2026-03-29 18:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 18:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 18:30:06 [auto1.de] INFO: Batch mode enabled: batch 1/2
2026-03-29 18:30:06 [auto1.de] INFO: Starting spider auto1.de
2026-03-29 18:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 18:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 18:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 18:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 18:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: d3d1e5fde1b614fc
2026-03-29 18:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-29 18:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_17_2026-03-29T18_30_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-29 18:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 18:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 18:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 18:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 18:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 18:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 18:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 18:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-29 18:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 18:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 18:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 18:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 18:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 18:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 18:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 18:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 18:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 18:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 18:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-29 18:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 18:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 18:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 18:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 18:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 18:30:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 18:30:16 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 6740 | hits on page: 40
2026-03-29 18:30:16 [auto1.de] INFO: Found listing with ID: GT74179
2026-03-29 18:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT74179%27 HTTP/1.1" 200 None
2026-03-29 18:30:16 [auto1.de] INFO: Scrape type for GT74179: 2
2026-03-29 18:30:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68df837f-99ef-5edc-8812-2b4d0a42f475 with identifier: GT74179
2026-03-29 18:30:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68df837f-99ef-5edc-8812-2b4d0a42f475 with scrape type 2
2026-03-29 18:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68df837f-99ef-5edc-8812-2b4d0a42f475 with scrape type 2
2026-03-29 18:30:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68df837f-99ef-5edc-8812-2b4d0a42f475, identifier: GT74179
2026-03-29 18:30:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68df837f-99ef-5edc-8812-2b4d0a42f475 with identifier: GT74179
2026-03-29 18:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:30:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 18:30:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:30:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 18:30:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:30:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68df837f-99ef-5edc-8812-2b4d0a42f475 with identifier: GT74179
2026-03-29 18:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68df837f-99ef-5edc-8812-2b4d0a42f475 with identifier: GT74179 to the API
2026-03-29 18:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:11:43Z',
'fuel_type': 'petrol',
'id': '68df837f-99ef-5edc-8812-2b4d0a42f475',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT74179',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 96331,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-26',
'seller_name': None,
'title': 'Renault Captur 1.3 TCe Version S',
'transmission': 'automatic',
'trim': 'Version S',
'year': 2018}
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT74179%27 HTTP/1.1" 200 None
2026-03-29 18:30:18 [auto1.de] INFO: Saving data for GT74179: {'auction_closing_time': 1774883503.0, 'created_time': 1774551717.852264, 'last_price_update_time': 1774809018.216464}
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT74179') HTTP/1.1" 204 0
2026-03-29 18:30:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:18 [auto1.de] INFO: Found listing with ID: ZP13586
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP13586%27 HTTP/1.1" 200 None
2026-03-29 18:30:18 [auto1.de] INFO: Scrape type for ZP13586: 2
2026-03-29 18:30:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b46d55c6-26ad-5c4b-9358-2953a73083d4 with identifier: ZP13586
2026-03-29 18:30:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b46d55c6-26ad-5c4b-9358-2953a73083d4 with scrape type 2
2026-03-29 18:30:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b46d55c6-26ad-5c4b-9358-2953a73083d4 with scrape type 2
2026-03-29 18:30:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b46d55c6-26ad-5c4b-9358-2953a73083d4, identifier: ZP13586
2026-03-29 18:30:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b46d55c6-26ad-5c4b-9358-2953a73083d4 with identifier: ZP13586
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 18:30:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-29 18:30:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:30:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b46d55c6-26ad-5c4b-9358-2953a73083d4 with identifier: ZP13586
2026-03-29 18:30:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b46d55c6-26ad-5c4b-9358-2953a73083d4 with identifier: ZP13586 to the API
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 428,
'expiration_date': '2026-03-30T15:31:14Z',
'fuel_type': 'electro',
'id': 'b46d55c6-26ad-5c4b-9358-2953a73083d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP13586',
'listing': 'auction',
'make': 'Smart',
'model': '#1',
'odometer': 63162,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-29',
'seller_name': None,
'title': 'Smart #1 electric drive 315 kW 4WD Brabus',
'transmission': 'automatic',
'trim': '4WD Brabus',
'year': 2023}
2026-03-29 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP13586%27 HTTP/1.1" 200 None
2026-03-29 18:30:19 [auto1.de] INFO: Saving data for ZP13586: {'auction_closing_time': 1774884674.0, 'created_time': 1774552200.762412, 'last_price_update_time': 1774809019.007054}
2026-03-29 18:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP13586') HTTP/1.1" 204 0
2026-03-29 18:30:19 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-29 18:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01619%27 HTTP/1.1" 200 None
2026-03-29 18:30:19 [auto1.de] INFO: Scrape type for LT01619: 2
2026-03-29 18:30:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4046676-6435-5e91-87ab-219156d2405f with identifier: LT01619
2026-03-29 18:30:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4046676-6435-5e91-87ab-219156d2405f with scrape type 2
2026-03-29 18:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4046676-6435-5e91-87ab-219156d2405f with scrape type 2
2026-03-29 18:30:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4046676-6435-5e91-87ab-219156d2405f, identifier: LT01619
2026-03-29 18:30:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4046676-6435-5e91-87ab-219156d2405f with identifier: LT01619
2026-03-29 18:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:30:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 18:30:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:30:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 18:30:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:30:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4046676-6435-5e91-87ab-219156d2405f with identifier: LT01619
2026-03-29 18:30:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4046676-6435-5e91-87ab-219156d2405f with identifier: LT01619 to the API
2026-03-29 18:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:27:08Z',
'fuel_type': 'diesel',
'id': 'b4046676-6435-5e91-87ab-219156d2405f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT01619',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 260500,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-14',
'seller_name': None,
'title': 'BMW X5 3.0d',
'transmission': 'automatic',
'trim': '',
'year': 2006}
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01619%27 HTTP/1.1" 200 None
2026-03-29 18:30:20 [auto1.de] INFO: Saving data for LT01619: {'auction_closing_time': 1774884428.0, 'created_time': 1774639231.677834, 'last_price_update_time': 1774809020.165819}
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT01619') HTTP/1.1" 204 0
2026-03-29 18:30:20 [auto1.de] INFO: Found listing with ID: YW85241
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW85241%27 HTTP/1.1" 200 None
2026-03-29 18:30:20 [auto1.de] INFO: Scrape type for YW85241: 1
2026-03-29 18:30:20 [auto1.de] INFO: Found listing with ID: UX63116
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX63116%27 HTTP/1.1" 200 None
2026-03-29 18:30:20 [auto1.de] INFO: Scrape type for UX63116: 1
2026-03-29 18:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:20 [auto1.de] INFO: Found listing with ID: BX27275
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX27275%27 HTTP/1.1" 200 None
2026-03-29 18:30:20 [auto1.de] INFO: Scrape type for BX27275: 1
2026-03-29 18:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:20 [auto1.de] INFO: Found listing with ID: XK12555
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK12555%27 HTTP/1.1" 200 None
2026-03-29 18:30:20 [auto1.de] INFO: Scrape type for XK12555: 2
2026-03-29 18:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 151a9c20-41e0-5a48-91f3-24e70acb5f18 with identifier: XK12555
2026-03-29 18:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 151a9c20-41e0-5a48-91f3-24e70acb5f18 with scrape type 2
2026-03-29 18:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 151a9c20-41e0-5a48-91f3-24e70acb5f18 with scrape type 2
2026-03-29 18:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 151a9c20-41e0-5a48-91f3-24e70acb5f18, identifier: XK12555
2026-03-29 18:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 151a9c20-41e0-5a48-91f3-24e70acb5f18 with identifier: XK12555
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 18:30:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 18:30:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 151a9c20-41e0-5a48-91f3-24e70acb5f18 with identifier: XK12555
2026-03-29 18:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 151a9c20-41e0-5a48-91f3-24e70acb5f18 with identifier: XK12555 to the API
2026-03-29 18:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:30:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 211,
'expiration_date': '2026-03-30T15:55:13Z',
'fuel_type': 'hybrid',
'id': '151a9c20-41e0-5a48-91f3-24e70acb5f18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK12555',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 106630,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-28',
'seller_name': None,
'title': 'Volvo XC40 1.5 T4 Recharge Plug-in Hybrid Core 2WD',
'transmission': 'automatic',
'trim': 'Core 2WD',
'year': 2022}
2026-03-29 18:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK12555%27 HTTP/1.1" 200 None
2026-03-29 18:30:21 [auto1.de] INFO: Saving data for XK12555: {'auction_closing_time': 1774886113.0, 'created_time': 1774034565.775824, 'last_price_update_time': 1774809021.753669}
2026-03-29 18:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK12555') HTTP/1.1" 204 0
2026-03-29 18:30:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:21 [auto1.de] INFO: Found listing with ID: ZJ08126
2026-03-29 18:30:21 [auto1.de] INFO: Found listing with ID: VN44067
2026-03-29 18:30:21 [auto1.de] INFO: Found listing with ID: BR93746
2026-03-29 18:30:21 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-29 18:30:21 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-29 18:30:21 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-29 18:30:21 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-29 18:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT99965%27 HTTP/1.1" 200 None
2026-03-29 18:30:21 [auto1.de] INFO: Scrape type for MT99965: 2
2026-03-29 18:30:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 713956ed-c174-57e8-808c-970c1b4652d0 with identifier: MT99965
2026-03-29 18:30:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 713956ed-c174-57e8-808c-970c1b4652d0 with scrape type 2
2026-03-29 18:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 713956ed-c174-57e8-808c-970c1b4652d0 with scrape type 2
2026-03-29 18:30:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 713956ed-c174-57e8-808c-970c1b4652d0, identifier: MT99965
2026-03-29 18:30:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 713956ed-c174-57e8-808c-970c1b4652d0 with identifier: MT99965
2026-03-29 18:30:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 713956ed-c174-57e8-808c-970c1b4652d0 with identifier: MT99965
2026-03-29 18:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 713956ed-c174-57e8-808c-970c1b4652d0 with identifier: MT99965 to the API
2026-03-29 18:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:23:32Z',
'fuel_type': 'diesel',
'id': '713956ed-c174-57e8-808c-970c1b4652d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT99965',
'listing': 'auction',
'make': 'Citroen',
'model': 'DS5',
'odometer': 250390,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-29',
'seller_name': None,
'title': 'Citroen DS5 2.0 HDi SoChic',
'transmission': 'manual',
'trim': 'SoChic',
'year': 2013}
2026-03-29 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT99965%27 HTTP/1.1" 200 None
2026-03-29 18:30:22 [auto1.de] INFO: Saving data for MT99965: {'auction_closing_time': 1774884212.0, 'created_time': 1774552740.478243, 'last_price_update_time': 1774809022.390816}
2026-03-29 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT99965') HTTP/1.1" 204 0
2026-03-29 18:30:22 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-29 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW74632%27 HTTP/1.1" 200 None
2026-03-29 18:30:22 [auto1.de] INFO: Scrape type for PW74632: 2
2026-03-29 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 349d2b11-3d43-5921-a36c-b6d9cc409b96 with identifier: PW74632
2026-03-29 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 349d2b11-3d43-5921-a36c-b6d9cc409b96 with scrape type 2
2026-03-29 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 349d2b11-3d43-5921-a36c-b6d9cc409b96 with scrape type 2
2026-03-29 18:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 349d2b11-3d43-5921-a36c-b6d9cc409b96, identifier: PW74632
2026-03-29 18:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 349d2b11-3d43-5921-a36c-b6d9cc409b96 with identifier: PW74632
2026-03-29 18:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 349d2b11-3d43-5921-a36c-b6d9cc409b96 with identifier: PW74632
2026-03-29 18:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 349d2b11-3d43-5921-a36c-b6d9cc409b96 with identifier: PW74632 to the API
2026-03-29 18:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 193,
'expiration_date': '2026-03-30T15:31:58Z',
'fuel_type': 'petrol',
'id': '349d2b11-3d43-5921-a36c-b6d9cc409b96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW74632',
'listing': 'auction',
'make': 'BMW',
'model': '7er',
'odometer': 339977,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-03-11',
'seller_name': None,
'title': 'BMW 7er 728i',
'transmission': 'automatic',
'trim': '',
'year': 1999}
2026-03-29 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW74632%27 HTTP/1.1" 200 None
2026-03-29 18:30:23 [auto1.de] INFO: Saving data for PW74632: {'auction_closing_time': 1774884718.0, 'created_time': 1774637927.123262, 'last_price_update_time': 1774809023.029438}
2026-03-29 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW74632') HTTP/1.1" 204 0
2026-03-29 18:30:23 [auto1.de] INFO: Found listing with ID: ME72449
2026-03-29 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72449%27 HTTP/1.1" 200 None
2026-03-29 18:30:23 [auto1.de] INFO: Scrape type for ME72449: 2
2026-03-29 18:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03b27062-dd8d-5aa4-94ef-d21818ea03ac with identifier: ME72449
2026-03-29 18:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03b27062-dd8d-5aa4-94ef-d21818ea03ac with scrape type 2
2026-03-29 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03b27062-dd8d-5aa4-94ef-d21818ea03ac with scrape type 2
2026-03-29 18:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03b27062-dd8d-5aa4-94ef-d21818ea03ac, identifier: ME72449
2026-03-29 18:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03b27062-dd8d-5aa4-94ef-d21818ea03ac with identifier: ME72449
2026-03-29 18:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03b27062-dd8d-5aa4-94ef-d21818ea03ac with identifier: ME72449
2026-03-29 18:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03b27062-dd8d-5aa4-94ef-d21818ea03ac with identifier: ME72449 to the API
2026-03-29 18:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 50,
'expiration_date': '2026-03-30T15:12:00Z',
'fuel_type': 'petrol',
'id': '03b27062-dd8d-5aa4-94ef-d21818ea03ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME72449',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 191710,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-11-08',
'seller_name': None,
'title': 'Smart fortwo 0.7 Turbo Basis pure',
'transmission': 'automatic',
'trim': 'Basis pure',
'year': 2004}
2026-03-29 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72449%27 HTTP/1.1" 200 None
2026-03-29 18:30:24 [auto1.de] INFO: Saving data for ME72449: {'auction_closing_time': 1774883520.0, 'created_time': 1774549899.711049, 'last_price_update_time': 1774809024.593216}
2026-03-29 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME72449') HTTP/1.1" 204 0
2026-03-29 18:30:24 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-29 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR66468%27 HTTP/1.1" 200 None
2026-03-29 18:30:24 [auto1.de] INFO: Scrape type for KR66468: 2
2026-03-29 18:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8145828b-9c8a-59f3-8a33-b13ce1332643 with identifier: KR66468
2026-03-29 18:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8145828b-9c8a-59f3-8a33-b13ce1332643 with scrape type 2
2026-03-29 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8145828b-9c8a-59f3-8a33-b13ce1332643 with scrape type 2
2026-03-29 18:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8145828b-9c8a-59f3-8a33-b13ce1332643, identifier: KR66468
2026-03-29 18:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8145828b-9c8a-59f3-8a33-b13ce1332643 with identifier: KR66468
2026-03-29 18:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8145828b-9c8a-59f3-8a33-b13ce1332643 with identifier: KR66468
2026-03-29 18:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8145828b-9c8a-59f3-8a33-b13ce1332643 with identifier: KR66468 to the API
2026-03-29 18:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:07:37Z',
'fuel_type': 'diesel',
'id': '8145828b-9c8a-59f3-8a33-b13ce1332643',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR66468',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 234612,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-24',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline 4Motion BlueMotion',
'year': 2017}
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR66468%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Saving data for KR66468: {'auction_closing_time': 1774883257.0, 'created_time': 1774551514.125757, 'last_price_update_time': 1774809025.132585}
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR66468') HTTP/1.1" 204 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76020%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Scrape type for RT76020: 2
2026-03-29 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc676309-1b4e-5257-8762-693ff4f864a1 with identifier: RT76020
2026-03-29 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc676309-1b4e-5257-8762-693ff4f864a1 with scrape type 2
2026-03-29 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc676309-1b4e-5257-8762-693ff4f864a1 with scrape type 2
2026-03-29 18:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc676309-1b4e-5257-8762-693ff4f864a1, identifier: RT76020
2026-03-29 18:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc676309-1b4e-5257-8762-693ff4f864a1 with identifier: RT76020
2026-03-29 18:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc676309-1b4e-5257-8762-693ff4f864a1 with identifier: RT76020
2026-03-29 18:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc676309-1b4e-5257-8762-693ff4f864a1 with identifier: RT76020 to the API
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:43:32Z',
'fuel_type': 'petrol',
'id': 'bc676309-1b4e-5257-8762-693ff4f864a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT76020',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Space Star',
'odometer': 73695,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-05',
'seller_name': None,
'title': 'Mitsubishi Space Star 1.2 Diamant Edition+',
'transmission': 'manual',
'trim': 'Diamant Edition+',
'year': 2019}
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76020%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Saving data for RT76020: {'auction_closing_time': 1774885412.0, 'created_time': 1774467484.714932, 'last_price_update_time': 1774809025.733402}
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT76020') HTTP/1.1" 204 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA16616%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Scrape type for SA16616: 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN36676%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Scrape type for HN36676: 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX89684%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Scrape type for BX89684: 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: AB70277
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: GN07930
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: HM22337
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM22337%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Scrape type for HM22337: 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP03054%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Scrape type for MP03054: 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF20752%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Scrape type for PF20752: 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: JM25076
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM25076%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Scrape type for JM25076: 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD80802%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Scrape type for HD80802: 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: CR70620
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70620%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Scrape type for CR70620: 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: DY40129
2026-03-29 18:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW85241/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UX63116/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX27275/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:25 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 6740 | hits on page: 40
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: GT74179
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT74179%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Scrape type for GT74179: 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: ZP13586
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP13586%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Scrape type for ZP13586: 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01619%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Scrape type for LT01619: 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: YW85241
2026-03-29 18:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:25 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/YW85241/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: UX63116
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: BX27275
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: XK12555
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK12555%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Scrape type for XK12555: 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: ZJ08126
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: VN44067
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: BR93746
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT99965%27 HTTP/1.1" 200 None
2026-03-29 18:30:25 [auto1.de] INFO: Scrape type for MT99965: 0
2026-03-29 18:30:25 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-29 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW74632%27 HTTP/1.1" 200 None
2026-03-29 18:30:26 [auto1.de] INFO: Scrape type for PW74632: 0
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: ME72449
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72449%27 HTTP/1.1" 200 None
2026-03-29 18:30:26 [auto1.de] INFO: Scrape type for ME72449: 0
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR66468%27 HTTP/1.1" 200 None
2026-03-29 18:30:26 [auto1.de] INFO: Scrape type for KR66468: 0
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76020%27 HTTP/1.1" 200 None
2026-03-29 18:30:26 [auto1.de] INFO: Scrape type for RT76020: 0
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA16616%27 HTTP/1.1" 200 None
2026-03-29 18:30:26 [auto1.de] INFO: Scrape type for SA16616: 0
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN36676%27 HTTP/1.1" 200 None
2026-03-29 18:30:26 [auto1.de] INFO: Scrape type for HN36676: 0
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX89684%27 HTTP/1.1" 200 None
2026-03-29 18:30:26 [auto1.de] INFO: Scrape type for BX89684: 0
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: AB70277
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: GN07930
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: HM22337
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM22337%27 HTTP/1.1" 200 None
2026-03-29 18:30:26 [auto1.de] INFO: Scrape type for HM22337: 0
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP03054%27 HTTP/1.1" 200 None
2026-03-29 18:30:26 [auto1.de] INFO: Scrape type for MP03054: 0
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF20752%27 HTTP/1.1" 200 None
2026-03-29 18:30:26 [auto1.de] INFO: Scrape type for PF20752: 0
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: JM25076
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM25076%27 HTTP/1.1" 200 None
2026-03-29 18:30:26 [auto1.de] INFO: Scrape type for JM25076: 0
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD80802%27 HTTP/1.1" 200 None
2026-03-29 18:30:26 [auto1.de] INFO: Scrape type for HD80802: 0
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: CR70620
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70620%27 HTTP/1.1" 200 None
2026-03-29 18:30:26 [auto1.de] INFO: Scrape type for CR70620: 0
2026-03-29 18:30:26 [auto1.de] INFO: Found listing with ID: DY40129
2026-03-29 18:30:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW85241> (referer: https://www.auto1.com/v1/car-details-view/YW85241/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UX63116> (referer: https://www.auto1.com/v1/car-details-view/UX63116/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 223b2e55-4bcb-50c7-84c2-839ef7e91a6a with identifier: YW85241
2026-03-29 18:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 223b2e55-4bcb-50c7-84c2-839ef7e91a6a with scrape type 1
2026-03-29 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 223b2e55-4bcb-50c7-84c2-839ef7e91a6a
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F0b%252F1a0b953bb1bfaccc1e5e033977d82262%252Fpa%252FYW85241_0ee21557c7019f7d132f98562b273236.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_0ee21557c7019f7d132f98562b273236.jpg already downloaded
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F0b%252F1a0b953bb1bfaccc1e5e033977d82262%252Fpa%252FYW85241_962affd4c2c5e302e4e65608f0291786.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_962affd4c2c5e302e4e65608f0291786.jpg already downloaded
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F0b%252F1a0b953bb1bfaccc1e5e033977d82262%252Fpa%252FYW85241_76fd9be5295b7696d9a3a04113313190.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_76fd9be5295b7696d9a3a04113313190.jpg already downloaded
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F0b%252F1a0b953bb1bfaccc1e5e033977d82262%252Fpa%252FYW85241_4bf3a5f45f4e41af06f77c22fb28d5d9.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_4bf3a5f45f4e41af06f77c22fb28d5d9.jpg already downloaded
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F0b%252F1a0b953bb1bfaccc1e5e033977d82262%252Fpa%252FYW85241_480ff4f5f0f499c02837da38b0d03f87.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_480ff4f5f0f499c02837da38b0d03f87.jpg already downloaded
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F0b%252F1a0b953bb1bfaccc1e5e033977d82262%252Fpa%252FYW85241_96b4a1bc1a3f92170887707b668d11c1.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_96b4a1bc1a3f92170887707b668d11c1.jpg already downloaded
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F0b%252F1a0b953bb1bfaccc1e5e033977d82262%252Fpa%252FYW85241_63b9b541a26fefdd478ca71f61d325b8.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_63b9b541a26fefdd478ca71f61d325b8.jpg already downloaded
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F0b%252F1a0b953bb1bfaccc1e5e033977d82262%252Fpa%252FYW85241_c3c59181eaf36d97bbce175a83dc1feb.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_c3c59181eaf36d97bbce175a83dc1feb.jpg already downloaded
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F0b%252F1a0b953bb1bfaccc1e5e033977d82262%252Fpa%252FYW85241_007a19db1b7f0e4a828a9c1056a7876c.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_007a19db1b7f0e4a828a9c1056a7876c.jpg already downloaded
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F0b%252F1a0b953bb1bfaccc1e5e033977d82262%252Fpa%252FYW85241_9edb62ba300e38ff6fd02b3ff50162aa.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_9edb62ba300e38ff6fd02b3ff50162aa.jpg already downloaded
2026-03-29 18:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 223b2e55-4bcb-50c7-84c2-839ef7e91a6a, identifier: YW85241
2026-03-29 18:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 223b2e55-4bcb-50c7-84c2-839ef7e91a6a with identifier: YW85241
2026-03-29 18:30:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 223b2e55-4bcb-50c7-84c2-839ef7e91a6a with identifier: YW85241
2026-03-29 18:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 223b2e55-4bcb-50c7-84c2-839ef7e91a6a with identifier: YW85241 to the API
2026-03-29 18:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YW85241>
{'auction_title': '',
'c_o_2_emission_value': 169,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:54:53Z',
'fuel_type': 'diesel',
'id': '223b2e55-4bcb-50c7-84c2-839ef7e91a6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW85241',
'listing': 'auction',
'location': 'DE',
'make': 'Volvo',
'model': 'XC60',
'odometer': 123927,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_0ee21557c7019f7d132f98562b273236.jpg',
'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_962affd4c2c5e302e4e65608f0291786.jpg',
'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_76fd9be5295b7696d9a3a04113313190.jpg',
'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_4bf3a5f45f4e41af06f77c22fb28d5d9.jpg',
'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_480ff4f5f0f499c02837da38b0d03f87.jpg',
'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_96b4a1bc1a3f92170887707b668d11c1.jpg',
'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_63b9b541a26fefdd478ca71f61d325b8.jpg',
'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_c3c59181eaf36d97bbce175a83dc1feb.jpg',
'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_007a19db1b7f0e4a828a9c1056a7876c.jpg',
'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_9edb62ba300e38ff6fd02b3ff50162aa.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223b2e55-4bcb-50c7-84c2-839ef7e91a6a/223b2e55-4bcb-50c7-84c2-839ef7e91a6a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_0ee21557c7019f7d132f98562b273236.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223b2e55-4bcb-50c7-84c2-839ef7e91a6a/223b2e55-4bcb-50c7-84c2-839ef7e91a6a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_962affd4c2c5e302e4e65608f0291786.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223b2e55-4bcb-50c7-84c2-839ef7e91a6a/223b2e55-4bcb-50c7-84c2-839ef7e91a6a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92915,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_76fd9be5295b7696d9a3a04113313190.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223b2e55-4bcb-50c7-84c2-839ef7e91a6a/223b2e55-4bcb-50c7-84c2-839ef7e91a6a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87496,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_4bf3a5f45f4e41af06f77c22fb28d5d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223b2e55-4bcb-50c7-84c2-839ef7e91a6a/223b2e55-4bcb-50c7-84c2-839ef7e91a6a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_480ff4f5f0f499c02837da38b0d03f87.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223b2e55-4bcb-50c7-84c2-839ef7e91a6a/223b2e55-4bcb-50c7-84c2-839ef7e91a6a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_96b4a1bc1a3f92170887707b668d11c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223b2e55-4bcb-50c7-84c2-839ef7e91a6a/223b2e55-4bcb-50c7-84c2-839ef7e91a6a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_63b9b541a26fefdd478ca71f61d325b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223b2e55-4bcb-50c7-84c2-839ef7e91a6a/223b2e55-4bcb-50c7-84c2-839ef7e91a6a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_c3c59181eaf36d97bbce175a83dc1feb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223b2e55-4bcb-50c7-84c2-839ef7e91a6a/223b2e55-4bcb-50c7-84c2-839ef7e91a6a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_007a19db1b7f0e4a828a9c1056a7876c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223b2e55-4bcb-50c7-84c2-839ef7e91a6a/223b2e55-4bcb-50c7-84c2-839ef7e91a6a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68131,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/0b/1a0b953bb1bfaccc1e5e033977d82262/pa/YW85241_9edb62ba300e38ff6fd02b3ff50162aa.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-08',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Ultimate Bright AWD',
'transmission': 'automatic',
'trim': 'Ultimate Bright AWD',
'year': 2023}
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW85241%27 HTTP/1.1" 200 None
2026-03-29 18:30:28 [auto1.de] INFO: Saving data for YW85241: {'created_time': 1774809028.236742, 'last_price_update_time': 1774809028.236753, 'auction_closing_time': 1774886093.0}
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW85241') HTTP/1.1" 204 0
2026-03-29 18:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX27275> (referer: https://www.auto1.com/v1/car-details-view/BX27275/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f27823b-12e9-5a09-a4c8-515819434c5f with identifier: UX63116
2026-03-29 18:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f27823b-12e9-5a09-a4c8-515819434c5f with scrape type 1
2026-03-29 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f27823b-12e9-5a09-a4c8-515819434c5f
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffc%252F72fca4e61af647481fb03d8079f27093%252Fpa%252FUX63116_6c560afbab3092054efb0cc53e9d678d.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_6c560afbab3092054efb0cc53e9d678d.jpg already downloaded
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffc%252F72fca4e61af647481fb03d8079f27093%252Fpa%252FUX63116_b87e8ca2c15f7dd90b220d79bc9b8124.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_b87e8ca2c15f7dd90b220d79bc9b8124.jpg already downloaded
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffc%252F72fca4e61af647481fb03d8079f27093%252Fpa%252FUX63116_4507cbe7921d61306a602a5448af7743.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_4507cbe7921d61306a602a5448af7743.jpg already downloaded
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffc%252F72fca4e61af647481fb03d8079f27093%252Fpa%252FUX63116_4f6c513a360018043b74e43eaca3d38c.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_4f6c513a360018043b74e43eaca3d38c.jpg already downloaded
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffc%252F72fca4e61af647481fb03d8079f27093%252Fpa%252FUX63116_0dd906e3c640ac212163c76de3450471.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_0dd906e3c640ac212163c76de3450471.jpg already downloaded
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffc%252F72fca4e61af647481fb03d8079f27093%252Fpa%252FUX63116_10d916b011c5f6a7680a8d693f57d23e.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_10d916b011c5f6a7680a8d693f57d23e.jpg already downloaded
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffc%252F72fca4e61af647481fb03d8079f27093%252Fpa%252FUX63116_faaf5dec17de4563cd4ec8cae8ca7121.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_faaf5dec17de4563cd4ec8cae8ca7121.jpg already downloaded
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffc%252F72fca4e61af647481fb03d8079f27093%252Fpa%252FUX63116_3ed9ae42d85dd69f7a548e459623ec35.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_3ed9ae42d85dd69f7a548e459623ec35.jpg already downloaded
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffc%252F72fca4e61af647481fb03d8079f27093%252Fpa%252FUX63116_bb17a32b96febe3420f8726d29d16e22.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_bb17a32b96febe3420f8726d29d16e22.jpg already downloaded
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ffc%252F72fca4e61af647481fb03d8079f27093%252Fpa%252FUX63116_afff51cbab0fd500517ec079e53f40a5.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_afff51cbab0fd500517ec079e53f40a5.jpg already downloaded
2026-03-29 18:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f27823b-12e9-5a09-a4c8-515819434c5f, identifier: UX63116
2026-03-29 18:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f27823b-12e9-5a09-a4c8-515819434c5f with identifier: UX63116
2026-03-29 18:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f27823b-12e9-5a09-a4c8-515819434c5f with identifier: UX63116
2026-03-29 18:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f27823b-12e9-5a09-a4c8-515819434c5f with identifier: UX63116 to the API
2026-03-29 18:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UX63116>
{'auction_title': '',
'c_o_2_emission_value': 24,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 398,
'expiration_date': '2026-03-30T15:42:22Z',
'fuel_type': 'hybrid',
'id': '1f27823b-12e9-5a09-a4c8-515819434c5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX63116',
'listing': 'auction',
'location': 'DE',
'make': 'Volvo',
'model': 'XC60',
'odometer': 49499,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_6c560afbab3092054efb0cc53e9d678d.jpg',
'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_b87e8ca2c15f7dd90b220d79bc9b8124.jpg',
'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_4507cbe7921d61306a602a5448af7743.jpg',
'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_4f6c513a360018043b74e43eaca3d38c.jpg',
'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_0dd906e3c640ac212163c76de3450471.jpg',
'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_10d916b011c5f6a7680a8d693f57d23e.jpg',
'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_faaf5dec17de4563cd4ec8cae8ca7121.jpg',
'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_3ed9ae42d85dd69f7a548e459623ec35.jpg',
'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_bb17a32b96febe3420f8726d29d16e22.jpg',
'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_afff51cbab0fd500517ec079e53f40a5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f27823b-12e9-5a09-a4c8-515819434c5f/1f27823b-12e9-5a09-a4c8-515819434c5f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_6c560afbab3092054efb0cc53e9d678d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f27823b-12e9-5a09-a4c8-515819434c5f/1f27823b-12e9-5a09-a4c8-515819434c5f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_b87e8ca2c15f7dd90b220d79bc9b8124.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f27823b-12e9-5a09-a4c8-515819434c5f/1f27823b-12e9-5a09-a4c8-515819434c5f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_4507cbe7921d61306a602a5448af7743.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f27823b-12e9-5a09-a4c8-515819434c5f/1f27823b-12e9-5a09-a4c8-515819434c5f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_4f6c513a360018043b74e43eaca3d38c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f27823b-12e9-5a09-a4c8-515819434c5f/1f27823b-12e9-5a09-a4c8-515819434c5f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_0dd906e3c640ac212163c76de3450471.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f27823b-12e9-5a09-a4c8-515819434c5f/1f27823b-12e9-5a09-a4c8-515819434c5f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79698,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_10d916b011c5f6a7680a8d693f57d23e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f27823b-12e9-5a09-a4c8-515819434c5f/1f27823b-12e9-5a09-a4c8-515819434c5f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86273,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_faaf5dec17de4563cd4ec8cae8ca7121.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f27823b-12e9-5a09-a4c8-515819434c5f/1f27823b-12e9-5a09-a4c8-515819434c5f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_3ed9ae42d85dd69f7a548e459623ec35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f27823b-12e9-5a09-a4c8-515819434c5f/1f27823b-12e9-5a09-a4c8-515819434c5f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69841,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_bb17a32b96febe3420f8726d29d16e22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f27823b-12e9-5a09-a4c8-515819434c5f/1f27823b-12e9-5a09-a4c8-515819434c5f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/fc/72fca4e61af647481fb03d8079f27093/pa/UX63116_afff51cbab0fd500517ec079e53f40a5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-12-08',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 T6 Twin Engine Recharge Plug-in Hybrid Inscription '
'Expression AWD',
'transmission': 'automatic',
'trim': 'Inscription Expression AWD',
'year': 2022}
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX63116%27 HTTP/1.1" 200 None
2026-03-29 18:30:29 [auto1.de] INFO: Saving data for UX63116: {'created_time': 1774809029.156398, 'last_price_update_time': 1774809029.156409, 'auction_closing_time': 1774885342.0}
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX63116') HTTP/1.1" 204 0
2026-03-29 18:30:29 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 6740 | hits on page: 40
2026-03-29 18:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f370120-ba94-5a77-92f4-e7ff14c9abbe with identifier: BX27275
2026-03-29 18:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f370120-ba94-5a77-92f4-e7ff14c9abbe with scrape type 1
2026-03-29 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f370120-ba94-5a77-92f4-e7ff14c9abbe
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9bf66ee81cf81fa00c80920b3409b1%252Fpa%252FBX27275_35d97d27e87eb074d20b9e21e8a85b61.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_35d97d27e87eb074d20b9e21e8a85b61.jpg already downloaded
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9bf66ee81cf81fa00c80920b3409b1%252Fpa%252FBX27275_a9d0ff088409f615f2663b658e3d0cfc.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_a9d0ff088409f615f2663b658e3d0cfc.jpg already downloaded
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9bf66ee81cf81fa00c80920b3409b1%252Fpa%252FBX27275_e28553d6a4884e1ea97097d8608d22d9.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_e28553d6a4884e1ea97097d8608d22d9.jpg already downloaded
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9bf66ee81cf81fa00c80920b3409b1%252Fpa%252FBX27275_ffbf8faf222cc299122055ed03cd33ca.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_ffbf8faf222cc299122055ed03cd33ca.jpg already downloaded
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9bf66ee81cf81fa00c80920b3409b1%252Fpa%252FBX27275_4f7036e8402d1103773cacd5784a4ba1.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_4f7036e8402d1103773cacd5784a4ba1.jpg already downloaded
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9bf66ee81cf81fa00c80920b3409b1%252Fpa%252FBX27275_69e7b1b93e855c32cd1ec3a754d2589b.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_69e7b1b93e855c32cd1ec3a754d2589b.jpg already downloaded
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9bf66ee81cf81fa00c80920b3409b1%252Fpa%252FBX27275_c5fc0ea6cdfad036733bd278daa2f708.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_c5fc0ea6cdfad036733bd278daa2f708.jpg already downloaded
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9bf66ee81cf81fa00c80920b3409b1%252Fpa%252FBX27275_d4b4b22ab2323355cf6d2d5ea3ec5f37.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_d4b4b22ab2323355cf6d2d5ea3ec5f37.jpg already downloaded
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9bf66ee81cf81fa00c80920b3409b1%252Fpa%252FBX27275_ad6a987f21792ca28bfc31450174a1c6.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_ad6a987f21792ca28bfc31450174a1c6.jpg already downloaded
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9bf66ee81cf81fa00c80920b3409b1%252Fpa%252FBX27275_26e15bacb7f6fe6bf580832106e46562.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_26e15bacb7f6fe6bf580832106e46562.jpg already downloaded
2026-03-29 18:30:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f370120-ba94-5a77-92f4-e7ff14c9abbe, identifier: BX27275
2026-03-29 18:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f370120-ba94-5a77-92f4-e7ff14c9abbe with identifier: BX27275
2026-03-29 18:30:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f370120-ba94-5a77-92f4-e7ff14c9abbe with identifier: BX27275
2026-03-29 18:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f370120-ba94-5a77-92f4-e7ff14c9abbe with identifier: BX27275 to the API
2026-03-29 18:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BX27275>
{'auction_title': '',
'c_o_2_emission_value': 49,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 341,
'expiration_date': '2026-03-30T15:34:50Z',
'fuel_type': 'hybrid',
'id': '8f370120-ba94-5a77-92f4-e7ff14c9abbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX27275',
'listing': 'auction',
'location': 'DE',
'make': 'Volvo',
'model': 'V90',
'odometer': 103009,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_35d97d27e87eb074d20b9e21e8a85b61.jpg',
'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_a9d0ff088409f615f2663b658e3d0cfc.jpg',
'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_e28553d6a4884e1ea97097d8608d22d9.jpg',
'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_ffbf8faf222cc299122055ed03cd33ca.jpg',
'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_4f7036e8402d1103773cacd5784a4ba1.jpg',
'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_69e7b1b93e855c32cd1ec3a754d2589b.jpg',
'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_c5fc0ea6cdfad036733bd278daa2f708.jpg',
'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_d4b4b22ab2323355cf6d2d5ea3ec5f37.jpg',
'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_ad6a987f21792ca28bfc31450174a1c6.jpg',
'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_26e15bacb7f6fe6bf580832106e46562.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f370120-ba94-5a77-92f4-e7ff14c9abbe/8f370120-ba94-5a77-92f4-e7ff14c9abbe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84268,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_35d97d27e87eb074d20b9e21e8a85b61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f370120-ba94-5a77-92f4-e7ff14c9abbe/8f370120-ba94-5a77-92f4-e7ff14c9abbe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_a9d0ff088409f615f2663b658e3d0cfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f370120-ba94-5a77-92f4-e7ff14c9abbe/8f370120-ba94-5a77-92f4-e7ff14c9abbe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_e28553d6a4884e1ea97097d8608d22d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f370120-ba94-5a77-92f4-e7ff14c9abbe/8f370120-ba94-5a77-92f4-e7ff14c9abbe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_ffbf8faf222cc299122055ed03cd33ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f370120-ba94-5a77-92f4-e7ff14c9abbe/8f370120-ba94-5a77-92f4-e7ff14c9abbe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_4f7036e8402d1103773cacd5784a4ba1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f370120-ba94-5a77-92f4-e7ff14c9abbe/8f370120-ba94-5a77-92f4-e7ff14c9abbe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_69e7b1b93e855c32cd1ec3a754d2589b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f370120-ba94-5a77-92f4-e7ff14c9abbe/8f370120-ba94-5a77-92f4-e7ff14c9abbe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_c5fc0ea6cdfad036733bd278daa2f708.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f370120-ba94-5a77-92f4-e7ff14c9abbe/8f370120-ba94-5a77-92f4-e7ff14c9abbe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85504,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_d4b4b22ab2323355cf6d2d5ea3ec5f37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f370120-ba94-5a77-92f4-e7ff14c9abbe/8f370120-ba94-5a77-92f4-e7ff14c9abbe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_ad6a987f21792ca28bfc31450174a1c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f370120-ba94-5a77-92f4-e7ff14c9abbe/8f370120-ba94-5a77-92f4-e7ff14c9abbe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58683,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9bf66ee81cf81fa00c80920b3409b1/pa/BX27275_26e15bacb7f6fe6bf580832106e46562.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-16',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V90 2.0 T6 Plug-in Hybrid Inscription Expression AWD',
'transmission': 'automatic',
'trim': 'Inscription Expression AWD',
'year': 2020}
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX27275%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Saving data for BX27275: {'created_time': 1774809031.443694, 'last_price_update_time': 1774809031.443704, 'auction_closing_time': 1774884890.0}
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX27275') HTTP/1.1" 204 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: BV77129
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: PX43483
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX43483%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for PX43483: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY87536%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for FY87536: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: KS38701
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS38701%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for KS38701: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: ZY10708
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: HC26014
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: LN64409
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN64409%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for LN64409: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: RC36772
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: UG24074
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24074%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for UG24074: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE36292%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for RE36292: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA01516%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for ZA01516: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: KF39369
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX65869%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for NX65869: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: CX65130
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: EM69588
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69588%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for EM69588: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: FY70837
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: YL11317
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: RA38840
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA38840%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for RA38840: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: ZH40630
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: RR52693
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: NK75444
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: ES51146
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES51146%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for ES51146: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: RC32924
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC32924%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for RC32924: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: AA06623
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: VY63295
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: XN76849
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN76849%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for XN76849: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: KV42803
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: XF10018
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF10018%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for XF10018: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: TJ48176
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ48176%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for TJ48176: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: WW07339
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW07339%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for WW07339: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: NH05952
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: MM90300
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: HT08782
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT08782%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for HT08782: 0
2026-03-29 18:30:31 [auto1.de] INFO: Found listing with ID: UH53806
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH53806%27 HTTP/1.1" 200 None
2026-03-29 18:30:31 [auto1.de] INFO: Scrape type for UH53806: 0
2026-03-29 18:30:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:32 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 6740 | hits on page: 40
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: LE65557
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: LJ58074
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: YY18465
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: VC28435
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC28435%27 HTTP/1.1" 200 None
2026-03-29 18:30:32 [auto1.de] INFO: Scrape type for VC28435: 0
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: HJ76482
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: KP69989
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: GT35568
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT35568%27 HTTP/1.1" 200 None
2026-03-29 18:30:32 [auto1.de] INFO: Scrape type for GT35568: 0
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: TJ90592
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ90592%27 HTTP/1.1" 200 None
2026-03-29 18:30:32 [auto1.de] INFO: Scrape type for TJ90592: 0
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: ZS29776
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: PJ98033
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: CV58900
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV58900%27 HTTP/1.1" 200 None
2026-03-29 18:30:32 [auto1.de] INFO: Scrape type for CV58900: 0
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: RG53469
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG53469%27 HTTP/1.1" 200 None
2026-03-29 18:30:32 [auto1.de] INFO: Scrape type for RG53469: 0
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: AT97457
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT97457%27 HTTP/1.1" 200 None
2026-03-29 18:30:32 [auto1.de] INFO: Scrape type for AT97457: 0
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: DS41181
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS41181%27 HTTP/1.1" 200 None
2026-03-29 18:30:32 [auto1.de] INFO: Scrape type for DS41181: 0
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: WY61426
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY61426%27 HTTP/1.1" 200 None
2026-03-29 18:30:32 [auto1.de] INFO: Scrape type for WY61426: 0
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: ZA83090
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: BV92050
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV92050%27 HTTP/1.1" 200 None
2026-03-29 18:30:32 [auto1.de] INFO: Scrape type for BV92050: 0
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: UL88623
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL88623%27 HTTP/1.1" 200 None
2026-03-29 18:30:32 [auto1.de] INFO: Scrape type for UL88623: 0
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: NX62884
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: NW73502
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW73502%27 HTTP/1.1" 200 None
2026-03-29 18:30:32 [auto1.de] INFO: Scrape type for NW73502: 0
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: BV67523
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV67523%27 HTTP/1.1" 200 None
2026-03-29 18:30:32 [auto1.de] INFO: Scrape type for BV67523: 0
2026-03-29 18:30:32 [auto1.de] INFO: Found listing with ID: NW01649
2026-03-29 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01649%27 HTTP/1.1" 200 None
2026-03-29 18:30:33 [auto1.de] INFO: Scrape type for NW01649: 0
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: SN44411
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN44411%27 HTTP/1.1" 200 None
2026-03-29 18:30:33 [auto1.de] INFO: Scrape type for SN44411: 0
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: BJ40023
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ40023%27 HTTP/1.1" 200 None
2026-03-29 18:30:33 [auto1.de] INFO: Scrape type for BJ40023: 0
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: GM20688
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: HA10005
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: VR35896
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR35896%27 HTTP/1.1" 200 None
2026-03-29 18:30:33 [auto1.de] INFO: Scrape type for VR35896: 0
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: CZ25681
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: CG76921
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG76921%27 HTTP/1.1" 200 None
2026-03-29 18:30:33 [auto1.de] INFO: Scrape type for CG76921: 0
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: JT14161
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14161%27 HTTP/1.1" 200 None
2026-03-29 18:30:33 [auto1.de] INFO: Scrape type for JT14161: 0
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: LN95655
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN95655%27 HTTP/1.1" 200 None
2026-03-29 18:30:33 [auto1.de] INFO: Scrape type for LN95655: 0
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: WF02803
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02803%27 HTTP/1.1" 200 None
2026-03-29 18:30:33 [auto1.de] INFO: Scrape type for WF02803: 0
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: UH31359
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: LG46226
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: BE23086
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: HP19661
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP19661%27 HTTP/1.1" 200 None
2026-03-29 18:30:33 [auto1.de] INFO: Scrape type for HP19661: 0
2026-03-29 18:30:33 [auto1.de] INFO: Found listing with ID: GN33586
2026-03-29 18:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:34 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 6740 | hits on page: 40
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: FA69463
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA69463%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for FA69463: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: WG22836
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG22836%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for WG22836: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: HN88809
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: NV36056
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: GF37615
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: VF27943
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27943%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for VF27943: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: EK20296
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: AF05413
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF05413%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for AF05413: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: MC98570
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: TU72063
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU72063%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for TU72063: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: JY14465
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: GC94975
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC94975%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for GC94975: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: ZR75909
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR75909%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for ZR75909: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: TT55225
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: EX17549
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: TE08681
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: HB21625
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: VE07121
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: RT89872
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT89872%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for RT89872: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: YW33550
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW33550%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for YW33550: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: VN24673
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN24673%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for VN24673: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: RL83760
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: HH17921
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: ZY88037
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY88037%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for ZY88037: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: MZ37823
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: NC19407
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: AA02702
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02702%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for AA02702: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: KG90894
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG90894%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for KG90894: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: WX41278
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41278%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for WX41278: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: RC66900
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC66900%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for RC66900: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: FF58085
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF58085%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for FF58085: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: XV56284
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: TR94323
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR94323%27 HTTP/1.1" 200 None
2026-03-29 18:30:34 [auto1.de] INFO: Scrape type for TR94323: 0
2026-03-29 18:30:34 [auto1.de] INFO: Found listing with ID: EJ33834
2026-03-29 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ33834%27 HTTP/1.1" 200 None
2026-03-29 18:30:35 [auto1.de] INFO: Scrape type for EJ33834: 0
2026-03-29 18:30:35 [auto1.de] INFO: Found listing with ID: KH07650
2026-03-29 18:30:35 [auto1.de] INFO: Found listing with ID: FN39592
2026-03-29 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN39592%27 HTTP/1.1" 200 None
2026-03-29 18:30:35 [auto1.de] INFO: Scrape type for FN39592: 0
2026-03-29 18:30:35 [auto1.de] INFO: Found listing with ID: VV83737
2026-03-29 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV83737%27 HTTP/1.1" 200 None
2026-03-29 18:30:35 [auto1.de] INFO: Scrape type for VV83737: 0
2026-03-29 18:30:35 [auto1.de] INFO: Found listing with ID: YV56430
2026-03-29 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV56430%27 HTTP/1.1" 200 None
2026-03-29 18:30:35 [auto1.de] INFO: Scrape type for YV56430: 0
2026-03-29 18:30:35 [auto1.de] INFO: Found listing with ID: BS63746
2026-03-29 18:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:36 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 6740 | hits on page: 40
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: MR97164
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: BD67330
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: JC71292
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: XY86775
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: EC15325
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC15325%27 HTTP/1.1" 200 None
2026-03-29 18:30:36 [auto1.de] INFO: Scrape type for EC15325: 0
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: TL60563
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL60563%27 HTTP/1.1" 200 None
2026-03-29 18:30:36 [auto1.de] INFO: Scrape type for TL60563: 0
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: GF90377
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: EX05236
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: RR70760
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: FY44506
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: DC02620
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: LF08399
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: XW84981
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW84981%27 HTTP/1.1" 200 None
2026-03-29 18:30:36 [auto1.de] INFO: Scrape type for XW84981: 0
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: MT41300
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: WT31487
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: XE54390
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE54390%27 HTTP/1.1" 200 None
2026-03-29 18:30:36 [auto1.de] INFO: Scrape type for XE54390: 0
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: HB92022
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: GT54138
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: US93398
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US93398%27 HTTP/1.1" 200 None
2026-03-29 18:30:36 [auto1.de] INFO: Scrape type for US93398: 0
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: WY12370
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY12370%27 HTTP/1.1" 200 None
2026-03-29 18:30:36 [auto1.de] INFO: Scrape type for WY12370: 0
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: UJ19896
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ19896%27 HTTP/1.1" 200 None
2026-03-29 18:30:36 [auto1.de] INFO: Scrape type for UJ19896: 0
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: LN54864
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN54864%27 HTTP/1.1" 200 None
2026-03-29 18:30:36 [auto1.de] INFO: Scrape type for LN54864: 0
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: ZL28977
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL28977%27 HTTP/1.1" 200 None
2026-03-29 18:30:36 [auto1.de] INFO: Scrape type for ZL28977: 0
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: GA07513
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: BS02635
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: FE29735
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE29735%27 HTTP/1.1" 200 None
2026-03-29 18:30:36 [auto1.de] INFO: Scrape type for FE29735: 0
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: TB77068
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: UB74163
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: NB51359
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: SP94156
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: KJ70545
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: XW55257
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW55257%27 HTTP/1.1" 200 None
2026-03-29 18:30:36 [auto1.de] INFO: Scrape type for XW55257: 0
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: NV52830
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: WM05984
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: TY76082
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: VN17699
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: FG48186
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48186%27 HTTP/1.1" 200 None
2026-03-29 18:30:36 [auto1.de] INFO: Scrape type for FG48186: 0
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: EC36111
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: WJ67809
2026-03-29 18:30:36 [auto1.de] INFO: Found listing with ID: GB77683
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB77683%27 HTTP/1.1" 200 None
2026-03-29 18:30:36 [auto1.de] INFO: Scrape type for GB77683: 0
2026-03-29 18:30:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:37 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 6740 | hits on page: 40
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: WZ39505
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ39505%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for WZ39505: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: YL47006
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL47006%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for YL47006: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: BT97276
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97276%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for BT97276: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ62660%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for UJ62660: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: JK20630
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: UY36184
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY36184%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for UY36184: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: WE06039
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: UR84816
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: UF70247
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: XA86799
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA86799%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for XA86799: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: SU99742
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU99742%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for SU99742: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: ZE87532
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE87532%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for ZE87532: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: ZJ67042
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: JY35599
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY35599%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for JY35599: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: PT45615
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT45615%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for PT45615: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: JA40486
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: JY67859
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY67859%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for JY67859: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: MG41395
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG41395%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for MG41395: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: SG28932
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28932%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for SG28932: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: ND21540
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: XG25622
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: DN18269
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN18269%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for DN18269: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: WK49951
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK49951%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for WK49951: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: VX95412
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: AE04688
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: HG95875
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG95875%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for HG95875: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: VW68690
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: NX61710
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: LG72403
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: KX92622
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: KY89472
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: WM17924
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM17924%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for WM17924: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: SV54413
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV54413%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for SV54413: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: CL13866
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL13866%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for CL13866: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: KP55119
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP55119%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for KP55119: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: BY81957
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY81957%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for BY81957: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: NJ51378
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ51378%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for NJ51378: 0
2026-03-29 18:30:37 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF02627%27 HTTP/1.1" 200 None
2026-03-29 18:30:37 [auto1.de] INFO: Scrape type for CF02627: 2
2026-03-29 18:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d777cb51-be22-582a-8544-509ff2400f61 with identifier: CF02627
2026-03-29 18:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d777cb51-be22-582a-8544-509ff2400f61 with scrape type 2
2026-03-29 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d777cb51-be22-582a-8544-509ff2400f61 with scrape type 2
2026-03-29 18:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d777cb51-be22-582a-8544-509ff2400f61, identifier: CF02627
2026-03-29 18:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d777cb51-be22-582a-8544-509ff2400f61 with identifier: CF02627
2026-03-29 18:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d777cb51-be22-582a-8544-509ff2400f61 with identifier: CF02627
2026-03-29 18:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d777cb51-be22-582a-8544-509ff2400f61 with identifier: CF02627 to the API
2026-03-29 18:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:06:29Z',
'fuel_type': 'petrol',
'id': 'd777cb51-be22-582a-8544-509ff2400f61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF02627',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 71198,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-20',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2015}
2026-03-29 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF02627%27 HTTP/1.1" 200 None
2026-03-29 18:30:39 [auto1.de] INFO: Saving data for CF02627: {'auction_closing_time': 1774883189.0, 'created_time': 1773859653.438261, 'last_price_update_time': 1774809039.407763}
2026-03-29 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF02627') HTTP/1.1" 204 0
2026-03-29 18:30:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:40 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 6740 | hits on page: 40
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: DM11182
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM11182%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for DM11182: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: NV13979
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: SR10535
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: EX39495
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX39495%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for EX39495: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: LY60106
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY60106%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for LY60106: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR07934%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for GR07934: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: GZ84157
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ84157%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for GZ84157: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: CM86164
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: UF75132
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF75132%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for UF75132: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: FR75533
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75533%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for FR75533: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: AD16750
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: JE79090
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: TU64777
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: RK76188
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: EK64818
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK64818%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for EK64818: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: XY93824
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT28488%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for AT28488: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: YW90897
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW90897%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for YW90897: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: YB70330
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: CJ04557
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: UD27058
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: JG12226
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG12226%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for JG12226: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: UV43425
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV43425%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for UV43425: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: MH98673
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: LD99689
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: JM98796
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: CZ09643
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09643%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for CZ09643: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: LZ98247
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ98247%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for LZ98247: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: VM39350
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM39350%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for VM39350: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: TB49409
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: NB42822
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: KU03533
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: LV79824
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV79824%27 HTTP/1.1" 200 None
2026-03-29 18:30:40 [auto1.de] INFO: Scrape type for LV79824: 0
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: PM35820
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: TZ64186
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: HE78253
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: WC37981
2026-03-29 18:30:40 [auto1.de] INFO: Found listing with ID: HA87343
2026-03-29 18:30:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:41 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 6740 | hits on page: 40
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: VU91193
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: TX49680
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX49680%27 HTTP/1.1" 200 None
2026-03-29 18:30:41 [auto1.de] INFO: Scrape type for TX49680: 0
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: EE57065
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: BP97760
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: MW79047
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW79047%27 HTTP/1.1" 200 None
2026-03-29 18:30:41 [auto1.de] INFO: Scrape type for MW79047: 0
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: RP29277
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP29277%27 HTTP/1.1" 200 None
2026-03-29 18:30:41 [auto1.de] INFO: Scrape type for RP29277: 0
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: HC04393
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: ZV78302
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: VX94865
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX94865%27 HTTP/1.1" 200 None
2026-03-29 18:30:41 [auto1.de] INFO: Scrape type for VX94865: 0
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: CZ47065
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ47065%27 HTTP/1.1" 200 None
2026-03-29 18:30:41 [auto1.de] INFO: Scrape type for CZ47065: 0
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: ES20413
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: XE08723
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE08723%27 HTTP/1.1" 200 None
2026-03-29 18:30:41 [auto1.de] INFO: Scrape type for XE08723: 0
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: AU50389
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU50389%27 HTTP/1.1" 200 None
2026-03-29 18:30:41 [auto1.de] INFO: Scrape type for AU50389: 0
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: LZ63004
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: VT21239
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: ME62571
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: KJ28184
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ28184%27 HTTP/1.1" 200 None
2026-03-29 18:30:41 [auto1.de] INFO: Scrape type for KJ28184: 0
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: NV69214
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: UT98357
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT98357%27 HTTP/1.1" 200 None
2026-03-29 18:30:41 [auto1.de] INFO: Scrape type for UT98357: 0
2026-03-29 18:30:41 [auto1.de] INFO: Found listing with ID: HY43469
2026-03-29 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY43469%27 HTTP/1.1" 200 None
2026-03-29 18:30:42 [auto1.de] INFO: Scrape type for HY43469: 0
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: KF75867
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF75867%27 HTTP/1.1" 200 None
2026-03-29 18:30:42 [auto1.de] INFO: Scrape type for KF75867: 0
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: JA01983
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA01983%27 HTTP/1.1" 200 None
2026-03-29 18:30:42 [auto1.de] INFO: Scrape type for JA01983: 0
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: UJ23150
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: AH44309
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH44309%27 HTTP/1.1" 200 None
2026-03-29 18:30:42 [auto1.de] INFO: Scrape type for AH44309: 0
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: PM99817
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM99817%27 HTTP/1.1" 200 None
2026-03-29 18:30:42 [auto1.de] INFO: Scrape type for PM99817: 0
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: YK45245
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: DB08314
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB08314%27 HTTP/1.1" 200 None
2026-03-29 18:30:42 [auto1.de] INFO: Scrape type for DB08314: 0
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: HS17931
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: DP06637
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP06637%27 HTTP/1.1" 200 None
2026-03-29 18:30:42 [auto1.de] INFO: Scrape type for DP06637: 0
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: NG65344
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG65344%27 HTTP/1.1" 200 None
2026-03-29 18:30:42 [auto1.de] INFO: Scrape type for NG65344: 0
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: XT30705
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT30705%27 HTTP/1.1" 200 None
2026-03-29 18:30:42 [auto1.de] INFO: Scrape type for XT30705: 0
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: JC50514
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD00479%27 HTTP/1.1" 200 None
2026-03-29 18:30:42 [auto1.de] INFO: Scrape type for AD00479: 0
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: CL69426
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL69426%27 HTTP/1.1" 200 None
2026-03-29 18:30:42 [auto1.de] INFO: Scrape type for CL69426: 0
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: WJ52801
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ52801%27 HTTP/1.1" 200 None
2026-03-29 18:30:42 [auto1.de] INFO: Scrape type for WJ52801: 0
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: TC78124
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: PY29315
2026-03-29 18:30:42 [auto1.de] INFO: Found listing with ID: WW76911
2026-03-29 18:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:43 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 6740 | hits on page: 40
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: EE66446
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: SR43778
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR43778%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for SR43778: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: GV67741
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67741%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for GV67741: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: VY63466
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: PF70516
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF70516%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for PF70516: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: MB34428
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: YY88868
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY88868%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for YY88868: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: WL17880
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: NY52199
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: CL67465
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: AX54291
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: EU26057
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU26057%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for EU26057: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: KN25796
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: NN77195
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: RZ45087
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ45087%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for RZ45087: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: HW35113
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW35113%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for HW35113: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: TP80753
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP80753%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for TP80753: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: WB48893
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB48893%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for WB48893: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: NF53472
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: WX30683
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: HC78210
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC78210%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for HC78210: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: YK03536
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK03536%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for YK03536: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: CP72119
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG12821%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for VG12821: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: NW56335
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW56335%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for NW56335: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: EJ19003
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ19003%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for EJ19003: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: EL19889
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL19889%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for EL19889: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: XC49831
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: JG80760
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: TV16338
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: AS89586
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: XL04777
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL04777%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for XL04777: 0
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: ZB59540
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: EZ65040
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: KR07785
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: CW58984
2026-03-29 18:30:43 [auto1.de] INFO: Found listing with ID: LE60252
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE60252%27 HTTP/1.1" 200 None
2026-03-29 18:30:43 [auto1.de] INFO: Scrape type for LE60252: 0
2026-03-29 18:30:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:44 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 6740 | hits on page: 40
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: ZF51547
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: BL18853
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL18853%27 HTTP/1.1" 200 None
2026-03-29 18:30:44 [auto1.de] INFO: Scrape type for BL18853: 0
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: DW68241
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: GX07003
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: AE08285
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: XE49281
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE49281%27 HTTP/1.1" 200 None
2026-03-29 18:30:44 [auto1.de] INFO: Scrape type for XE49281: 0
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: BV75755
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: GZ46196
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: SY67219
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY67219%27 HTTP/1.1" 200 None
2026-03-29 18:30:44 [auto1.de] INFO: Scrape type for SY67219: 0
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: UW13006
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: WE35343
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: NL19475
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19475%27 HTTP/1.1" 200 None
2026-03-29 18:30:44 [auto1.de] INFO: Scrape type for NL19475: 0
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: WJ46196
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ46196%27 HTTP/1.1" 200 None
2026-03-29 18:30:44 [auto1.de] INFO: Scrape type for WJ46196: 0
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: AT70381
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT70381%27 HTTP/1.1" 200 None
2026-03-29 18:30:44 [auto1.de] INFO: Scrape type for AT70381: 0
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: VN12200
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: HE00957
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE00957%27 HTTP/1.1" 200 None
2026-03-29 18:30:44 [auto1.de] INFO: Scrape type for HE00957: 0
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: MS26334
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS26334%27 HTTP/1.1" 200 None
2026-03-29 18:30:44 [auto1.de] INFO: Scrape type for MS26334: 0
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: PJ99813
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ99813%27 HTTP/1.1" 200 None
2026-03-29 18:30:44 [auto1.de] INFO: Scrape type for PJ99813: 0
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: WP80129
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: ST83220
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: TJ95012
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: BB55573
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: UA53606
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: AE82588
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: LS75303
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: PN52671
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: VH02312
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: NN25217
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: SR95486
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR95486%27 HTTP/1.1" 200 None
2026-03-29 18:30:44 [auto1.de] INFO: Scrape type for SR95486: 0
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: NL19683
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: SV33608
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: JW05859
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: WL45010
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL45010%27 HTTP/1.1" 200 None
2026-03-29 18:30:44 [auto1.de] INFO: Scrape type for WL45010: 0
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: YG26489
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: VJ55974
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ55974%27 HTTP/1.1" 200 None
2026-03-29 18:30:44 [auto1.de] INFO: Scrape type for VJ55974: 0
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: YP11119
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP11119%27 HTTP/1.1" 200 None
2026-03-29 18:30:44 [auto1.de] INFO: Scrape type for YP11119: 0
2026-03-29 18:30:44 [auto1.de] INFO: Found listing with ID: MC32966
2026-03-29 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC32966%27 HTTP/1.1" 200 None
2026-03-29 18:30:45 [auto1.de] INFO: Scrape type for MC32966: 0
2026-03-29 18:30:45 [auto1.de] INFO: Found listing with ID: GE22934
2026-03-29 18:30:45 [auto1.de] INFO: Found listing with ID: FB20654
2026-03-29 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20654%27 HTTP/1.1" 200 None
2026-03-29 18:30:45 [auto1.de] INFO: Scrape type for FB20654: 0
2026-03-29 18:30:45 [auto1.de] INFO: Found listing with ID: GM09493
2026-03-29 18:30:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:46 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 6740 | hits on page: 40
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: UZ05424
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: FA50226
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA50226%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for FA50226: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: AY40999
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: SY89352
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY89352%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for SY89352: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: YE79096
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE79096%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for YE79096: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: XG44569
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG44569%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for XG44569: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: XZ28453
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: EE17704
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE17704%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for EE17704: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: TU83885
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: ZU14307
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: WT63610
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT63610%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for WT63610: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: GD86800
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD86800%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for GD86800: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: MT90206
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90206%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for MT90206: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: EH26353
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: FL70928
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: KS19016
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS19016%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for KS19016: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: UT35325
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: PY62114
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: UB19219
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: SH98568
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH98568%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for SH98568: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: FU56159
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU56159%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for FU56159: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87515%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for HP87515: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE03726%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for VE03726: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: SJ83553
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ83553%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for SJ83553: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: NG98905
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC98877%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for VC98877: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: JC07133
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: JR52924
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: GL55365
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL55365%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for GL55365: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: GM39396
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM39396%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for GM39396: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: KM60144
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: KP76789
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU84960%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for YU84960: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: KM84276
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ57335%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for WJ57335: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: HK49782
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK49782%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for HK49782: 0
2026-03-29 18:30:46 [auto1.de] INFO: Found listing with ID: JT65336
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT65336%27 HTTP/1.1" 200 None
2026-03-29 18:30:46 [auto1.de] INFO: Scrape type for JT65336: 0
2026-03-29 18:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:52 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 6740 | hits on page: 40
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: UM76387
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: BR88683
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR88683%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for BR88683: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: PY66131
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY66131%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for PY66131: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: WX96485
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: AL04579
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL04579%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for AL04579: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: NH10753
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH10753%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for NH10753: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: CA14151
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA14151%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for CA14151: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF04397%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for EF04397: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: BY37084
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: GC63965
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: UA30528
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: PP86111
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP86111%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for PP86111: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: AU99703
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU99703%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for AU99703: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: UJ07162
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ07162%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for UJ07162: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: YV92261
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: YG24433
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: RK19274
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: XP45109
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: UB06797
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL50945%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for HL50945: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: BM44177
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE28257%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for JE28257: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: TK71200
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK71200%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for TK71200: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: EZ46252
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ46252%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for EZ46252: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: AK88220
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: DN40523
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN40523%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for DN40523: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: XJ45397
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ45397%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for XJ45397: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: TM91896
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: TZ55203
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: NR32079
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR32079%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for NR32079: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: XW83383
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: DN59974
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: TH47484
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: ST09245
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: TK97766
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: GZ01520
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ01520%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for GZ01520: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: PD79431
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD79431%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for PD79431: 0
2026-03-29 18:30:52 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS30445%27 HTTP/1.1" 200 None
2026-03-29 18:30:52 [auto1.de] INFO: Scrape type for RS30445: 0
2026-03-29 18:30:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:53 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 6740 | hits on page: 40
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: VN22748
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN22748%27 HTTP/1.1" 200 None
2026-03-29 18:30:53 [auto1.de] INFO: Scrape type for VN22748: 0
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: BK28670
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK28670%27 HTTP/1.1" 200 None
2026-03-29 18:30:53 [auto1.de] INFO: Scrape type for BK28670: 0
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: AK90767
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK90767%27 HTTP/1.1" 200 None
2026-03-29 18:30:53 [auto1.de] INFO: Scrape type for AK90767: 0
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: TB02108
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB02108%27 HTTP/1.1" 200 None
2026-03-29 18:30:53 [auto1.de] INFO: Scrape type for TB02108: 0
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: GB27698
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27698%27 HTTP/1.1" 200 None
2026-03-29 18:30:53 [auto1.de] INFO: Scrape type for GB27698: 0
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: YC23372
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC23372%27 HTTP/1.1" 200 None
2026-03-29 18:30:53 [auto1.de] INFO: Scrape type for YC23372: 0
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: LN26385
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: WA11944
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA11944%27 HTTP/1.1" 200 None
2026-03-29 18:30:53 [auto1.de] INFO: Scrape type for WA11944: 0
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: VA77092
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA77092%27 HTTP/1.1" 200 None
2026-03-29 18:30:53 [auto1.de] INFO: Scrape type for VA77092: 0
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: SR72775
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: JZ29670
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW90225%27 HTTP/1.1" 200 None
2026-03-29 18:30:53 [auto1.de] INFO: Scrape type for LW90225: 0
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: LJ23138
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA27483%27 HTTP/1.1" 200 None
2026-03-29 18:30:53 [auto1.de] INFO: Scrape type for ZA27483: 0
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: XM73112
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM73112%27 HTTP/1.1" 200 None
2026-03-29 18:30:53 [auto1.de] INFO: Scrape type for XM73112: 0
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: VY06306
2026-03-29 18:30:53 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS83117%27 HTTP/1.1" 200 None
2026-03-29 18:30:53 [auto1.de] INFO: Scrape type for HS83117: 2
2026-03-29 18:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 501234cb-2272-5878-a3d0-c56835e253e8 with identifier: HS83117
2026-03-29 18:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 501234cb-2272-5878-a3d0-c56835e253e8 with scrape type 2
2026-03-29 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 501234cb-2272-5878-a3d0-c56835e253e8 with scrape type 2
2026-03-29 18:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 501234cb-2272-5878-a3d0-c56835e253e8, identifier: HS83117
2026-03-29 18:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 501234cb-2272-5878-a3d0-c56835e253e8 with identifier: HS83117
2026-03-29 18:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:30:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 18:30:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 501234cb-2272-5878-a3d0-c56835e253e8 with identifier: HS83117
2026-03-29 18:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 501234cb-2272-5878-a3d0-c56835e253e8 with identifier: HS83117 to the API
2026-03-29 18:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 468,
'expiration_date': '2026-03-30T15:44:28Z',
'fuel_type': 'petrol',
'id': '501234cb-2272-5878-a3d0-c56835e253e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS83117',
'listing': 'auction',
'make': 'Jeep',
'model': 'Grand Cherokee',
'odometer': 203445,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-31',
'seller_name': None,
'title': 'Jeep Grand Cherokee 6.4 V8 HEMI SRT',
'transmission': 'automatic',
'trim': 'HEMI SRT',
'year': 2019}
2026-03-29 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS83117%27 HTTP/1.1" 200 None
2026-03-29 18:30:56 [auto1.de] INFO: Saving data for HS83117: {'auction_closing_time': 1774885468.0, 'created_time': 1773227932.230839, 'last_price_update_time': 1774809056.862036}
2026-03-29 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS83117') HTTP/1.1" 204 0
2026-03-29 18:30:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:30:56 [auto1.de] INFO: Found listing with ID: RW76455
2026-03-29 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW76455%27 HTTP/1.1" 200 None
2026-03-29 18:30:56 [auto1.de] INFO: Scrape type for RW76455: 0
2026-03-29 18:30:56 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-29 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP66782%27 HTTP/1.1" 200 None
2026-03-29 18:30:57 [auto1.de] INFO: Scrape type for RP66782: 0
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: RC29911
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC29911%27 HTTP/1.1" 200 None
2026-03-29 18:30:57 [auto1.de] INFO: Scrape type for RC29911: 0
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL48750%27 HTTP/1.1" 200 None
2026-03-29 18:30:57 [auto1.de] INFO: Scrape type for VL48750: 0
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: CZ70893
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: HC32133
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: WC25701
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC25701%27 HTTP/1.1" 200 None
2026-03-29 18:30:57 [auto1.de] INFO: Scrape type for WC25701: 0
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: RS41901
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS41901%27 HTTP/1.1" 200 None
2026-03-29 18:30:57 [auto1.de] INFO: Scrape type for RS41901: 0
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: CW57830
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW57830%27 HTTP/1.1" 200 None
2026-03-29 18:30:57 [auto1.de] INFO: Scrape type for CW57830: 0
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: YC02535
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC02535%27 HTTP/1.1" 200 None
2026-03-29 18:30:57 [auto1.de] INFO: Scrape type for YC02535: 0
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW01944%27 HTTP/1.1" 200 None
2026-03-29 18:30:57 [auto1.de] INFO: Scrape type for TW01944: 0
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: RN71628
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT70874%27 HTTP/1.1" 200 None
2026-03-29 18:30:57 [auto1.de] INFO: Scrape type for HT70874: 0
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: YW93482
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: CJ85818
2026-03-29 18:30:57 [auto1.de] INFO: Found listing with ID: CM64848
2026-03-29 18:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:30:58 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 6740 | hits on page: 40
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF64937%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for KF64937: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: MW29670
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: RC86966
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW48128%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for XW48128: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT87510%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for LT87510: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS77403%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for WS77403: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: KL19595
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19595%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for KL19595: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: YV77496
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV77496%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for YV77496: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ52204%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for NJ52204: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55946%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for UP55946: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: BG00548
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: SP96872
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: FN44778
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN38539%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for YN38539: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: CG08693
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG08693%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for CG08693: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: LG10256
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG10256%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for LG10256: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK73289%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for KK73289: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49952%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for LS49952: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN74445%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for EN74445: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: XY85959
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: YL95361
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL95361%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for YL95361: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ61875%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for DZ61875: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: YB72786
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC06801%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for NC06801: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: RM28884
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: HA68744
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF55933%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for SF55933: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: RY86630
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY86630%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for RY86630: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: CU91826
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU91826%27 HTTP/1.1" 200 None
2026-03-29 18:30:58 [auto1.de] INFO: Scrape type for CU91826: 0
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-29 18:30:58 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-29 18:30:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:31:00 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 6740 | hits on page: 40
2026-03-29 18:31:00 [auto1.de] INFO: Found listing with ID: YY17846
2026-03-29 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY17846%27 HTTP/1.1" 200 None
2026-03-29 18:31:00 [auto1.de] INFO: Scrape type for YY17846: 0
2026-03-29 18:31:00 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-29 18:31:00 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-29 18:31:00 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-29 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG73719%27 HTTP/1.1" 200 None
2026-03-29 18:31:00 [auto1.de] INFO: Scrape type for CG73719: 0
2026-03-29 18:31:00 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-29 18:31:00 [auto1.de] INFO: Found listing with ID: NB79280
2026-03-29 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB79280%27 HTTP/1.1" 200 None
2026-03-29 18:31:00 [auto1.de] INFO: Scrape type for NB79280: 0
2026-03-29 18:31:00 [auto1.de] INFO: Found listing with ID: AS80209
2026-03-29 18:31:00 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-29 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK62781%27 HTTP/1.1" 200 None
2026-03-29 18:31:00 [auto1.de] INFO: Scrape type for XK62781: 0
2026-03-29 18:31:00 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-29 18:31:00 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-29 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF68653%27 HTTP/1.1" 200 None
2026-03-29 18:31:00 [auto1.de] INFO: Scrape type for YF68653: 0
2026-03-29 18:31:00 [auto1.de] INFO: Found listing with ID: TF22102
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF22102%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for TF22102: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94497%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for FG94497: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE99483%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for HE99483: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: LF77567
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF77567%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for LF77567: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: JL43427
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: DX27890
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: VJ93938
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ93938%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for VJ93938: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX13429%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for AX13429: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD17030%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for SD17030: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF12446%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for JF12446: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81971%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for NH81971: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: PU44230
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU44230%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for PU44230: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER86835%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for ER86835: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20018%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for MA20018: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: SU19428
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU19428%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for SU19428: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW74525%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for UW74525: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06642%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for CP06642: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: EH70293
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: YX40073
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX40073%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for YX40073: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: NR97756
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC05735%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for LC05735: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: AW14620
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW14620%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for AW14620: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78793%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for FM78793: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: VH46900
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH46900%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for VH46900: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: ZN75041
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN75041%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for ZN75041: 0
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: XV57552
2026-03-29 18:31:01 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93361%27 HTTP/1.1" 200 None
2026-03-29 18:31:01 [auto1.de] INFO: Scrape type for UW93361: 0
2026-03-29 18:31:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:31:02 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 6740 | hits on page: 40
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: YY00897
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY00897%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for YY00897: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: DE21080
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE21080%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for DE21080: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP65093%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for ZP65093: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: JN49232
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN49232%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for JN49232: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: WV35399
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: ZT07846
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT07846%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for ZT07846: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG75781%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for WG75781: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: MM39918
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR25455%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for ZR25455: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: YJ88627
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: AF95202
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT54057%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for LT54057: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY54552%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for VY54552: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: XV17111
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: GJ78269
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ78269%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for GJ78269: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW71141%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for HW71141: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69554%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for EM69554: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: EU39655
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU39655%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for EU39655: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX59054%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for TX59054: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: RV72867
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72867%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for RV72867: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: XT69734
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT69734%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for XT69734: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: XF01324
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF01324%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for XF01324: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: UP89204
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP89204%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for UP89204: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ11746%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for TZ11746: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: ZK08136
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK08136%27 HTTP/1.1" 200 None
2026-03-29 18:31:02 [auto1.de] INFO: Scrape type for ZK08136: 0
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-29 18:31:02 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-29 18:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:31:03 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 6740 | hits on page: 40
2026-03-29 18:31:03 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-29 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS05622%27 HTTP/1.1" 200 None
2026-03-29 18:31:03 [auto1.de] INFO: Scrape type for VS05622: 0
2026-03-29 18:31:03 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-29 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU27746%27 HTTP/1.1" 200 None
2026-03-29 18:31:03 [auto1.de] INFO: Scrape type for CU27746: 0
2026-03-29 18:31:03 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN73859%27 HTTP/1.1" 200 None
2026-03-29 18:31:04 [auto1.de] INFO: Scrape type for UN73859: 0
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: VG22194
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG22194%27 HTTP/1.1" 200 None
2026-03-29 18:31:04 [auto1.de] INFO: Scrape type for VG22194: 0
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: VH01397
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: FD54213
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: JT90882
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT90882%27 HTTP/1.1" 200 None
2026-03-29 18:31:04 [auto1.de] INFO: Scrape type for JT90882: 0
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ18698%27 HTTP/1.1" 200 None
2026-03-29 18:31:04 [auto1.de] INFO: Scrape type for AJ18698: 0
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: MG97845
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: UM62946
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: EN76399
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68218%27 HTTP/1.1" 200 None
2026-03-29 18:31:04 [auto1.de] INFO: Scrape type for AG68218: 0
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: YZ27957
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ27957%27 HTTP/1.1" 200 None
2026-03-29 18:31:04 [auto1.de] INFO: Scrape type for YZ27957: 0
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: GA63896
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA63896%27 HTTP/1.1" 200 None
2026-03-29 18:31:04 [auto1.de] INFO: Scrape type for GA63896: 0
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP19468%27 HTTP/1.1" 200 None
2026-03-29 18:31:04 [auto1.de] INFO: Scrape type for YP19468: 0
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: TW27373
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: PR12496
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ51315%27 HTTP/1.1" 200 None
2026-03-29 18:31:04 [auto1.de] INFO: Scrape type for NZ51315: 0
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH44928%27 HTTP/1.1" 200 None
2026-03-29 18:31:04 [auto1.de] INFO: Scrape type for VH44928: 0
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28645%27 HTTP/1.1" 200 None
2026-03-29 18:31:04 [auto1.de] INFO: Scrape type for WC28645: 0
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: DD41075
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11604%27 HTTP/1.1" 200 None
2026-03-29 18:31:04 [auto1.de] INFO: Scrape type for LN11604: 0
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: XR19518
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR19518%27 HTTP/1.1" 200 None
2026-03-29 18:31:04 [auto1.de] INFO: Scrape type for XR19518: 0
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: FE98948
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE98948%27 HTTP/1.1" 200 None
2026-03-29 18:31:04 [auto1.de] INFO: Scrape type for FE98948: 0
2026-03-29 18:31:04 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT84792%27 HTTP/1.1" 200 None
2026-03-29 18:31:04 [auto1.de] INFO: Scrape type for GT84792: 2
2026-03-29 18:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c973ae3a-eed1-5c9d-9a7c-4874e4a5d109 with identifier: GT84792
2026-03-29 18:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c973ae3a-eed1-5c9d-9a7c-4874e4a5d109 with scrape type 2
2026-03-29 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c973ae3a-eed1-5c9d-9a7c-4874e4a5d109 with scrape type 2
2026-03-29 18:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c973ae3a-eed1-5c9d-9a7c-4874e4a5d109, identifier: GT84792
2026-03-29 18:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c973ae3a-eed1-5c9d-9a7c-4874e4a5d109 with identifier: GT84792
2026-03-29 18:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c973ae3a-eed1-5c9d-9a7c-4874e4a5d109 with identifier: GT84792
2026-03-29 18:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c973ae3a-eed1-5c9d-9a7c-4874e4a5d109 with identifier: GT84792 to the API
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:26:52Z',
'fuel_type': 'petrol',
'id': 'c973ae3a-eed1-5c9d-9a7c-4874e4a5d109',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT84792',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 35134,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-02',
'seller_name': None,
'title': 'Skoda Kamiq 1.0 TSI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2019}
2026-03-29 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT84792%27 HTTP/1.1" 200 None
2026-03-29 18:31:05 [auto1.de] INFO: Saving data for GT84792: {'auction_closing_time': 1774884412.0, 'created_time': 1773306690.158139, 'last_price_update_time': 1774809065.092245}
2026-03-29 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT84792') HTTP/1.1" 204 0
2026-03-29 18:31:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:31:05 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-29 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS84935%27 HTTP/1.1" 200 None
2026-03-29 18:31:05 [auto1.de] INFO: Scrape type for GS84935: 0
2026-03-29 18:31:05 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-29 18:31:05 [auto1.de] INFO: Found listing with ID: UK22592
2026-03-29 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK22592%27 HTTP/1.1" 200 None
2026-03-29 18:31:05 [auto1.de] INFO: Scrape type for UK22592: 0
2026-03-29 18:31:05 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-29 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU28651%27 HTTP/1.1" 200 None
2026-03-29 18:31:05 [auto1.de] INFO: Scrape type for FU28651: 0
2026-03-29 18:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:31:06 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 6740 | hits on page: 40
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: JM01437
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY36946%27 HTTP/1.1" 200 None
2026-03-29 18:31:06 [auto1.de] INFO: Scrape type for GY36946: 0
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV67596%27 HTTP/1.1" 200 None
2026-03-29 18:31:06 [auto1.de] INFO: Scrape type for PV67596: 0
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET29931%27 HTTP/1.1" 200 None
2026-03-29 18:31:06 [auto1.de] INFO: Scrape type for ET29931: 0
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP04527%27 HTTP/1.1" 200 None
2026-03-29 18:31:06 [auto1.de] INFO: Scrape type for BP04527: 0
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: AH10770
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: PW13353
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW13353%27 HTTP/1.1" 200 None
2026-03-29 18:31:06 [auto1.de] INFO: Scrape type for PW13353: 0
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG07802%27 HTTP/1.1" 200 None
2026-03-29 18:31:06 [auto1.de] INFO: Scrape type for JG07802: 0
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: TA43023
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: RC29433
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC29433%27 HTTP/1.1" 200 None
2026-03-29 18:31:06 [auto1.de] INFO: Scrape type for RC29433: 0
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: LP47085
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: VD46825
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: YE68062
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE68062%27 HTTP/1.1" 200 None
2026-03-29 18:31:06 [auto1.de] INFO: Scrape type for YE68062: 0
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: MP83511
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: FV18032
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV18032%27 HTTP/1.1" 200 None
2026-03-29 18:31:06 [auto1.de] INFO: Scrape type for FV18032: 0
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA02220%27 HTTP/1.1" 200 None
2026-03-29 18:31:06 [auto1.de] INFO: Scrape type for JA02220: 0
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-29 18:31:06 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN21638%27 HTTP/1.1" 200 None
2026-03-29 18:31:06 [auto1.de] INFO: Scrape type for JN21638: 2
2026-03-29 18:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5919942e-8741-5202-9d95-746fcf93fc13 with identifier: JN21638
2026-03-29 18:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5919942e-8741-5202-9d95-746fcf93fc13 with scrape type 2
2026-03-29 18:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5919942e-8741-5202-9d95-746fcf93fc13 with scrape type 2
2026-03-29 18:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5919942e-8741-5202-9d95-746fcf93fc13, identifier: JN21638
2026-03-29 18:31:06 [scrapy.extensions.logstats] INFO: Crawled 28 pages (at 28 pages/min), scraped 15 items (at 15 items/min)
2026-03-29 18:31:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5919942e-8741-5202-9d95-746fcf93fc13 with identifier: JN21638
2026-03-29 18:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:31:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 18:31:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5919942e-8741-5202-9d95-746fcf93fc13 with identifier: JN21638
2026-03-29 18:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5919942e-8741-5202-9d95-746fcf93fc13 with identifier: JN21638 to the API
2026-03-29 18:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:32:57Z',
'fuel_type': 'petrol',
'id': '5919942e-8741-5202-9d95-746fcf93fc13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN21638',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 101794,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-10',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.2 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2011}
2026-03-29 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN21638%27 HTTP/1.1" 200 None
2026-03-29 18:31:07 [auto1.de] INFO: Saving data for JN21638: {'auction_closing_time': 1774884777.0, 'created_time': 1774607780.93747, 'last_price_update_time': 1774809067.538394}
2026-03-29 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN21638') HTTP/1.1" 204 0
2026-03-29 18:31:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:31:07 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-29 18:31:07 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-29 18:31:07 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-29 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA84823%27 HTTP/1.1" 200 None
2026-03-29 18:31:07 [auto1.de] INFO: Scrape type for MA84823: 0
2026-03-29 18:31:07 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-29 18:31:07 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-29 18:31:07 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-29 18:31:07 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-29 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30127%27 HTTP/1.1" 200 None
2026-03-29 18:31:07 [auto1.de] INFO: Scrape type for MN30127: 2
2026-03-29 18:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7279628-8c27-54c7-a514-a6c484547c0b with identifier: MN30127
2026-03-29 18:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7279628-8c27-54c7-a514-a6c484547c0b with scrape type 2
2026-03-29 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7279628-8c27-54c7-a514-a6c484547c0b with scrape type 2
2026-03-29 18:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7279628-8c27-54c7-a514-a6c484547c0b, identifier: MN30127
2026-03-29 18:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7279628-8c27-54c7-a514-a6c484547c0b with identifier: MN30127
2026-03-29 18:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7279628-8c27-54c7-a514-a6c484547c0b with identifier: MN30127
2026-03-29 18:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7279628-8c27-54c7-a514-a6c484547c0b with identifier: MN30127 to the API
2026-03-29 18:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:19:55Z',
'fuel_type': 'petrol',
'id': 'd7279628-8c27-54c7-a514-a6c484547c0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN30127',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra GTC',
'odometer': 189708,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-30',
'seller_name': None,
'title': 'Opel Astra GTC 1.6 SIDI Turbo Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2014}
2026-03-29 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30127%27 HTTP/1.1" 200 None
2026-03-29 18:31:08 [auto1.de] INFO: Saving data for MN30127: {'auction_closing_time': 1774883995.0, 'created_time': 1774607885.211317, 'last_price_update_time': 1774809068.234781}
2026-03-29 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN30127') HTTP/1.1" 204 0
2026-03-29 18:31:08 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-29 18:31:08 [auto1.de] INFO: Found listing with ID: YE47766
2026-03-29 18:31:08 [auto1.de] INFO: Found listing with ID: AY52280
2026-03-29 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY52280%27 HTTP/1.1" 200 None
2026-03-29 18:31:08 [auto1.de] INFO: Scrape type for AY52280: 0
2026-03-29 18:31:08 [auto1.de] INFO: Found listing with ID: ST92465
2026-03-29 18:31:08 [auto1.de] INFO: Found listing with ID: EY37424
2026-03-29 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY37424%27 HTTP/1.1" 200 None
2026-03-29 18:31:08 [auto1.de] INFO: Scrape type for EY37424: 0
2026-03-29 18:31:08 [auto1.de] INFO: Found listing with ID: MT94431
2026-03-29 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT94431%27 HTTP/1.1" 200 None
2026-03-29 18:31:08 [auto1.de] INFO: Scrape type for MT94431: 0
2026-03-29 18:31:08 [auto1.de] INFO: Found listing with ID: ZF33601
2026-03-29 18:31:08 [auto1.de] INFO: Found listing with ID: BP69387
2026-03-29 18:31:08 [auto1.de] INFO: Found listing with ID: PF83814
2026-03-29 18:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:31:09 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 6740 | hits on page: 40
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: PS96844
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS96844%27 HTTP/1.1" 200 None
2026-03-29 18:31:09 [auto1.de] INFO: Scrape type for PS96844: 0
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: DH90644
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH90644%27 HTTP/1.1" 200 None
2026-03-29 18:31:09 [auto1.de] INFO: Scrape type for DH90644: 0
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: UX35771
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: LC73868
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: JX17903
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17903%27 HTTP/1.1" 200 None
2026-03-29 18:31:09 [auto1.de] INFO: Scrape type for JX17903: 0
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: YE89715
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: NX25429
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX25429%27 HTTP/1.1" 200 None
2026-03-29 18:31:09 [auto1.de] INFO: Scrape type for NX25429: 0
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: FB30616
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB30616%27 HTTP/1.1" 200 None
2026-03-29 18:31:09 [auto1.de] INFO: Scrape type for FB30616: 0
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: PZ87651
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: WR49956
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: EU48519
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: EM09444
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM09444%27 HTTP/1.1" 200 None
2026-03-29 18:31:09 [auto1.de] INFO: Scrape type for EM09444: 0
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: HS59554
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: VU90894
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: AL66084
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: WF31027
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: KJ73179
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ73179%27 HTTP/1.1" 200 None
2026-03-29 18:31:09 [auto1.de] INFO: Scrape type for KJ73179: 0
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: VM07579
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM07579%27 HTTP/1.1" 200 None
2026-03-29 18:31:09 [auto1.de] INFO: Scrape type for VM07579: 0
2026-03-29 18:31:09 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH18940%27 HTTP/1.1" 200 None
2026-03-29 18:31:09 [auto1.de] INFO: Scrape type for XH18940: 2
2026-03-29 18:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with identifier: XH18940
2026-03-29 18:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with scrape type 2
2026-03-29 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with scrape type 2
2026-03-29 18:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad, identifier: XH18940
2026-03-29 18:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with identifier: XH18940
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:31:09 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-29 18:31:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with identifier: XH18940
2026-03-29 18:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with identifier: XH18940 to the API
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 255,
'expiration_date': '2026-03-30T15:54:54Z',
'fuel_type': 'petrol',
'id': '2cfc60ef-fade-5bc4-ba8e-b40f682e77ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH18940',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Suburban',
'odometer': 184711,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-31',
'seller_name': None,
'title': 'Chevrolet Suburban 5.7 V8 LS 4WD',
'transmission': 'automatic',
'trim': 'LS 4WD',
'year': 2018}
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH18940%27 HTTP/1.1" 200 None
2026-03-29 18:31:10 [auto1.de] INFO: Saving data for XH18940: {'auction_closing_time': 1774886094.0, 'created_time': 1774607744.457554, 'last_price_update_time': 1774809070.489073}
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH18940') HTTP/1.1" 204 0
2026-03-29 18:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: UZ89172
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ89172%27 HTTP/1.1" 200 None
2026-03-29 18:31:10 [auto1.de] INFO: Scrape type for UZ89172: 0
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: EF06925
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF06925%27 HTTP/1.1" 200 None
2026-03-29 18:31:10 [auto1.de] INFO: Scrape type for EF06925: 0
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: KR46332
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: UE56505
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE56505%27 HTTP/1.1" 200 None
2026-03-29 18:31:10 [auto1.de] INFO: Scrape type for UE56505: 0
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: YS85982
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: KC50337
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: TR93945
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR93945%27 HTTP/1.1" 200 None
2026-03-29 18:31:10 [auto1.de] INFO: Scrape type for TR93945: 0
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: EP14807
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: XG49869
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: ZW53829
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: UF10359
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF10359%27 HTTP/1.1" 200 None
2026-03-29 18:31:10 [auto1.de] INFO: Scrape type for UF10359: 0
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: CE58616
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: KS98119
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: HW05295
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: BN60503
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN60503%27 HTTP/1.1" 200 None
2026-03-29 18:31:10 [auto1.de] INFO: Scrape type for BN60503: 0
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: BG41279
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG41279%27 HTTP/1.1" 200 None
2026-03-29 18:31:10 [auto1.de] INFO: Scrape type for BG41279: 0
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: DK12229
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: ND89828
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND89828%27 HTTP/1.1" 200 None
2026-03-29 18:31:10 [auto1.de] INFO: Scrape type for ND89828: 0
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: YB47390
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: VX00455
2026-03-29 18:31:10 [auto1.de] INFO: Found listing with ID: VW07399
2026-03-29 18:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:31:41 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 6740 | hits on page: 40
2026-03-29 18:31:41 [auto1.de] INFO: Found listing with ID: SZ67140
2026-03-29 18:31:41 [auto1.de] INFO: Found listing with ID: CK62820
2026-03-29 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62820%27 HTTP/1.1" 200 None
2026-03-29 18:31:41 [auto1.de] INFO: Scrape type for CK62820: 2
2026-03-29 18:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937 with identifier: CK62820
2026-03-29 18:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937 with scrape type 2
2026-03-29 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937 with scrape type 2
2026-03-29 18:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937, identifier: CK62820
2026-03-29 18:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937 with identifier: CK62820
2026-03-29 18:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937 with identifier: CK62820
2026-03-29 18:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937 with identifier: CK62820 to the API
2026-03-29 18:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:25:30Z',
'fuel_type': 'diesel',
'id': '38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK62820',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 155373,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-14',
'seller_name': None,
'title': 'BMW 3er 325d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62820%27 HTTP/1.1" 200 None
2026-03-29 18:31:42 [auto1.de] INFO: Saving data for CK62820: {'auction_closing_time': 1774884330.0, 'created_time': 1774034599.90676, 'last_price_update_time': 1774809102.46723}
2026-03-29 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK62820') HTTP/1.1" 204 0
2026-03-29 18:31:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:31:42 [auto1.de] INFO: Found listing with ID: HT40242
2026-03-29 18:31:42 [auto1.de] INFO: Found listing with ID: FC82221
2026-03-29 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC82221%27 HTTP/1.1" 200 None
2026-03-29 18:31:42 [auto1.de] INFO: Scrape type for FC82221: 2
2026-03-29 18:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c41a5b-3285-52cd-9af9-1ce73cdfbca2 with identifier: FC82221
2026-03-29 18:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c41a5b-3285-52cd-9af9-1ce73cdfbca2 with scrape type 2
2026-03-29 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c41a5b-3285-52cd-9af9-1ce73cdfbca2 with scrape type 2
2026-03-29 18:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2c41a5b-3285-52cd-9af9-1ce73cdfbca2, identifier: FC82221
2026-03-29 18:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2c41a5b-3285-52cd-9af9-1ce73cdfbca2 with identifier: FC82221
2026-03-29 18:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2c41a5b-3285-52cd-9af9-1ce73cdfbca2 with identifier: FC82221
2026-03-29 18:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2c41a5b-3285-52cd-9af9-1ce73cdfbca2 with identifier: FC82221 to the API
2026-03-29 18:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-30T15:19:30Z',
'fuel_type': 'petrol',
'id': 'b2c41a5b-3285-52cd-9af9-1ce73cdfbca2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC82221',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 173281,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-09',
'seller_name': None,
'title': 'Renault Megane 1.2 TCe Energy BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2014}
2026-03-29 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC82221%27 HTTP/1.1" 200 None
2026-03-29 18:31:42 [auto1.de] INFO: Saving data for FC82221: {'auction_closing_time': 1774883970.0, 'created_time': 1773466677.855246, 'last_price_update_time': 1774809102.96685}
2026-03-29 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC82221') HTTP/1.1" 204 0
2026-03-29 18:31:42 [auto1.de] INFO: Found listing with ID: MF60875
2026-03-29 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF60875%27 HTTP/1.1" 200 None
2026-03-29 18:31:43 [auto1.de] INFO: Scrape type for MF60875: 2
2026-03-29 18:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 461fcb9f-a50e-551b-9dfb-a2c5046efed9 with identifier: MF60875
2026-03-29 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 461fcb9f-a50e-551b-9dfb-a2c5046efed9 with scrape type 2
2026-03-29 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 461fcb9f-a50e-551b-9dfb-a2c5046efed9 with scrape type 2
2026-03-29 18:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 461fcb9f-a50e-551b-9dfb-a2c5046efed9, identifier: MF60875
2026-03-29 18:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 461fcb9f-a50e-551b-9dfb-a2c5046efed9 with identifier: MF60875
2026-03-29 18:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 461fcb9f-a50e-551b-9dfb-a2c5046efed9 with identifier: MF60875
2026-03-29 18:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 461fcb9f-a50e-551b-9dfb-a2c5046efed9 with identifier: MF60875 to the API
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:20:37Z',
'fuel_type': 'diesel',
'id': '461fcb9f-a50e-551b-9dfb-a2c5046efed9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF60875',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 261321,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-20',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2016}
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF60875%27 HTTP/1.1" 200 None
2026-03-29 18:31:43 [auto1.de] INFO: Saving data for MF60875: {'auction_closing_time': 1774884037.0, 'created_time': 1774722634.019599, 'last_price_update_time': 1774809103.41176}
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF60875') HTTP/1.1" 204 0
2026-03-29 18:31:43 [auto1.de] INFO: Found listing with ID: KT60854
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60854%27 HTTP/1.1" 200 None
2026-03-29 18:31:43 [auto1.de] INFO: Scrape type for KT60854: 2
2026-03-29 18:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2873f922-00c4-5252-842c-7e37e250fc25 with identifier: KT60854
2026-03-29 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2873f922-00c4-5252-842c-7e37e250fc25 with scrape type 2
2026-03-29 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2873f922-00c4-5252-842c-7e37e250fc25 with scrape type 2
2026-03-29 18:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2873f922-00c4-5252-842c-7e37e250fc25, identifier: KT60854
2026-03-29 18:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2873f922-00c4-5252-842c-7e37e250fc25 with identifier: KT60854
2026-03-29 18:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2873f922-00c4-5252-842c-7e37e250fc25 with identifier: KT60854
2026-03-29 18:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2873f922-00c4-5252-842c-7e37e250fc25 with identifier: KT60854 to the API
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:47:05Z',
'fuel_type': 'diesel',
'id': '2873f922-00c4-5252-842c-7e37e250fc25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT60854',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 160265,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-05',
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Premium L2',
'transmission': 'manual',
'trim': 'Premium L2',
'year': 2018}
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60854%27 HTTP/1.1" 200 None
2026-03-29 18:31:43 [auto1.de] INFO: Saving data for KT60854: {'auction_closing_time': 1774885625.0, 'created_time': 1774033622.967975, 'last_price_update_time': 1774809103.816894}
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT60854') HTTP/1.1" 204 0
2026-03-29 18:31:43 [auto1.de] INFO: Found listing with ID: AC96507
2026-03-29 18:31:43 [auto1.de] INFO: Found listing with ID: YS65782
2026-03-29 18:31:43 [auto1.de] INFO: Found listing with ID: MG42603
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG42603%27 HTTP/1.1" 200 None
2026-03-29 18:31:43 [auto1.de] INFO: Scrape type for MG42603: 2
2026-03-29 18:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 285887e2-7c17-56ac-88d2-8509212658e2 with identifier: MG42603
2026-03-29 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 285887e2-7c17-56ac-88d2-8509212658e2 with scrape type 2
2026-03-29 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 285887e2-7c17-56ac-88d2-8509212658e2 with scrape type 2
2026-03-29 18:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 285887e2-7c17-56ac-88d2-8509212658e2, identifier: MG42603
2026-03-29 18:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 285887e2-7c17-56ac-88d2-8509212658e2 with identifier: MG42603
2026-03-29 18:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 285887e2-7c17-56ac-88d2-8509212658e2 with identifier: MG42603
2026-03-29 18:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 285887e2-7c17-56ac-88d2-8509212658e2 with identifier: MG42603 to the API
2026-03-29 18:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:14:12Z',
'fuel_type': 'petrol',
'id': '285887e2-7c17-56ac-88d2-8509212658e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG42603',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 181300,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-26',
'seller_name': None,
'title': 'BMW 2er 218i Active Tourer Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2015}
2026-03-29 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG42603%27 HTTP/1.1" 200 None
2026-03-29 18:31:44 [auto1.de] INFO: Saving data for MG42603: {'auction_closing_time': 1774883652.0, 'created_time': 1774349157.257162, 'last_price_update_time': 1774809104.962022}
2026-03-29 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG42603') HTTP/1.1" 204 0
2026-03-29 18:31:44 [auto1.de] INFO: Found listing with ID: FK12887
2026-03-29 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK12887%27 HTTP/1.1" 200 None
2026-03-29 18:31:44 [auto1.de] INFO: Scrape type for FK12887: 2
2026-03-29 18:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d9e3855-0e5e-5a2b-8d46-19f99fcad03d with identifier: FK12887
2026-03-29 18:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d9e3855-0e5e-5a2b-8d46-19f99fcad03d with scrape type 2
2026-03-29 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d9e3855-0e5e-5a2b-8d46-19f99fcad03d with scrape type 2
2026-03-29 18:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d9e3855-0e5e-5a2b-8d46-19f99fcad03d, identifier: FK12887
2026-03-29 18:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d9e3855-0e5e-5a2b-8d46-19f99fcad03d with identifier: FK12887
2026-03-29 18:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d9e3855-0e5e-5a2b-8d46-19f99fcad03d with identifier: FK12887
2026-03-29 18:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d9e3855-0e5e-5a2b-8d46-19f99fcad03d with identifier: FK12887 to the API
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:02:58Z',
'fuel_type': 'petrol',
'id': '8d9e3855-0e5e-5a2b-8d46-19f99fcad03d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK12887',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 124733,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-27',
'seller_name': None,
'title': 'Nissan Juke 1.6 Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2011}
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK12887%27 HTTP/1.1" 200 None
2026-03-29 18:31:45 [auto1.de] INFO: Saving data for FK12887: {'auction_closing_time': 1774882978.0, 'created_time': 1774349748.698466, 'last_price_update_time': 1774809105.371877}
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK12887') HTTP/1.1" 204 0
2026-03-29 18:31:45 [auto1.de] INFO: Found listing with ID: ZU40023
2026-03-29 18:31:45 [auto1.de] INFO: Found listing with ID: CH93645
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH93645%27 HTTP/1.1" 200 None
2026-03-29 18:31:45 [auto1.de] INFO: Scrape type for CH93645: 2
2026-03-29 18:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef8e5418-5f64-5de6-ae46-14b3442ad5d8 with identifier: CH93645
2026-03-29 18:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef8e5418-5f64-5de6-ae46-14b3442ad5d8 with scrape type 2
2026-03-29 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef8e5418-5f64-5de6-ae46-14b3442ad5d8 with scrape type 2
2026-03-29 18:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef8e5418-5f64-5de6-ae46-14b3442ad5d8, identifier: CH93645
2026-03-29 18:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef8e5418-5f64-5de6-ae46-14b3442ad5d8 with identifier: CH93645
2026-03-29 18:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef8e5418-5f64-5de6-ae46-14b3442ad5d8 with identifier: CH93645
2026-03-29 18:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef8e5418-5f64-5de6-ae46-14b3442ad5d8 with identifier: CH93645 to the API
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:26:58Z',
'fuel_type': 'petrol',
'id': 'ef8e5418-5f64-5de6-ae46-14b3442ad5d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH93645',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 114214,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-20',
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH93645%27 HTTP/1.1" 200 None
2026-03-29 18:31:45 [auto1.de] INFO: Saving data for CH93645: {'auction_closing_time': 1774884418.0, 'created_time': 1773468583.218764, 'last_price_update_time': 1774809105.789012}
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH93645') HTTP/1.1" 204 0
2026-03-29 18:31:45 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-29 18:31:45 [auto1.de] INFO: Found listing with ID: JP33538
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP33538%27 HTTP/1.1" 200 None
2026-03-29 18:31:45 [auto1.de] INFO: Scrape type for JP33538: 2
2026-03-29 18:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c30d998f-02ab-5ba8-866e-d29ca3cc3e9d with identifier: JP33538
2026-03-29 18:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c30d998f-02ab-5ba8-866e-d29ca3cc3e9d with scrape type 2
2026-03-29 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c30d998f-02ab-5ba8-866e-d29ca3cc3e9d with scrape type 2
2026-03-29 18:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c30d998f-02ab-5ba8-866e-d29ca3cc3e9d, identifier: JP33538
2026-03-29 18:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c30d998f-02ab-5ba8-866e-d29ca3cc3e9d with identifier: JP33538
2026-03-29 18:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c30d998f-02ab-5ba8-866e-d29ca3cc3e9d with identifier: JP33538
2026-03-29 18:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c30d998f-02ab-5ba8-866e-d29ca3cc3e9d with identifier: JP33538 to the API
2026-03-29 18:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:19:34Z',
'fuel_type': 'diesel',
'id': 'c30d998f-02ab-5ba8-866e-d29ca3cc3e9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP33538',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 52352,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-17',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Join',
'transmission': 'automatic',
'trim': 'Join',
'year': 2019}
2026-03-29 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP33538%27 HTTP/1.1" 200 None
2026-03-29 18:31:46 [auto1.de] INFO: Saving data for JP33538: {'auction_closing_time': 1774883974.0, 'created_time': 1774034102.377192, 'last_price_update_time': 1774809106.229725}
2026-03-29 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP33538') HTTP/1.1" 204 0
2026-03-29 18:31:46 [auto1.de] INFO: Found listing with ID: YT05280
2026-03-29 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05280%27 HTTP/1.1" 200 None
2026-03-29 18:31:46 [auto1.de] INFO: Scrape type for YT05280: 2
2026-03-29 18:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 041be986-6b99-50e8-b776-fc09ed64a53a with identifier: YT05280
2026-03-29 18:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 041be986-6b99-50e8-b776-fc09ed64a53a with scrape type 2
2026-03-29 18:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 041be986-6b99-50e8-b776-fc09ed64a53a with scrape type 2
2026-03-29 18:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 041be986-6b99-50e8-b776-fc09ed64a53a, identifier: YT05280
2026-03-29 18:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 041be986-6b99-50e8-b776-fc09ed64a53a with identifier: YT05280
2026-03-29 18:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:31:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-29 18:31:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 041be986-6b99-50e8-b776-fc09ed64a53a with identifier: YT05280
2026-03-29 18:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 041be986-6b99-50e8-b776-fc09ed64a53a with identifier: YT05280 to the API
2026-03-29 18:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:56:03Z',
'fuel_type': 'petrol',
'id': '041be986-6b99-50e8-b776-fc09ed64a53a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT05280',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 165298,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-06',
'seller_name': None,
'title': 'Volkswagen Caddy 1.2 TSI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2014}
2026-03-29 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05280%27 HTTP/1.1" 200 None
2026-03-29 18:31:48 [auto1.de] INFO: Saving data for YT05280: {'auction_closing_time': 1774886163.0, 'created_time': 1774118395.910183, 'last_price_update_time': 1774809108.457934}
2026-03-29 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT05280') HTTP/1.1" 204 0
2026-03-29 18:31:48 [auto1.de] INFO: Found listing with ID: RF07068
2026-03-29 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF07068%27 HTTP/1.1" 200 None
2026-03-29 18:31:48 [auto1.de] INFO: Scrape type for RF07068: 2
2026-03-29 18:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2063cac8-c1b4-5c1b-8468-825f8883353a with identifier: RF07068
2026-03-29 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2063cac8-c1b4-5c1b-8468-825f8883353a with scrape type 2
2026-03-29 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2063cac8-c1b4-5c1b-8468-825f8883353a with scrape type 2
2026-03-29 18:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2063cac8-c1b4-5c1b-8468-825f8883353a, identifier: RF07068
2026-03-29 18:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2063cac8-c1b4-5c1b-8468-825f8883353a with identifier: RF07068
2026-03-29 18:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2063cac8-c1b4-5c1b-8468-825f8883353a with identifier: RF07068
2026-03-29 18:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2063cac8-c1b4-5c1b-8468-825f8883353a with identifier: RF07068 to the API
2026-03-29 18:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:17:31Z',
'fuel_type': 'petrol',
'id': '2063cac8-c1b4-5c1b-8468-825f8883353a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF07068',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 152347,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-07',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.4 TSI Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2013}
2026-03-29 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF07068%27 HTTP/1.1" 200 None
2026-03-29 18:31:48 [auto1.de] INFO: Saving data for RF07068: {'auction_closing_time': 1774883851.0, 'created_time': 1774722642.915174, 'last_price_update_time': 1774809108.847504}
2026-03-29 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF07068') HTTP/1.1" 204 0
2026-03-29 18:31:48 [auto1.de] INFO: Found listing with ID: MU49508
2026-03-29 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU49508%27 HTTP/1.1" 200 None
2026-03-29 18:31:48 [auto1.de] INFO: Scrape type for MU49508: 2
2026-03-29 18:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57408875-a72b-51ea-be38-bba26194e66b with identifier: MU49508
2026-03-29 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57408875-a72b-51ea-be38-bba26194e66b with scrape type 2
2026-03-29 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57408875-a72b-51ea-be38-bba26194e66b with scrape type 2
2026-03-29 18:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57408875-a72b-51ea-be38-bba26194e66b, identifier: MU49508
2026-03-29 18:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57408875-a72b-51ea-be38-bba26194e66b with identifier: MU49508
2026-03-29 18:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57408875-a72b-51ea-be38-bba26194e66b with identifier: MU49508
2026-03-29 18:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57408875-a72b-51ea-be38-bba26194e66b with identifier: MU49508 to the API
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:38:37Z',
'fuel_type': 'diesel',
'id': '57408875-a72b-51ea-be38-bba26194e66b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU49508',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 337044,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-25',
'seller_name': None,
'title': 'Volvo XC60 2.0 D4 Momentum 2WD',
'transmission': 'automatic',
'trim': 'Momentum 2WD',
'year': 2012}
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU49508%27 HTTP/1.1" 200 None
2026-03-29 18:31:49 [auto1.de] INFO: Saving data for MU49508: {'auction_closing_time': 1774885117.0, 'created_time': 1774349537.52918, 'last_price_update_time': 1774809109.310896}
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU49508') HTTP/1.1" 204 0
2026-03-29 18:31:49 [auto1.de] INFO: Found listing with ID: KD86114
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD86114%27 HTTP/1.1" 200 None
2026-03-29 18:31:49 [auto1.de] INFO: Scrape type for KD86114: 2
2026-03-29 18:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e35f26-b653-5b62-adbd-a8768fa97370 with identifier: KD86114
2026-03-29 18:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e35f26-b653-5b62-adbd-a8768fa97370 with scrape type 2
2026-03-29 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55e35f26-b653-5b62-adbd-a8768fa97370 with scrape type 2
2026-03-29 18:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55e35f26-b653-5b62-adbd-a8768fa97370, identifier: KD86114
2026-03-29 18:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55e35f26-b653-5b62-adbd-a8768fa97370 with identifier: KD86114
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-29 18:31:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55e35f26-b653-5b62-adbd-a8768fa97370 with identifier: KD86114
2026-03-29 18:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55e35f26-b653-5b62-adbd-a8768fa97370 with identifier: KD86114 to the API
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:48:09Z',
'fuel_type': 'petrol',
'id': '55e35f26-b653-5b62-adbd-a8768fa97370',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD86114',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 82108,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-06-20',
'seller_name': None,
'title': 'Peugeot 2008 1.2 Mild-Hybrid Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2024}
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD86114%27 HTTP/1.1" 200 None
2026-03-29 18:31:49 [auto1.de] INFO: Saving data for KD86114: {'auction_closing_time': 1774885689.0, 'created_time': 1774722639.79624, 'last_price_update_time': 1774809109.896781}
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD86114') HTTP/1.1" 204 0
2026-03-29 18:31:49 [auto1.de] INFO: Found listing with ID: AY96814
2026-03-29 18:31:49 [auto1.de] INFO: Found listing with ID: EF75873
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF75873%27 HTTP/1.1" 200 None
2026-03-29 18:31:49 [auto1.de] INFO: Scrape type for EF75873: 2
2026-03-29 18:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eaacb14-3bca-5de9-9be6-a6bce274e6c6 with identifier: EF75873
2026-03-29 18:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eaacb14-3bca-5de9-9be6-a6bce274e6c6 with scrape type 2
2026-03-29 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eaacb14-3bca-5de9-9be6-a6bce274e6c6 with scrape type 2
2026-03-29 18:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6eaacb14-3bca-5de9-9be6-a6bce274e6c6, identifier: EF75873
2026-03-29 18:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6eaacb14-3bca-5de9-9be6-a6bce274e6c6 with identifier: EF75873
2026-03-29 18:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6eaacb14-3bca-5de9-9be6-a6bce274e6c6 with identifier: EF75873
2026-03-29 18:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6eaacb14-3bca-5de9-9be6-a6bce274e6c6 with identifier: EF75873 to the API
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:31:34Z',
'fuel_type': 'diesel',
'id': '6eaacb14-3bca-5de9-9be6-a6bce274e6c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF75873',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 127242,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-03',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Lounge 4Motion BlueMotion Tech',
'transmission': 'manual',
'trim': 'Lounge 4Motion BlueMotion Tech',
'year': 2015}
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF75873%27 HTTP/1.1" 200 None
2026-03-29 18:31:50 [auto1.de] INFO: Saving data for EF75873: {'auction_closing_time': 1774884694.0, 'created_time': 1774722639.443115, 'last_price_update_time': 1774809110.326361}
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF75873') HTTP/1.1" 204 0
2026-03-29 18:31:50 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 6740 | hits on page: 40
2026-03-29 18:31:50 [auto1.de] INFO: Found listing with ID: HZ55109
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ55109%27 HTTP/1.1" 200 None
2026-03-29 18:31:50 [auto1.de] INFO: Scrape type for HZ55109: 2
2026-03-29 18:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efd83c5e-9672-54e2-a4b9-29b0de5c1374 with identifier: HZ55109
2026-03-29 18:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efd83c5e-9672-54e2-a4b9-29b0de5c1374 with scrape type 2
2026-03-29 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efd83c5e-9672-54e2-a4b9-29b0de5c1374 with scrape type 2
2026-03-29 18:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efd83c5e-9672-54e2-a4b9-29b0de5c1374, identifier: HZ55109
2026-03-29 18:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efd83c5e-9672-54e2-a4b9-29b0de5c1374 with identifier: HZ55109
2026-03-29 18:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efd83c5e-9672-54e2-a4b9-29b0de5c1374 with identifier: HZ55109
2026-03-29 18:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efd83c5e-9672-54e2-a4b9-29b0de5c1374 with identifier: HZ55109 to the API
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 195,
'expiration_date': '2026-03-30T15:18:01Z',
'fuel_type': 'diesel',
'id': 'efd83c5e-9672-54e2-a4b9-29b0de5c1374',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ55109',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 152317,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-29',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2017}
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ55109%27 HTTP/1.1" 200 None
2026-03-29 18:31:50 [auto1.de] INFO: Saving data for HZ55109: {'auction_closing_time': 1774883881.0, 'created_time': 1774722643.26327, 'last_price_update_time': 1774809110.73525}
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ55109') HTTP/1.1" 204 0
2026-03-29 18:31:50 [auto1.de] INFO: Found listing with ID: DS59005
2026-03-29 18:31:50 [auto1.de] INFO: Found listing with ID: MF86039
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF86039%27 HTTP/1.1" 200 None
2026-03-29 18:31:50 [auto1.de] INFO: Scrape type for MF86039: 2
2026-03-29 18:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afcca04c-440f-5f6b-b12e-105c4a41bbba with identifier: MF86039
2026-03-29 18:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afcca04c-440f-5f6b-b12e-105c4a41bbba with scrape type 2
2026-03-29 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afcca04c-440f-5f6b-b12e-105c4a41bbba with scrape type 2
2026-03-29 18:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afcca04c-440f-5f6b-b12e-105c4a41bbba, identifier: MF86039
2026-03-29 18:31:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:31:50 [auto1.de] INFO: Found listing with ID: UR98067
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98067%27 HTTP/1.1" 200 None
2026-03-29 18:31:50 [auto1.de] INFO: Scrape type for UR98067: 2
2026-03-29 18:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23df2a60-cac0-5843-92ed-4b677d992563 with identifier: UR98067
2026-03-29 18:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23df2a60-cac0-5843-92ed-4b677d992563 with scrape type 2
2026-03-29 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23df2a60-cac0-5843-92ed-4b677d992563 with scrape type 2
2026-03-29 18:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23df2a60-cac0-5843-92ed-4b677d992563, identifier: UR98067
2026-03-29 18:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afcca04c-440f-5f6b-b12e-105c4a41bbba with identifier: MF86039
2026-03-29 18:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afcca04c-440f-5f6b-b12e-105c4a41bbba with identifier: MF86039
2026-03-29 18:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afcca04c-440f-5f6b-b12e-105c4a41bbba with identifier: MF86039 to the API
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:12:27Z',
'fuel_type': 'diesel',
'id': 'afcca04c-440f-5f6b-b12e-105c4a41bbba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF86039',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 279207,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-01',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2017}
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF86039%27 HTTP/1.1" 200 None
2026-03-29 18:31:51 [auto1.de] INFO: Saving data for MF86039: {'auction_closing_time': 1774883547.0, 'created_time': 1774350112.359188, 'last_price_update_time': 1774809111.273778}
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF86039') HTTP/1.1" 204 0
2026-03-29 18:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23df2a60-cac0-5843-92ed-4b677d992563 with identifier: UR98067
2026-03-29 18:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23df2a60-cac0-5843-92ed-4b677d992563 with identifier: UR98067
2026-03-29 18:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23df2a60-cac0-5843-92ed-4b677d992563 with identifier: UR98067 to the API
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:59:53Z',
'fuel_type': 'petrol',
'id': '23df2a60-cac0-5843-92ed-4b677d992563',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR98067',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 160623,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-27',
'seller_name': None,
'title': 'Opel Corsa 1.4 Color Edition',
'transmission': 'manual',
'trim': 'Color Edition',
'year': 2012}
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98067%27 HTTP/1.1" 200 None
2026-03-29 18:31:51 [auto1.de] INFO: Saving data for UR98067: {'auction_closing_time': 1774886393.0, 'created_time': 1773467737.384401, 'last_price_update_time': 1774809111.603099}
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR98067') HTTP/1.1" 204 0
2026-03-29 18:31:51 [auto1.de] INFO: Found listing with ID: JV48558
2026-03-29 18:31:51 [auto1.de] INFO: Found listing with ID: SJ64604
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64604%27 HTTP/1.1" 200 None
2026-03-29 18:31:51 [auto1.de] INFO: Scrape type for SJ64604: 2
2026-03-29 18:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4891959-2518-5cf4-b03a-eeb28e47269e with identifier: SJ64604
2026-03-29 18:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4891959-2518-5cf4-b03a-eeb28e47269e with scrape type 2
2026-03-29 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4891959-2518-5cf4-b03a-eeb28e47269e with scrape type 2
2026-03-29 18:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4891959-2518-5cf4-b03a-eeb28e47269e, identifier: SJ64604
2026-03-29 18:31:51 [auto1.de] INFO: Found listing with ID: PT29857
2026-03-29 18:31:51 [auto1.de] INFO: Found listing with ID: CX74060
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX74060%27 HTTP/1.1" 200 None
2026-03-29 18:31:51 [auto1.de] INFO: Scrape type for CX74060: 2
2026-03-29 18:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03f0dbc-0a74-51f7-80d7-f054559dfe61 with identifier: CX74060
2026-03-29 18:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03f0dbc-0a74-51f7-80d7-f054559dfe61 with scrape type 2
2026-03-29 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b03f0dbc-0a74-51f7-80d7-f054559dfe61 with scrape type 2
2026-03-29 18:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b03f0dbc-0a74-51f7-80d7-f054559dfe61, identifier: CX74060
2026-03-29 18:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4891959-2518-5cf4-b03a-eeb28e47269e with identifier: SJ64604
2026-03-29 18:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4891959-2518-5cf4-b03a-eeb28e47269e with identifier: SJ64604
2026-03-29 18:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4891959-2518-5cf4-b03a-eeb28e47269e with identifier: SJ64604 to the API
2026-03-29 18:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:36:41Z',
'fuel_type': 'petrol',
'id': 'e4891959-2518-5cf4-b03a-eeb28e47269e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ64604',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 219095,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-10',
'seller_name': None,
'title': 'Volkswagen Golf V 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2008}
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64604%27 HTTP/1.1" 200 None
2026-03-29 18:31:52 [auto1.de] INFO: Saving data for SJ64604: {'auction_closing_time': 1774885001.0, 'created_time': 1773427626.721407, 'last_price_update_time': 1774809112.164896}
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ64604') HTTP/1.1" 204 0
2026-03-29 18:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b03f0dbc-0a74-51f7-80d7-f054559dfe61 with identifier: CX74060
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 18:31:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b03f0dbc-0a74-51f7-80d7-f054559dfe61 with identifier: CX74060
2026-03-29 18:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b03f0dbc-0a74-51f7-80d7-f054559dfe61 with identifier: CX74060 to the API
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:36:21Z',
'fuel_type': 'diesel',
'id': 'b03f0dbc-0a74-51f7-80d7-f054559dfe61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX74060',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 164533,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-28',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI Trendline 4Motion',
'transmission': 'manual',
'trim': 'Trendline 4Motion',
'year': 2013}
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX74060%27 HTTP/1.1" 200 None
2026-03-29 18:31:52 [auto1.de] INFO: Saving data for CX74060: {'auction_closing_time': 1774884981.0, 'created_time': 1773426704.978276, 'last_price_update_time': 1774809112.754364}
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX74060') HTTP/1.1" 204 0
2026-03-29 18:31:52 [auto1.de] INFO: Found listing with ID: LH54346
2026-03-29 18:31:52 [auto1.de] INFO: Found listing with ID: DT57257
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT57257%27 HTTP/1.1" 200 None
2026-03-29 18:31:52 [auto1.de] INFO: Scrape type for DT57257: 2
2026-03-29 18:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faa2166b-ac17-5280-9bbe-7a1a537270f8 with identifier: DT57257
2026-03-29 18:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faa2166b-ac17-5280-9bbe-7a1a537270f8 with scrape type 2
2026-03-29 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faa2166b-ac17-5280-9bbe-7a1a537270f8 with scrape type 2
2026-03-29 18:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faa2166b-ac17-5280-9bbe-7a1a537270f8, identifier: DT57257
2026-03-29 18:31:52 [auto1.de] INFO: Found listing with ID: LA18154
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA18154%27 HTTP/1.1" 200 None
2026-03-29 18:31:52 [auto1.de] INFO: Scrape type for LA18154: 2
2026-03-29 18:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4b923b9-bba2-5b47-91e0-df2a861efbf4 with identifier: LA18154
2026-03-29 18:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4b923b9-bba2-5b47-91e0-df2a861efbf4 with scrape type 2
2026-03-29 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4b923b9-bba2-5b47-91e0-df2a861efbf4 with scrape type 2
2026-03-29 18:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4b923b9-bba2-5b47-91e0-df2a861efbf4, identifier: LA18154
2026-03-29 18:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faa2166b-ac17-5280-9bbe-7a1a537270f8 with identifier: DT57257
2026-03-29 18:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faa2166b-ac17-5280-9bbe-7a1a537270f8 with identifier: DT57257
2026-03-29 18:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faa2166b-ac17-5280-9bbe-7a1a537270f8 with identifier: DT57257 to the API
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:58:50Z',
'fuel_type': 'diesel',
'id': 'faa2166b-ac17-5280-9bbe-7a1a537270f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT57257',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 159942,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-11',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2013}
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT57257%27 HTTP/1.1" 200 None
2026-03-29 18:31:53 [auto1.de] INFO: Saving data for DT57257: {'auction_closing_time': 1774886330.0, 'created_time': 1773429154.259543, 'last_price_update_time': 1774809113.294209}
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT57257') HTTP/1.1" 204 0
2026-03-29 18:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4b923b9-bba2-5b47-91e0-df2a861efbf4 with identifier: LA18154
2026-03-29 18:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4b923b9-bba2-5b47-91e0-df2a861efbf4 with identifier: LA18154
2026-03-29 18:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4b923b9-bba2-5b47-91e0-df2a861efbf4 with identifier: LA18154 to the API
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:53:19Z',
'fuel_type': 'petrol',
'id': 'f4b923b9-bba2-5b47-91e0-df2a861efbf4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA18154',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 103332,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-12',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 TGDI Trend 2WD',
'transmission': 'manual',
'trim': 'Trend 2WD',
'year': 2019}
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA18154%27 HTTP/1.1" 200 None
2026-03-29 18:31:53 [auto1.de] INFO: Saving data for LA18154: {'auction_closing_time': 1774885999.0, 'created_time': 1773467571.930998, 'last_price_update_time': 1774809113.610238}
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA18154') HTTP/1.1" 204 0
2026-03-29 18:31:53 [auto1.de] INFO: Found listing with ID: VT63649
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT63649%27 HTTP/1.1" 200 None
2026-03-29 18:31:53 [auto1.de] INFO: Scrape type for VT63649: 2
2026-03-29 18:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8e47cae-82a9-5e87-9a19-15afe5a20e8f with identifier: VT63649
2026-03-29 18:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8e47cae-82a9-5e87-9a19-15afe5a20e8f with scrape type 2
2026-03-29 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8e47cae-82a9-5e87-9a19-15afe5a20e8f with scrape type 2
2026-03-29 18:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8e47cae-82a9-5e87-9a19-15afe5a20e8f, identifier: VT63649
2026-03-29 18:31:53 [auto1.de] INFO: Found listing with ID: WA25791
2026-03-29 18:31:53 [auto1.de] INFO: Found listing with ID: LN99770
2026-03-29 18:31:53 [auto1.de] INFO: Found listing with ID: NK17990
2026-03-29 18:31:53 [auto1.de] INFO: Found listing with ID: CY43451
2026-03-29 18:31:53 [auto1.de] INFO: Found listing with ID: ZX96561
2026-03-29 18:31:53 [auto1.de] INFO: Found listing with ID: LX79709
2026-03-29 18:31:53 [auto1.de] INFO: Found listing with ID: KC50640
2026-03-29 18:31:53 [auto1.de] INFO: Found listing with ID: VR60747
2026-03-29 18:31:53 [auto1.de] INFO: Found listing with ID: SZ06147
2026-03-29 18:31:53 [auto1.de] INFO: Found listing with ID: CW95568
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW95568%27 HTTP/1.1" 200 None
2026-03-29 18:31:53 [auto1.de] INFO: Scrape type for CW95568: 2
2026-03-29 18:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74ae5883-2dca-50f6-a67f-dc87cfd92846 with identifier: CW95568
2026-03-29 18:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74ae5883-2dca-50f6-a67f-dc87cfd92846 with scrape type 2
2026-03-29 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74ae5883-2dca-50f6-a67f-dc87cfd92846 with scrape type 2
2026-03-29 18:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74ae5883-2dca-50f6-a67f-dc87cfd92846, identifier: CW95568
2026-03-29 18:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8e47cae-82a9-5e87-9a19-15afe5a20e8f with identifier: VT63649
2026-03-29 18:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8e47cae-82a9-5e87-9a19-15afe5a20e8f with identifier: VT63649
2026-03-29 18:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8e47cae-82a9-5e87-9a19-15afe5a20e8f with identifier: VT63649 to the API
2026-03-29 18:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:53:59Z',
'fuel_type': 'petrol',
'id': 'e8e47cae-82a9-5e87-9a19-15afe5a20e8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT63649',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 149592,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-05',
'seller_name': None,
'title': 'Opel Corsa 1.2 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2009}
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT63649%27 HTTP/1.1" 200 None
2026-03-29 18:31:54 [auto1.de] INFO: Saving data for VT63649: {'auction_closing_time': 1774886039.0, 'created_time': 1773468735.32282, 'last_price_update_time': 1774809114.173524}
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT63649') HTTP/1.1" 204 0
2026-03-29 18:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74ae5883-2dca-50f6-a67f-dc87cfd92846 with identifier: CW95568
2026-03-29 18:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74ae5883-2dca-50f6-a67f-dc87cfd92846 with identifier: CW95568
2026-03-29 18:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74ae5883-2dca-50f6-a67f-dc87cfd92846 with identifier: CW95568 to the API
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:14:44Z',
'fuel_type': 'petrol',
'id': '74ae5883-2dca-50f6-a67f-dc87cfd92846',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW95568',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 116382,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-17',
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2018}
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW95568%27 HTTP/1.1" 200 None
2026-03-29 18:31:54 [auto1.de] INFO: Saving data for CW95568: {'auction_closing_time': 1774883684.0, 'created_time': 1773468995.412244, 'last_price_update_time': 1774809114.577923}
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW95568') HTTP/1.1" 204 0
2026-03-29 18:31:54 [auto1.de] INFO: Found listing with ID: JX79740
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX79740%27 HTTP/1.1" 200 None
2026-03-29 18:31:54 [auto1.de] INFO: Scrape type for JX79740: 2
2026-03-29 18:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53ffc70a-1ed1-586a-934a-d1d7b1d4030b with identifier: JX79740
2026-03-29 18:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53ffc70a-1ed1-586a-934a-d1d7b1d4030b with scrape type 2
2026-03-29 18:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53ffc70a-1ed1-586a-934a-d1d7b1d4030b with scrape type 2
2026-03-29 18:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53ffc70a-1ed1-586a-934a-d1d7b1d4030b, identifier: JX79740
2026-03-29 18:31:54 [auto1.de] INFO: Found listing with ID: NV70278
2026-03-29 18:31:54 [auto1.de] INFO: Found listing with ID: ZL59344
2026-03-29 18:31:54 [auto1.de] INFO: Found listing with ID: GD26044
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD26044%27 HTTP/1.1" 200 None
2026-03-29 18:31:54 [auto1.de] INFO: Scrape type for GD26044: 2
2026-03-29 18:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6a9cdc8-2d56-596c-9881-85c8182855cd with identifier: GD26044
2026-03-29 18:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6a9cdc8-2d56-596c-9881-85c8182855cd with scrape type 2
2026-03-29 18:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6a9cdc8-2d56-596c-9881-85c8182855cd with scrape type 2
2026-03-29 18:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6a9cdc8-2d56-596c-9881-85c8182855cd, identifier: GD26044
2026-03-29 18:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53ffc70a-1ed1-586a-934a-d1d7b1d4030b with identifier: JX79740
2026-03-29 18:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53ffc70a-1ed1-586a-934a-d1d7b1d4030b with identifier: JX79740
2026-03-29 18:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53ffc70a-1ed1-586a-934a-d1d7b1d4030b with identifier: JX79740 to the API
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:56:38Z',
'fuel_type': 'diesel',
'id': '53ffc70a-1ed1-586a-934a-d1d7b1d4030b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX79740',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 109003,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-20',
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX79740%27 HTTP/1.1" 200 None
2026-03-29 18:31:55 [auto1.de] INFO: Saving data for JX79740: {'auction_closing_time': 1774886198.0, 'created_time': 1774118866.14086, 'last_price_update_time': 1774809115.098443}
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX79740') HTTP/1.1" 204 0
2026-03-29 18:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6a9cdc8-2d56-596c-9881-85c8182855cd with identifier: GD26044
2026-03-29 18:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6a9cdc8-2d56-596c-9881-85c8182855cd with identifier: GD26044
2026-03-29 18:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6a9cdc8-2d56-596c-9881-85c8182855cd with identifier: GD26044 to the API
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:31:13Z',
'fuel_type': 'diesel',
'id': 'f6a9cdc8-2d56-596c-9881-85c8182855cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD26044',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 124870,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-23',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2014}
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD26044%27 HTTP/1.1" 200 None
2026-03-29 18:31:55 [auto1.de] INFO: Saving data for GD26044: {'auction_closing_time': 1774884673.0, 'created_time': 1773302229.467592, 'last_price_update_time': 1774809115.402743}
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD26044') HTTP/1.1" 204 0
2026-03-29 18:31:55 [auto1.de] INFO: Found listing with ID: FR69109
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR69109%27 HTTP/1.1" 200 None
2026-03-29 18:31:55 [auto1.de] INFO: Scrape type for FR69109: 2
2026-03-29 18:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 164b0b97-5f2b-57e7-ad9f-b2cf28262f43 with identifier: FR69109
2026-03-29 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 164b0b97-5f2b-57e7-ad9f-b2cf28262f43 with scrape type 2
2026-03-29 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 164b0b97-5f2b-57e7-ad9f-b2cf28262f43 with scrape type 2
2026-03-29 18:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 164b0b97-5f2b-57e7-ad9f-b2cf28262f43, identifier: FR69109
2026-03-29 18:31:55 [auto1.de] INFO: Found listing with ID: EE96817
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE96817%27 HTTP/1.1" 200 None
2026-03-29 18:31:55 [auto1.de] INFO: Scrape type for EE96817: 2
2026-03-29 18:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4776b629-e013-5570-8f72-88347287f5f5 with identifier: EE96817
2026-03-29 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4776b629-e013-5570-8f72-88347287f5f5 with scrape type 2
2026-03-29 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4776b629-e013-5570-8f72-88347287f5f5 with scrape type 2
2026-03-29 18:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4776b629-e013-5570-8f72-88347287f5f5, identifier: EE96817
2026-03-29 18:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 164b0b97-5f2b-57e7-ad9f-b2cf28262f43 with identifier: FR69109
2026-03-29 18:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 164b0b97-5f2b-57e7-ad9f-b2cf28262f43 with identifier: FR69109
2026-03-29 18:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 164b0b97-5f2b-57e7-ad9f-b2cf28262f43 with identifier: FR69109 to the API
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:04:48Z',
'fuel_type': 'petrol',
'id': '164b0b97-5f2b-57e7-ad9f-b2cf28262f43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR69109',
'listing': 'auction',
'make': 'Toyota',
'model': 'Auris',
'odometer': 113159,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-31',
'seller_name': None,
'title': 'Toyota Auris 1.3 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2009}
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR69109%27 HTTP/1.1" 200 None
2026-03-29 18:31:55 [auto1.de] INFO: Saving data for FR69109: {'auction_closing_time': 1774883088.0, 'created_time': 1774031521.331701, 'last_price_update_time': 1774809115.936569}
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR69109') HTTP/1.1" 204 0
2026-03-29 18:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4776b629-e013-5570-8f72-88347287f5f5 with identifier: EE96817
2026-03-29 18:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4776b629-e013-5570-8f72-88347287f5f5 with identifier: EE96817
2026-03-29 18:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4776b629-e013-5570-8f72-88347287f5f5 with identifier: EE96817 to the API
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:49:25Z',
'fuel_type': 'petrol',
'id': '4776b629-e013-5570-8f72-88347287f5f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE96817',
'listing': 'auction',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 69055,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-25',
'seller_name': None,
'title': 'Skoda Karoq 1.5 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE96817%27 HTTP/1.1" 200 None
2026-03-29 18:31:56 [auto1.de] INFO: Saving data for EE96817: {'auction_closing_time': 1774885765.0, 'created_time': 1774089201.051592, 'last_price_update_time': 1774809116.247812}
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE96817') HTTP/1.1" 204 0
2026-03-29 18:31:56 [auto1.de] INFO: Found listing with ID: BS19118
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS19118%27 HTTP/1.1" 200 None
2026-03-29 18:31:56 [auto1.de] INFO: Scrape type for BS19118: 2
2026-03-29 18:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70ee74f4-9aff-5d15-abb4-50dbac5fa953 with identifier: BS19118
2026-03-29 18:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70ee74f4-9aff-5d15-abb4-50dbac5fa953 with scrape type 2
2026-03-29 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70ee74f4-9aff-5d15-abb4-50dbac5fa953 with scrape type 2
2026-03-29 18:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70ee74f4-9aff-5d15-abb4-50dbac5fa953, identifier: BS19118
2026-03-29 18:31:56 [auto1.de] INFO: Found listing with ID: NH06338
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH06338%27 HTTP/1.1" 200 None
2026-03-29 18:31:56 [auto1.de] INFO: Scrape type for NH06338: 2
2026-03-29 18:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1 with identifier: NH06338
2026-03-29 18:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1 with scrape type 2
2026-03-29 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1 with scrape type 2
2026-03-29 18:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1, identifier: NH06338
2026-03-29 18:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70ee74f4-9aff-5d15-abb4-50dbac5fa953 with identifier: BS19118
2026-03-29 18:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70ee74f4-9aff-5d15-abb4-50dbac5fa953 with identifier: BS19118
2026-03-29 18:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70ee74f4-9aff-5d15-abb4-50dbac5fa953 with identifier: BS19118 to the API
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:00:49Z',
'fuel_type': 'hybrid',
'id': '70ee74f4-9aff-5d15-abb4-50dbac5fa953',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS19118',
'listing': 'auction',
'make': 'Peugeot',
'model': '508',
'odometer': 40199,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-07',
'seller_name': None,
'title': 'Peugeot 508 1.6 Hybrid 225 GT',
'transmission': 'automatic',
'trim': '225 GT',
'year': 2022}
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS19118%27 HTTP/1.1" 200 None
2026-03-29 18:31:56 [auto1.de] INFO: Saving data for BS19118: {'auction_closing_time': 1774882849.0, 'created_time': 1774034053.785726, 'last_price_update_time': 1774809116.763917}
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS19118') HTTP/1.1" 204 0
2026-03-29 18:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1 with identifier: NH06338
2026-03-29 18:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1 with identifier: NH06338
2026-03-29 18:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1 with identifier: NH06338 to the API
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 65,
'expiration_date': '2026-03-30T15:46:54Z',
'fuel_type': 'petrol',
'id': '6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH06338',
'listing': 'auction',
'make': 'Nissan',
'model': 'Micra',
'odometer': 114547,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-28',
'seller_name': None,
'title': 'Nissan Micra 1.2 Visia',
'transmission': 'manual',
'trim': 'Visia',
'year': 2009}
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH06338%27 HTTP/1.1" 200 None
2026-03-29 18:31:57 [auto1.de] INFO: Saving data for NH06338: {'auction_closing_time': 1774885614.0, 'created_time': 1774722649.613262, 'last_price_update_time': 1774809117.06955}
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH06338') HTTP/1.1" 204 0
2026-03-29 18:31:57 [auto1.de] INFO: Found listing with ID: JX21647
2026-03-29 18:31:57 [auto1.de] INFO: Found listing with ID: VU30885
2026-03-29 18:31:57 [auto1.de] INFO: Found listing with ID: MM90627
2026-03-29 18:31:57 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP11609%27 HTTP/1.1" 200 None
2026-03-29 18:31:57 [auto1.de] INFO: Scrape type for UP11609: 0
2026-03-29 18:31:57 [auto1.de] INFO: Found listing with ID: SL92984
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL92984%27 HTTP/1.1" 200 None
2026-03-29 18:31:57 [auto1.de] INFO: Scrape type for SL92984: 2
2026-03-29 18:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9ca5f7a-b989-510f-bd2c-8d4365e82d2b with identifier: SL92984
2026-03-29 18:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9ca5f7a-b989-510f-bd2c-8d4365e82d2b with scrape type 2
2026-03-29 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9ca5f7a-b989-510f-bd2c-8d4365e82d2b with scrape type 2
2026-03-29 18:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9ca5f7a-b989-510f-bd2c-8d4365e82d2b, identifier: SL92984
2026-03-29 18:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9ca5f7a-b989-510f-bd2c-8d4365e82d2b with identifier: SL92984
2026-03-29 18:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9ca5f7a-b989-510f-bd2c-8d4365e82d2b with identifier: SL92984
2026-03-29 18:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9ca5f7a-b989-510f-bd2c-8d4365e82d2b with identifier: SL92984 to the API
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:55:56Z',
'fuel_type': 'diesel',
'id': 'f9ca5f7a-b989-510f-bd2c-8d4365e82d2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL92984',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 133910,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-12',
'seller_name': None,
'title': 'BMW 3er 335d GT xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2016}
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL92984%27 HTTP/1.1" 200 None
2026-03-29 18:31:57 [auto1.de] INFO: Saving data for SL92984: {'auction_closing_time': 1774886156.0, 'created_time': 1774722654.165908, 'last_price_update_time': 1774809117.490337}
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL92984') HTTP/1.1" 204 0
2026-03-29 18:31:57 [auto1.de] INFO: Found listing with ID: GH39731
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39731%27 HTTP/1.1" 200 None
2026-03-29 18:31:57 [auto1.de] INFO: Scrape type for GH39731: 2
2026-03-29 18:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e93735e-2da9-50ca-bf5f-bfab5874df2d with identifier: GH39731
2026-03-29 18:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e93735e-2da9-50ca-bf5f-bfab5874df2d with scrape type 2
2026-03-29 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e93735e-2da9-50ca-bf5f-bfab5874df2d with scrape type 2
2026-03-29 18:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e93735e-2da9-50ca-bf5f-bfab5874df2d, identifier: GH39731
2026-03-29 18:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e93735e-2da9-50ca-bf5f-bfab5874df2d with identifier: GH39731
2026-03-29 18:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e93735e-2da9-50ca-bf5f-bfab5874df2d with identifier: GH39731
2026-03-29 18:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e93735e-2da9-50ca-bf5f-bfab5874df2d with identifier: GH39731 to the API
2026-03-29 18:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:22:34Z',
'fuel_type': 'diesel',
'id': '4e93735e-2da9-50ca-bf5f-bfab5874df2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH39731',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 137933,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-15',
'seller_name': None,
'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
'transmission': 'manual',
'trim': 'Kinetic 2WD',
'year': 2016}
2026-03-29 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39731%27 HTTP/1.1" 200 None
2026-03-29 18:31:58 [auto1.de] INFO: Saving data for GH39731: {'auction_closing_time': 1774884154.0, 'created_time': 1774031491.396866, 'last_price_update_time': 1774809118.487865}
2026-03-29 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH39731') HTTP/1.1" 204 0
2026-03-29 18:31:58 [auto1.de] INFO: Found listing with ID: JG03809
2026-03-29 18:31:58 [auto1.de] INFO: Found listing with ID: SN42334
2026-03-29 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN42334%27 HTTP/1.1" 200 None
2026-03-29 18:31:58 [auto1.de] INFO: Scrape type for SN42334: 2
2026-03-29 18:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9a04f92-8da5-5119-9d06-b55f448c66b4 with identifier: SN42334
2026-03-29 18:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9a04f92-8da5-5119-9d06-b55f448c66b4 with scrape type 2
2026-03-29 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9a04f92-8da5-5119-9d06-b55f448c66b4 with scrape type 2
2026-03-29 18:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9a04f92-8da5-5119-9d06-b55f448c66b4, identifier: SN42334
2026-03-29 18:31:58 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 6740 | hits on page: 40
2026-03-29 18:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9a04f92-8da5-5119-9d06-b55f448c66b4 with identifier: SN42334
2026-03-29 18:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9a04f92-8da5-5119-9d06-b55f448c66b4 with identifier: SN42334
2026-03-29 18:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9a04f92-8da5-5119-9d06-b55f448c66b4 with identifier: SN42334 to the API
2026-03-29 18:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 286,
'expiration_date': '2026-03-30T15:54:56Z',
'fuel_type': 'diesel',
'id': 'c9a04f92-8da5-5119-9d06-b55f448c66b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN42334',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 125291,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-16',
'seller_name': None,
'title': 'Audi A6 50 TDI Mild-Hybrid quattro Design',
'transmission': 'automatic',
'trim': 'quattro Design',
'year': 2018}
2026-03-29 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN42334%27 HTTP/1.1" 200 None
2026-03-29 18:31:58 [auto1.de] INFO: Saving data for SN42334: {'auction_closing_time': 1774886096.0, 'created_time': 1773466752.964476, 'last_price_update_time': 1774809118.933013}
2026-03-29 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN42334') HTTP/1.1" 204 0
2026-03-29 18:31:58 [auto1.de] INFO: Found listing with ID: NV30450
2026-03-29 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV30450%27 HTTP/1.1" 200 None
2026-03-29 18:31:58 [auto1.de] INFO: Scrape type for NV30450: 2
2026-03-29 18:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2e3695f-b1fa-5d4e-9102-4a573089b0e8 with identifier: NV30450
2026-03-29 18:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2e3695f-b1fa-5d4e-9102-4a573089b0e8 with scrape type 2
2026-03-29 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2e3695f-b1fa-5d4e-9102-4a573089b0e8 with scrape type 2
2026-03-29 18:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2e3695f-b1fa-5d4e-9102-4a573089b0e8, identifier: NV30450
2026-03-29 18:31:59 [auto1.de] INFO: Found listing with ID: DC32299
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC32299%27 HTTP/1.1" 200 None
2026-03-29 18:31:59 [auto1.de] INFO: Scrape type for DC32299: 2
2026-03-29 18:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7915730f-c15d-576d-8a6e-4ddc67d0107c with identifier: DC32299
2026-03-29 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7915730f-c15d-576d-8a6e-4ddc67d0107c with scrape type 2
2026-03-29 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7915730f-c15d-576d-8a6e-4ddc67d0107c with scrape type 2
2026-03-29 18:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7915730f-c15d-576d-8a6e-4ddc67d0107c, identifier: DC32299
2026-03-29 18:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2e3695f-b1fa-5d4e-9102-4a573089b0e8 with identifier: NV30450
2026-03-29 18:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2e3695f-b1fa-5d4e-9102-4a573089b0e8 with identifier: NV30450
2026-03-29 18:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2e3695f-b1fa-5d4e-9102-4a573089b0e8 with identifier: NV30450 to the API
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:19:29Z',
'fuel_type': 'diesel',
'id': 'd2e3695f-b1fa-5d4e-9102-4a573089b0e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV30450',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 239497,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-23',
'seller_name': None,
'title': 'BMW 5er 520d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV30450%27 HTTP/1.1" 200 None
2026-03-29 18:31:59 [auto1.de] INFO: Saving data for NV30450: {'auction_closing_time': 1774883969.0, 'created_time': 1774722654.968519, 'last_price_update_time': 1774809119.463804}
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV30450') HTTP/1.1" 204 0
2026-03-29 18:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7915730f-c15d-576d-8a6e-4ddc67d0107c with identifier: DC32299
2026-03-29 18:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7915730f-c15d-576d-8a6e-4ddc67d0107c with identifier: DC32299
2026-03-29 18:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7915730f-c15d-576d-8a6e-4ddc67d0107c with identifier: DC32299 to the API
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:59:17Z',
'fuel_type': 'diesel',
'id': '7915730f-c15d-576d-8a6e-4ddc67d0107c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC32299',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 147831,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-28',
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
'transmission': 'automatic',
'trim': 'BlueMotion',
'year': 2012}
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC32299%27 HTTP/1.1" 200 None
2026-03-29 18:31:59 [auto1.de] INFO: Saving data for DC32299: {'auction_closing_time': 1774886357.0, 'created_time': 1773426755.346334, 'last_price_update_time': 1774809119.771948}
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC32299') HTTP/1.1" 204 0
2026-03-29 18:31:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:31:59 [auto1.de] INFO: Found listing with ID: ZW50012
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW50012%27 HTTP/1.1" 200 None
2026-03-29 18:31:59 [auto1.de] INFO: Scrape type for ZW50012: 2
2026-03-29 18:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c98b61e-0691-5631-850f-217bff1d1d90 with identifier: ZW50012
2026-03-29 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c98b61e-0691-5631-850f-217bff1d1d90 with scrape type 2
2026-03-29 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c98b61e-0691-5631-850f-217bff1d1d90 with scrape type 2
2026-03-29 18:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c98b61e-0691-5631-850f-217bff1d1d90, identifier: ZW50012
2026-03-29 18:31:59 [auto1.de] INFO: Found listing with ID: SD24294
2026-03-29 18:31:59 [auto1.de] INFO: Found listing with ID: JY97697
2026-03-29 18:31:59 [auto1.de] INFO: Found listing with ID: ZM10504
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM10504%27 HTTP/1.1" 200 None
2026-03-29 18:31:59 [auto1.de] INFO: Scrape type for ZM10504: 2
2026-03-29 18:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa9a5f40-85ed-5712-8522-5c8c0085619c with identifier: ZM10504
2026-03-29 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa9a5f40-85ed-5712-8522-5c8c0085619c with scrape type 2
2026-03-29 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa9a5f40-85ed-5712-8522-5c8c0085619c with scrape type 2
2026-03-29 18:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa9a5f40-85ed-5712-8522-5c8c0085619c, identifier: ZM10504
2026-03-29 18:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c98b61e-0691-5631-850f-217bff1d1d90 with identifier: ZW50012
2026-03-29 18:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c98b61e-0691-5631-850f-217bff1d1d90 with identifier: ZW50012
2026-03-29 18:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c98b61e-0691-5631-850f-217bff1d1d90 with identifier: ZW50012 to the API
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:37:15Z',
'fuel_type': 'diesel',
'id': '9c98b61e-0691-5631-850f-217bff1d1d90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW50012',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 129150,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-23',
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 Td4 HSE',
'transmission': 'automatic',
'trim': 'HSE',
'year': 2015}
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW50012%27 HTTP/1.1" 200 None
2026-03-29 18:32:00 [auto1.de] INFO: Saving data for ZW50012: {'auction_closing_time': 1774885035.0, 'created_time': 1774118398.942037, 'last_price_update_time': 1774809120.293175}
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW50012') HTTP/1.1" 204 0
2026-03-29 18:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa9a5f40-85ed-5712-8522-5c8c0085619c with identifier: ZM10504
2026-03-29 18:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa9a5f40-85ed-5712-8522-5c8c0085619c with identifier: ZM10504
2026-03-29 18:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa9a5f40-85ed-5712-8522-5c8c0085619c with identifier: ZM10504 to the API
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 360,
'expiration_date': '2026-03-30T15:17:12Z',
'fuel_type': 'petrol',
'id': 'fa9a5f40-85ed-5712-8522-5c8c0085619c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM10504',
'listing': 'auction',
'make': 'BMW',
'model': 'X4',
'odometer': 35491,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-13',
'seller_name': None,
'title': 'BMW X4 M40i',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM10504%27 HTTP/1.1" 200 None
2026-03-29 18:32:00 [auto1.de] INFO: Saving data for ZM10504: {'auction_closing_time': 1774883832.0, 'created_time': 1773342217.629764, 'last_price_update_time': 1774809120.612074}
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM10504') HTTP/1.1" 204 0
2026-03-29 18:32:00 [auto1.de] INFO: Found listing with ID: YV85598
2026-03-29 18:32:00 [auto1.de] INFO: Found listing with ID: LE50284
2026-03-29 18:32:00 [auto1.de] INFO: Found listing with ID: AB49133
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49133%27 HTTP/1.1" 200 None
2026-03-29 18:32:00 [auto1.de] INFO: Scrape type for AB49133: 2
2026-03-29 18:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a08c3df5-bad3-53fd-a803-10f89c4bc7c9 with identifier: AB49133
2026-03-29 18:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a08c3df5-bad3-53fd-a803-10f89c4bc7c9 with scrape type 2
2026-03-29 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a08c3df5-bad3-53fd-a803-10f89c4bc7c9 with scrape type 2
2026-03-29 18:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a08c3df5-bad3-53fd-a803-10f89c4bc7c9, identifier: AB49133
2026-03-29 18:32:00 [auto1.de] INFO: Found listing with ID: NA60022
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA60022%27 HTTP/1.1" 200 None
2026-03-29 18:32:00 [auto1.de] INFO: Scrape type for NA60022: 2
2026-03-29 18:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 740b1dce-a97b-5678-9e81-426376ce14eb with identifier: NA60022
2026-03-29 18:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 740b1dce-a97b-5678-9e81-426376ce14eb with scrape type 2
2026-03-29 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 740b1dce-a97b-5678-9e81-426376ce14eb with scrape type 2
2026-03-29 18:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 740b1dce-a97b-5678-9e81-426376ce14eb, identifier: NA60022
2026-03-29 18:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a08c3df5-bad3-53fd-a803-10f89c4bc7c9 with identifier: AB49133
2026-03-29 18:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a08c3df5-bad3-53fd-a803-10f89c4bc7c9 with identifier: AB49133
2026-03-29 18:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a08c3df5-bad3-53fd-a803-10f89c4bc7c9 with identifier: AB49133 to the API
2026-03-29 18:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:15:55Z',
'fuel_type': 'petrol',
'id': 'a08c3df5-bad3-53fd-a803-10f89c4bc7c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB49133',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 153234,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-05',
'seller_name': None,
'title': 'Kia Sorento 2.4 Spirit 4WD',
'transmission': 'automatic',
'trim': 'Spirit 4WD',
'year': 2012}
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49133%27 HTTP/1.1" 200 None
2026-03-29 18:32:01 [auto1.de] INFO: Saving data for AB49133: {'auction_closing_time': 1774883755.0, 'created_time': 1774722658.31921, 'last_price_update_time': 1774809121.134975}
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB49133') HTTP/1.1" 204 0
2026-03-29 18:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 740b1dce-a97b-5678-9e81-426376ce14eb with identifier: NA60022
2026-03-29 18:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 740b1dce-a97b-5678-9e81-426376ce14eb with identifier: NA60022
2026-03-29 18:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 740b1dce-a97b-5678-9e81-426376ce14eb with identifier: NA60022 to the API
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:34:48Z',
'fuel_type': 'diesel',
'id': '740b1dce-a97b-5678-9e81-426376ce14eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA60022',
'listing': 'auction',
'make': 'Kia',
'model': 'Optima',
'odometer': 201290,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-28',
'seller_name': None,
'title': 'Kia Optima 1.7 CRDi Spirit',
'transmission': 'automatic',
'trim': 'Spirit',
'year': 2012}
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA60022%27 HTTP/1.1" 200 None
2026-03-29 18:32:01 [auto1.de] INFO: Saving data for NA60022: {'auction_closing_time': 1774884888.0, 'created_time': 1774032572.407129, 'last_price_update_time': 1774809121.525129}
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA60022') HTTP/1.1" 204 0
2026-03-29 18:32:01 [auto1.de] INFO: Found listing with ID: FN52751
2026-03-29 18:32:01 [auto1.de] INFO: Found listing with ID: KB67170
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB67170%27 HTTP/1.1" 200 None
2026-03-29 18:32:01 [auto1.de] INFO: Scrape type for KB67170: 2
2026-03-29 18:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94dbc75b-b6b7-591b-aa58-96c9ebd742e2 with identifier: KB67170
2026-03-29 18:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94dbc75b-b6b7-591b-aa58-96c9ebd742e2 with scrape type 2
2026-03-29 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94dbc75b-b6b7-591b-aa58-96c9ebd742e2 with scrape type 2
2026-03-29 18:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94dbc75b-b6b7-591b-aa58-96c9ebd742e2, identifier: KB67170
2026-03-29 18:32:01 [auto1.de] INFO: Found listing with ID: CH24864
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH24864%27 HTTP/1.1" 200 None
2026-03-29 18:32:01 [auto1.de] INFO: Scrape type for CH24864: 2
2026-03-29 18:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78bfc106-c780-5946-bffd-9834507f31fc with identifier: CH24864
2026-03-29 18:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78bfc106-c780-5946-bffd-9834507f31fc with scrape type 2
2026-03-29 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78bfc106-c780-5946-bffd-9834507f31fc with scrape type 2
2026-03-29 18:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78bfc106-c780-5946-bffd-9834507f31fc, identifier: CH24864
2026-03-29 18:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94dbc75b-b6b7-591b-aa58-96c9ebd742e2 with identifier: KB67170
2026-03-29 18:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94dbc75b-b6b7-591b-aa58-96c9ebd742e2 with identifier: KB67170
2026-03-29 18:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94dbc75b-b6b7-591b-aa58-96c9ebd742e2 with identifier: KB67170 to the API
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:49:22Z',
'fuel_type': 'diesel',
'id': '94dbc75b-b6b7-591b-aa58-96c9ebd742e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB67170',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 150844,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-04',
'seller_name': None,
'title': 'Audi A4 2.0 TDI Design ultra',
'transmission': 'automatic',
'trim': 'Design ultra',
'year': 2017}
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB67170%27 HTTP/1.1" 200 None
2026-03-29 18:32:02 [auto1.de] INFO: Saving data for KB67170: {'auction_closing_time': 1774885762.0, 'created_time': 1774349517.016865, 'last_price_update_time': 1774809122.049381}
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB67170') HTTP/1.1" 204 0
2026-03-29 18:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78bfc106-c780-5946-bffd-9834507f31fc with identifier: CH24864
2026-03-29 18:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78bfc106-c780-5946-bffd-9834507f31fc with identifier: CH24864
2026-03-29 18:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78bfc106-c780-5946-bffd-9834507f31fc with identifier: CH24864 to the API
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:20:06Z',
'fuel_type': 'diesel',
'id': '78bfc106-c780-5946-bffd-9834507f31fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH24864',
'listing': 'auction',
'make': 'Skoda',
'model': 'Rapid Spaceback',
'odometer': 144398,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-26',
'seller_name': None,
'title': 'Skoda Rapid Spaceback 1.6 TDI Drive',
'transmission': 'manual',
'trim': 'Drive',
'year': 2014}
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH24864%27 HTTP/1.1" 200 None
2026-03-29 18:32:02 [auto1.de] INFO: Saving data for CH24864: {'auction_closing_time': 1774884006.0, 'created_time': 1773307520.507692, 'last_price_update_time': 1774809122.367385}
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH24864') HTTP/1.1" 204 0
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: SC23766
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: CL73395
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: ZU96971
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: KF93262
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF93262%27 HTTP/1.1" 200 None
2026-03-29 18:32:02 [auto1.de] INFO: Scrape type for KF93262: 2
2026-03-29 18:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b95a52-fde9-5420-befe-cef72bed20e2 with identifier: KF93262
2026-03-29 18:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b95a52-fde9-5420-befe-cef72bed20e2 with scrape type 2
2026-03-29 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38b95a52-fde9-5420-befe-cef72bed20e2 with scrape type 2
2026-03-29 18:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38b95a52-fde9-5420-befe-cef72bed20e2, identifier: KF93262
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: GX79735
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: ZY33636
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: HJ92241
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: FL18278
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: TE81012
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: CG37224
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: BE55111
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: LV65947
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: VN71215
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: FY57331
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: GS42870
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: MT54263
2026-03-29 18:32:02 [auto1.de] INFO: Found listing with ID: AK26500
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK26500%27 HTTP/1.1" 200 None
2026-03-29 18:32:02 [auto1.de] INFO: Scrape type for AK26500: 2
2026-03-29 18:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ee2a469-befa-5607-b315-aebe1f19de9f with identifier: AK26500
2026-03-29 18:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ee2a469-befa-5607-b315-aebe1f19de9f with scrape type 2
2026-03-29 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ee2a469-befa-5607-b315-aebe1f19de9f with scrape type 2
2026-03-29 18:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ee2a469-befa-5607-b315-aebe1f19de9f, identifier: AK26500
2026-03-29 18:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38b95a52-fde9-5420-befe-cef72bed20e2 with identifier: KF93262
2026-03-29 18:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38b95a52-fde9-5420-befe-cef72bed20e2 with identifier: KF93262
2026-03-29 18:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38b95a52-fde9-5420-befe-cef72bed20e2 with identifier: KF93262 to the API
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 179,
'expiration_date': '2026-03-30T15:14:54Z',
'fuel_type': 'petrol',
'id': '38b95a52-fde9-5420-befe-cef72bed20e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF93262',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 16845,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-29',
'seller_name': None,
'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid GT-Line 4WD',
'transmission': 'automatic',
'trim': 'GT-Line 4WD',
'year': 2022}
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF93262%27 HTTP/1.1" 200 None
2026-03-29 18:32:02 [auto1.de] INFO: Saving data for KF93262: {'auction_closing_time': 1774883694.0, 'created_time': 1773688856.544371, 'last_price_update_time': 1774809122.923692}
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF93262') HTTP/1.1" 204 0
2026-03-29 18:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ee2a469-befa-5607-b315-aebe1f19de9f with identifier: AK26500
2026-03-29 18:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ee2a469-befa-5607-b315-aebe1f19de9f with identifier: AK26500
2026-03-29 18:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ee2a469-befa-5607-b315-aebe1f19de9f with identifier: AK26500 to the API
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:35:43Z',
'fuel_type': 'diesel',
'id': '1ee2a469-befa-5607-b315-aebe1f19de9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK26500',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 109381,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-18',
'seller_name': None,
'title': 'Volkswagen Passat 1.6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK26500%27 HTTP/1.1" 200 None
2026-03-29 18:32:03 [auto1.de] INFO: Saving data for AK26500: {'auction_closing_time': 1774884943.0, 'created_time': 1774722657.955394, 'last_price_update_time': 1774809123.346186}
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK26500') HTTP/1.1" 204 0
2026-03-29 18:32:03 [auto1.de] INFO: Found listing with ID: BP80209
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP80209%27 HTTP/1.1" 200 None
2026-03-29 18:32:03 [auto1.de] INFO: Scrape type for BP80209: 2
2026-03-29 18:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcd7a310-fb5e-5995-a51b-493598e6e4f2 with identifier: BP80209
2026-03-29 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcd7a310-fb5e-5995-a51b-493598e6e4f2 with scrape type 2
2026-03-29 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcd7a310-fb5e-5995-a51b-493598e6e4f2 with scrape type 2
2026-03-29 18:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcd7a310-fb5e-5995-a51b-493598e6e4f2, identifier: BP80209
2026-03-29 18:32:03 [auto1.de] INFO: Found listing with ID: ZZ49081
2026-03-29 18:32:03 [auto1.de] INFO: Found listing with ID: JL32962
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL32962%27 HTTP/1.1" 200 None
2026-03-29 18:32:03 [auto1.de] INFO: Scrape type for JL32962: 2
2026-03-29 18:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 959253b2-3db3-5285-a76d-48a35f6ed41e with identifier: JL32962
2026-03-29 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 959253b2-3db3-5285-a76d-48a35f6ed41e with scrape type 2
2026-03-29 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 959253b2-3db3-5285-a76d-48a35f6ed41e with scrape type 2
2026-03-29 18:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 959253b2-3db3-5285-a76d-48a35f6ed41e, identifier: JL32962
2026-03-29 18:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcd7a310-fb5e-5995-a51b-493598e6e4f2 with identifier: BP80209
2026-03-29 18:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcd7a310-fb5e-5995-a51b-493598e6e4f2 with identifier: BP80209
2026-03-29 18:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcd7a310-fb5e-5995-a51b-493598e6e4f2 with identifier: BP80209 to the API
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:49:18Z',
'fuel_type': 'petrol',
'id': 'dcd7a310-fb5e-5995-a51b-493598e6e4f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP80209',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 171473,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-21',
'seller_name': None,
'title': 'Hyundai i30 1.4 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2013}
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP80209%27 HTTP/1.1" 200 None
2026-03-29 18:32:03 [auto1.de] INFO: Saving data for BP80209: {'auction_closing_time': 1774885758.0, 'created_time': 1774031452.909335, 'last_price_update_time': 1774809123.853988}
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP80209') HTTP/1.1" 204 0
2026-03-29 18:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 959253b2-3db3-5285-a76d-48a35f6ed41e with identifier: JL32962
2026-03-29 18:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 959253b2-3db3-5285-a76d-48a35f6ed41e with identifier: JL32962
2026-03-29 18:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 959253b2-3db3-5285-a76d-48a35f6ed41e with identifier: JL32962 to the API
2026-03-29 18:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 67,
'expiration_date': '2026-03-30T15:13:21Z',
'fuel_type': 'petrol',
'id': '959253b2-3db3-5285-a76d-48a35f6ed41e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL32962',
'listing': 'auction',
'make': 'Kia',
'model': 'Picanto',
'odometer': 147958,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-31',
'seller_name': None,
'title': 'Kia Picanto 1.0 Spirit',
'transmission': 'manual',
'trim': 'Spirit',
'year': 2014}
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL32962%27 HTTP/1.1" 200 None
2026-03-29 18:32:04 [auto1.de] INFO: Saving data for JL32962: {'auction_closing_time': 1774883601.0, 'created_time': 1774349702.857531, 'last_price_update_time': 1774809124.167754}
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL32962') HTTP/1.1" 204 0
2026-03-29 18:32:04 [auto1.de] INFO: Found listing with ID: FR18143
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR18143%27 HTTP/1.1" 200 None
2026-03-29 18:32:04 [auto1.de] INFO: Scrape type for FR18143: 2
2026-03-29 18:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fdcbaa4-7735-542e-ab36-ac8d47184bed with identifier: FR18143
2026-03-29 18:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fdcbaa4-7735-542e-ab36-ac8d47184bed with scrape type 2
2026-03-29 18:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fdcbaa4-7735-542e-ab36-ac8d47184bed with scrape type 2
2026-03-29 18:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fdcbaa4-7735-542e-ab36-ac8d47184bed, identifier: FR18143
2026-03-29 18:32:04 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-29 18:32:04 [auto1.de] INFO: Found listing with ID: UN88738
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN88738%27 HTTP/1.1" 200 None
2026-03-29 18:32:04 [auto1.de] INFO: Scrape type for UN88738: 2
2026-03-29 18:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dca795a-8fe7-5cea-b20a-9ae3ca162183 with identifier: UN88738
2026-03-29 18:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dca795a-8fe7-5cea-b20a-9ae3ca162183 with scrape type 2
2026-03-29 18:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dca795a-8fe7-5cea-b20a-9ae3ca162183 with scrape type 2
2026-03-29 18:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2dca795a-8fe7-5cea-b20a-9ae3ca162183, identifier: UN88738
2026-03-29 18:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fdcbaa4-7735-542e-ab36-ac8d47184bed with identifier: FR18143
2026-03-29 18:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fdcbaa4-7735-542e-ab36-ac8d47184bed with identifier: FR18143
2026-03-29 18:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fdcbaa4-7735-542e-ab36-ac8d47184bed with identifier: FR18143 to the API
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:32:49Z',
'fuel_type': 'diesel',
'id': '8fdcbaa4-7735-542e-ab36-ac8d47184bed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR18143',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 179458,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-28',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Cup 4Motion BlueMotion Tech',
'transmission': 'manual',
'trim': 'Cup 4Motion BlueMotion Tech',
'year': 2014}
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR18143%27 HTTP/1.1" 200 None
2026-03-29 18:32:04 [auto1.de] INFO: Saving data for FR18143: {'auction_closing_time': 1774884769.0, 'created_time': 1773466966.625343, 'last_price_update_time': 1774809124.728894}
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR18143') HTTP/1.1" 204 0
2026-03-29 18:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2dca795a-8fe7-5cea-b20a-9ae3ca162183 with identifier: UN88738
2026-03-29 18:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2dca795a-8fe7-5cea-b20a-9ae3ca162183 with identifier: UN88738
2026-03-29 18:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2dca795a-8fe7-5cea-b20a-9ae3ca162183 with identifier: UN88738 to the API
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:06:01Z',
'fuel_type': 'petrol',
'id': '2dca795a-8fe7-5cea-b20a-9ae3ca162183',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN88738',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 111511,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-08',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN88738%27 HTTP/1.1" 200 None
2026-03-29 18:32:05 [auto1.de] INFO: Saving data for UN88738: {'auction_closing_time': 1774883161.0, 'created_time': 1774118564.743006, 'last_price_update_time': 1774809125.022344}
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN88738') HTTP/1.1" 204 0
2026-03-29 18:32:05 [auto1.de] INFO: Found listing with ID: FP56300
2026-03-29 18:32:05 [auto1.de] INFO: Found listing with ID: WF13702
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF13702%27 HTTP/1.1" 200 None
2026-03-29 18:32:05 [auto1.de] INFO: Scrape type for WF13702: 2
2026-03-29 18:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44b93079-d8ef-514e-b48b-9507cef89d03 with identifier: WF13702
2026-03-29 18:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b93079-d8ef-514e-b48b-9507cef89d03 with scrape type 2
2026-03-29 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44b93079-d8ef-514e-b48b-9507cef89d03 with scrape type 2
2026-03-29 18:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44b93079-d8ef-514e-b48b-9507cef89d03, identifier: WF13702
2026-03-29 18:32:05 [auto1.de] INFO: Found listing with ID: TV18525
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18525%27 HTTP/1.1" 200 None
2026-03-29 18:32:05 [auto1.de] INFO: Scrape type for TV18525: 2
2026-03-29 18:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8fa06fc-7154-5d7b-b482-d82a0a07c22e with identifier: TV18525
2026-03-29 18:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8fa06fc-7154-5d7b-b482-d82a0a07c22e with scrape type 2
2026-03-29 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8fa06fc-7154-5d7b-b482-d82a0a07c22e with scrape type 2
2026-03-29 18:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8fa06fc-7154-5d7b-b482-d82a0a07c22e, identifier: TV18525
2026-03-29 18:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44b93079-d8ef-514e-b48b-9507cef89d03 with identifier: WF13702
2026-03-29 18:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44b93079-d8ef-514e-b48b-9507cef89d03 with identifier: WF13702
2026-03-29 18:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44b93079-d8ef-514e-b48b-9507cef89d03 with identifier: WF13702 to the API
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:30:07Z',
'fuel_type': 'diesel',
'id': '44b93079-d8ef-514e-b48b-9507cef89d03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF13702',
'listing': 'auction',
'make': 'Seat',
'model': 'Altea XL',
'odometer': 306506,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-11-10',
'seller_name': None,
'title': 'Seat Altea XL 1.9 TDI Stylance Style',
'transmission': 'automatic',
'trim': 'Stylance Style',
'year': 2009}
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF13702%27 HTTP/1.1" 200 None
2026-03-29 18:32:05 [auto1.de] INFO: Saving data for WF13702: {'auction_closing_time': 1774884607.0, 'created_time': 1774350240.644642, 'last_price_update_time': 1774809125.547563}
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF13702') HTTP/1.1" 204 0
2026-03-29 18:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8fa06fc-7154-5d7b-b482-d82a0a07c22e with identifier: TV18525
2026-03-29 18:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8fa06fc-7154-5d7b-b482-d82a0a07c22e with identifier: TV18525
2026-03-29 18:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8fa06fc-7154-5d7b-b482-d82a0a07c22e with identifier: TV18525 to the API
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:14:50Z',
'fuel_type': 'petrol',
'id': 'e8fa06fc-7154-5d7b-b482-d82a0a07c22e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV18525',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 126826,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-25',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18525%27 HTTP/1.1" 200 None
2026-03-29 18:32:05 [auto1.de] INFO: Saving data for TV18525: {'auction_closing_time': 1774883690.0, 'created_time': 1774002859.995886, 'last_price_update_time': 1774809125.848024}
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV18525') HTTP/1.1" 204 0
2026-03-29 18:32:05 [auto1.de] INFO: Found listing with ID: DU56840
2026-03-29 18:32:05 [auto1.de] INFO: Found listing with ID: HJ42862
2026-03-29 18:32:05 [auto1.de] INFO: Found listing with ID: HH06006
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06006%27 HTTP/1.1" 200 None
2026-03-29 18:32:05 [auto1.de] INFO: Scrape type for HH06006: 2
2026-03-29 18:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22d76f29-2403-51b3-bd5e-8c363c0b1b1c with identifier: HH06006
2026-03-29 18:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22d76f29-2403-51b3-bd5e-8c363c0b1b1c with scrape type 2
2026-03-29 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22d76f29-2403-51b3-bd5e-8c363c0b1b1c with scrape type 2
2026-03-29 18:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22d76f29-2403-51b3-bd5e-8c363c0b1b1c, identifier: HH06006
2026-03-29 18:32:05 [auto1.de] INFO: Found listing with ID: GB49809
2026-03-29 18:32:05 [auto1.de] INFO: Found listing with ID: LT85175
2026-03-29 18:32:05 [auto1.de] INFO: Found listing with ID: MU81714
2026-03-29 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU81714%27 HTTP/1.1" 200 None
2026-03-29 18:32:06 [auto1.de] INFO: Scrape type for MU81714: 2
2026-03-29 18:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62954f82-d7c0-52a6-9d78-fda0b5da12b5 with identifier: MU81714
2026-03-29 18:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62954f82-d7c0-52a6-9d78-fda0b5da12b5 with scrape type 2
2026-03-29 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62954f82-d7c0-52a6-9d78-fda0b5da12b5 with scrape type 2
2026-03-29 18:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62954f82-d7c0-52a6-9d78-fda0b5da12b5, identifier: MU81714
2026-03-29 18:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22d76f29-2403-51b3-bd5e-8c363c0b1b1c with identifier: HH06006
2026-03-29 18:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22d76f29-2403-51b3-bd5e-8c363c0b1b1c with identifier: HH06006
2026-03-29 18:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22d76f29-2403-51b3-bd5e-8c363c0b1b1c with identifier: HH06006 to the API
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 232,
'expiration_date': '2026-03-30T15:44:23Z',
'fuel_type': 'diesel',
'id': '22d76f29-2403-51b3-bd5e-8c363c0b1b1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH06006',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 276397,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-07-01',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2008}
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06006%27 HTTP/1.1" 200 None
2026-03-29 18:32:06 [auto1.de] INFO: Saving data for HH06006: {'auction_closing_time': 1774885463.0, 'created_time': 1774722657.018182, 'last_price_update_time': 1774809126.389105}
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH06006') HTTP/1.1" 204 0
2026-03-29 18:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62954f82-d7c0-52a6-9d78-fda0b5da12b5 with identifier: MU81714
2026-03-29 18:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62954f82-d7c0-52a6-9d78-fda0b5da12b5 with identifier: MU81714
2026-03-29 18:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62954f82-d7c0-52a6-9d78-fda0b5da12b5 with identifier: MU81714 to the API
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:40:44Z',
'fuel_type': 'petrol',
'id': '62954f82-d7c0-52a6-9d78-fda0b5da12b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU81714',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'up!',
'odometer': 178187,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-29',
'seller_name': None,
'title': 'Volkswagen up! 1.0 High up! BlueMotion Tech',
'transmission': 'manual',
'trim': 'High BlueMotion Tech',
'year': 2012}
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU81714%27 HTTP/1.1" 200 None
2026-03-29 18:32:06 [auto1.de] INFO: Saving data for MU81714: {'auction_closing_time': 1774885244.0, 'created_time': 1773428053.820549, 'last_price_update_time': 1774809126.787833}
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU81714') HTTP/1.1" 204 0
2026-03-29 18:32:06 [auto1.de] INFO: Found listing with ID: LU46217
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU46217%27 HTTP/1.1" 200 None
2026-03-29 18:32:06 [auto1.de] INFO: Scrape type for LU46217: 2
2026-03-29 18:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d079c23d-61ee-5a3b-a0ed-9397f374f6ff with identifier: LU46217
2026-03-29 18:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d079c23d-61ee-5a3b-a0ed-9397f374f6ff with scrape type 2
2026-03-29 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d079c23d-61ee-5a3b-a0ed-9397f374f6ff with scrape type 2
2026-03-29 18:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d079c23d-61ee-5a3b-a0ed-9397f374f6ff, identifier: LU46217
2026-03-29 18:32:06 [auto1.de] INFO: Found listing with ID: ZL07582
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07582%27 HTTP/1.1" 200 None
2026-03-29 18:32:06 [auto1.de] INFO: Scrape type for ZL07582: 2
2026-03-29 18:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43ae2915-fc0e-539c-96a8-52ddba92b5d4 with identifier: ZL07582
2026-03-29 18:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43ae2915-fc0e-539c-96a8-52ddba92b5d4 with scrape type 2
2026-03-29 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43ae2915-fc0e-539c-96a8-52ddba92b5d4 with scrape type 2
2026-03-29 18:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43ae2915-fc0e-539c-96a8-52ddba92b5d4, identifier: ZL07582
2026-03-29 18:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:32:07 [scrapy.extensions.logstats] INFO: Crawled 33 pages (at 5 pages/min), scraped 67 items (at 52 items/min)
2026-03-29 18:32:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d079c23d-61ee-5a3b-a0ed-9397f374f6ff with identifier: LU46217
2026-03-29 18:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d079c23d-61ee-5a3b-a0ed-9397f374f6ff with identifier: LU46217
2026-03-29 18:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d079c23d-61ee-5a3b-a0ed-9397f374f6ff with identifier: LU46217 to the API
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:17:08Z',
'fuel_type': 'petrol',
'id': 'd079c23d-61ee-5a3b-a0ed-9397f374f6ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU46217',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 92255,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-23',
'seller_name': None,
'title': 'BMW 1er 118i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2020}
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU46217%27 HTTP/1.1" 200 None
2026-03-29 18:32:07 [auto1.de] INFO: Saving data for LU46217: {'auction_closing_time': 1774883828.0, 'created_time': 1774033351.188739, 'last_price_update_time': 1774809127.310165}
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU46217') HTTP/1.1" 204 0
2026-03-29 18:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43ae2915-fc0e-539c-96a8-52ddba92b5d4 with identifier: ZL07582
2026-03-29 18:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43ae2915-fc0e-539c-96a8-52ddba92b5d4 with identifier: ZL07582
2026-03-29 18:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43ae2915-fc0e-539c-96a8-52ddba92b5d4 with identifier: ZL07582 to the API
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:43:55Z',
'fuel_type': 'diesel',
'id': '43ae2915-fc0e-539c-96a8-52ddba92b5d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL07582',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 73351,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-02',
'seller_name': None,
'title': 'BMW 5er 530d',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07582%27 HTTP/1.1" 200 None
2026-03-29 18:32:07 [auto1.de] INFO: Saving data for ZL07582: {'auction_closing_time': 1774885435.0, 'created_time': 1774722687.43065, 'last_price_update_time': 1774809127.648443}
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL07582') HTTP/1.1" 204 0
2026-03-29 18:32:07 [auto1.de] INFO: Found listing with ID: NC63257
2026-03-29 18:32:07 [auto1.de] INFO: Found listing with ID: HA49497
2026-03-29 18:32:07 [auto1.de] INFO: Found listing with ID: GN25688
2026-03-29 18:32:07 [auto1.de] INFO: Found listing with ID: PW12377
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12377%27 HTTP/1.1" 200 None
2026-03-29 18:32:07 [auto1.de] INFO: Scrape type for PW12377: 2
2026-03-29 18:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a48d21-41c3-5ba1-88fd-6e0b1f690b64 with identifier: PW12377
2026-03-29 18:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a48d21-41c3-5ba1-88fd-6e0b1f690b64 with scrape type 2
2026-03-29 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40a48d21-41c3-5ba1-88fd-6e0b1f690b64 with scrape type 2
2026-03-29 18:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40a48d21-41c3-5ba1-88fd-6e0b1f690b64, identifier: PW12377
2026-03-29 18:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40a48d21-41c3-5ba1-88fd-6e0b1f690b64 with identifier: PW12377
2026-03-29 18:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40a48d21-41c3-5ba1-88fd-6e0b1f690b64 with identifier: PW12377
2026-03-29 18:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40a48d21-41c3-5ba1-88fd-6e0b1f690b64 with identifier: PW12377 to the API
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:23:26Z',
'fuel_type': 'petrol',
'id': '40a48d21-41c3-5ba1-88fd-6e0b1f690b64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW12377',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 145891,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-02-14',
'seller_name': None,
'title': 'Toyota Aygo 1.0 VIP',
'transmission': 'manual',
'trim': 'VIP',
'year': 2008}
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12377%27 HTTP/1.1" 200 None
2026-03-29 18:32:08 [auto1.de] INFO: Saving data for PW12377: {'auction_closing_time': 1774884206.0, 'created_time': 1774032873.022406, 'last_price_update_time': 1774809128.070141}
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW12377') HTTP/1.1" 204 0
2026-03-29 18:32:08 [auto1.de] INFO: Found listing with ID: RD52099
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD52099%27 HTTP/1.1" 200 None
2026-03-29 18:32:08 [auto1.de] INFO: Scrape type for RD52099: 2
2026-03-29 18:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14753852-bd0d-5025-ad91-e6700e98bfe7 with identifier: RD52099
2026-03-29 18:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14753852-bd0d-5025-ad91-e6700e98bfe7 with scrape type 2
2026-03-29 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14753852-bd0d-5025-ad91-e6700e98bfe7 with scrape type 2
2026-03-29 18:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14753852-bd0d-5025-ad91-e6700e98bfe7, identifier: RD52099
2026-03-29 18:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14753852-bd0d-5025-ad91-e6700e98bfe7 with identifier: RD52099
2026-03-29 18:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14753852-bd0d-5025-ad91-e6700e98bfe7 with identifier: RD52099
2026-03-29 18:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14753852-bd0d-5025-ad91-e6700e98bfe7 with identifier: RD52099 to the API
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:40:33Z',
'fuel_type': 'petrol',
'id': '14753852-bd0d-5025-ad91-e6700e98bfe7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD52099',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 99970,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-26',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2017}
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD52099%27 HTTP/1.1" 200 None
2026-03-29 18:32:08 [auto1.de] INFO: Saving data for RD52099: {'auction_closing_time': 1774885233.0, 'created_time': 1773991277.021232, 'last_price_update_time': 1774809128.471037}
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD52099') HTTP/1.1" 204 0
2026-03-29 18:32:08 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 6740 | hits on page: 40
2026-03-29 18:32:08 [auto1.de] INFO: Found listing with ID: LX33649
2026-03-29 18:32:08 [auto1.de] INFO: Found listing with ID: CX30934
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX30934%27 HTTP/1.1" 200 None
2026-03-29 18:32:08 [auto1.de] INFO: Scrape type for CX30934: 2
2026-03-29 18:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c357b78-d2a5-52e8-aa9a-74aab652f31b with identifier: CX30934
2026-03-29 18:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c357b78-d2a5-52e8-aa9a-74aab652f31b with scrape type 2
2026-03-29 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c357b78-d2a5-52e8-aa9a-74aab652f31b with scrape type 2
2026-03-29 18:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c357b78-d2a5-52e8-aa9a-74aab652f31b, identifier: CX30934
2026-03-29 18:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c357b78-d2a5-52e8-aa9a-74aab652f31b with identifier: CX30934
2026-03-29 18:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c357b78-d2a5-52e8-aa9a-74aab652f31b with identifier: CX30934
2026-03-29 18:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c357b78-d2a5-52e8-aa9a-74aab652f31b with identifier: CX30934 to the API
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:44:02Z',
'fuel_type': 'diesel',
'id': '8c357b78-d2a5-52e8-aa9a-74aab652f31b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX30934',
'listing': 'auction',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 43367,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-27',
'seller_name': None,
'title': 'Skoda Karoq 2.0 TDI Tour',
'transmission': 'manual',
'trim': 'Tour',
'year': 2023}
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX30934%27 HTTP/1.1" 200 None
2026-03-29 18:32:08 [auto1.de] INFO: Saving data for CX30934: {'auction_closing_time': 1774885442.0, 'created_time': 1774033674.262523, 'last_price_update_time': 1774809128.887541}
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX30934') HTTP/1.1" 204 0
2026-03-29 18:32:08 [auto1.de] INFO: Found listing with ID: ZM46839
2026-03-29 18:32:08 [auto1.de] INFO: Found listing with ID: PL16151
2026-03-29 18:32:08 [auto1.de] INFO: Found listing with ID: GT44390
2026-03-29 18:32:08 [auto1.de] INFO: Found listing with ID: NK02034
2026-03-29 18:32:08 [auto1.de] INFO: Found listing with ID: RR54011
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR54011%27 HTTP/1.1" 200 None
2026-03-29 18:32:08 [auto1.de] INFO: Scrape type for RR54011: 2
2026-03-29 18:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24f449cc-28c3-5eeb-9815-0d135e2a4107 with identifier: RR54011
2026-03-29 18:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24f449cc-28c3-5eeb-9815-0d135e2a4107 with scrape type 2
2026-03-29 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24f449cc-28c3-5eeb-9815-0d135e2a4107 with scrape type 2
2026-03-29 18:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24f449cc-28c3-5eeb-9815-0d135e2a4107, identifier: RR54011
2026-03-29 18:32:09 [auto1.de] INFO: Found listing with ID: KT37105
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT37105%27 HTTP/1.1" 200 None
2026-03-29 18:32:09 [auto1.de] INFO: Scrape type for KT37105: 2
2026-03-29 18:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 227e7c38-322d-55ee-81c5-5bea705ebc49 with identifier: KT37105
2026-03-29 18:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 227e7c38-322d-55ee-81c5-5bea705ebc49 with scrape type 2
2026-03-29 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 227e7c38-322d-55ee-81c5-5bea705ebc49 with scrape type 2
2026-03-29 18:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 227e7c38-322d-55ee-81c5-5bea705ebc49, identifier: KT37105
2026-03-29 18:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24f449cc-28c3-5eeb-9815-0d135e2a4107 with identifier: RR54011
2026-03-29 18:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24f449cc-28c3-5eeb-9815-0d135e2a4107 with identifier: RR54011
2026-03-29 18:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24f449cc-28c3-5eeb-9815-0d135e2a4107 with identifier: RR54011 to the API
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:48:05Z',
'fuel_type': 'petrol',
'id': '24f449cc-28c3-5eeb-9815-0d135e2a4107',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR54011',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 31735,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-04-21',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2020}
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR54011%27 HTTP/1.1" 200 None
2026-03-29 18:32:09 [auto1.de] INFO: Saving data for RR54011: {'auction_closing_time': 1774885685.0, 'created_time': 1774033521.248038, 'last_price_update_time': 1774809129.446583}
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR54011') HTTP/1.1" 204 0
2026-03-29 18:32:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 227e7c38-322d-55ee-81c5-5bea705ebc49 with identifier: KT37105
2026-03-29 18:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 227e7c38-322d-55ee-81c5-5bea705ebc49 with identifier: KT37105
2026-03-29 18:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 227e7c38-322d-55ee-81c5-5bea705ebc49 with identifier: KT37105 to the API
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:23:34Z',
'fuel_type': 'petrol',
'id': '227e7c38-322d-55ee-81c5-5bea705ebc49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT37105',
'listing': 'auction',
'make': 'MINI',
'model': 'Coupe',
'odometer': 147911,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-30',
'seller_name': None,
'title': 'MINI Coupe Cooper S',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT37105%27 HTTP/1.1" 200 None
2026-03-29 18:32:09 [auto1.de] INFO: Saving data for KT37105: {'auction_closing_time': 1774884214.0, 'created_time': 1774033519.517306, 'last_price_update_time': 1774809129.836548}
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT37105') HTTP/1.1" 204 0
2026-03-29 18:32:09 [auto1.de] INFO: Found listing with ID: PN39432
2026-03-29 18:32:09 [auto1.de] INFO: Found listing with ID: XB31619
2026-03-29 18:32:09 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL12737%27 HTTP/1.1" 200 None
2026-03-29 18:32:09 [auto1.de] INFO: Scrape type for JL12737: 2
2026-03-29 18:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8cee521-5ad3-55fb-8975-6c4b63651cf6 with identifier: JL12737
2026-03-29 18:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8cee521-5ad3-55fb-8975-6c4b63651cf6 with scrape type 2
2026-03-29 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8cee521-5ad3-55fb-8975-6c4b63651cf6 with scrape type 2
2026-03-29 18:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8cee521-5ad3-55fb-8975-6c4b63651cf6, identifier: JL12737
2026-03-29 18:32:09 [auto1.de] INFO: Found listing with ID: NT69326
2026-03-29 18:32:09 [auto1.de] INFO: Found listing with ID: MP45750
2026-03-29 18:32:09 [auto1.de] INFO: Found listing with ID: BS14329
2026-03-29 18:32:09 [auto1.de] INFO: Found listing with ID: HW62804
2026-03-29 18:32:09 [auto1.de] INFO: Found listing with ID: BS91998
2026-03-29 18:32:09 [auto1.de] INFO: Found listing with ID: WW27591
2026-03-29 18:32:09 [auto1.de] INFO: Found listing with ID: SS07399
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS07399%27 HTTP/1.1" 200 None
2026-03-29 18:32:09 [auto1.de] INFO: Scrape type for SS07399: 2
2026-03-29 18:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fd68b71-2ea2-5c6f-8fad-2c670f202197 with identifier: SS07399
2026-03-29 18:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fd68b71-2ea2-5c6f-8fad-2c670f202197 with scrape type 2
2026-03-29 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fd68b71-2ea2-5c6f-8fad-2c670f202197 with scrape type 2
2026-03-29 18:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fd68b71-2ea2-5c6f-8fad-2c670f202197, identifier: SS07399
2026-03-29 18:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8cee521-5ad3-55fb-8975-6c4b63651cf6 with identifier: JL12737
2026-03-29 18:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8cee521-5ad3-55fb-8975-6c4b63651cf6 with identifier: JL12737
2026-03-29 18:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8cee521-5ad3-55fb-8975-6c4b63651cf6 with identifier: JL12737 to the API
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:34:04Z',
'fuel_type': 'hybrid',
'id': 'c8cee521-5ad3-55fb-8975-6c4b63651cf6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL12737',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 68914,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-09',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 250e Shooting Brake Edition 2020 AMG '
'Line',
'transmission': 'automatic',
'trim': 'Edition 2020 AMG Line',
'year': 2021}
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL12737%27 HTTP/1.1" 200 None
2026-03-29 18:32:10 [auto1.de] INFO: Saving data for JL12737: {'auction_closing_time': 1774884844.0, 'created_time': 1774607693.391996, 'last_price_update_time': 1774809130.388895}
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL12737') HTTP/1.1" 204 0
2026-03-29 18:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fd68b71-2ea2-5c6f-8fad-2c670f202197 with identifier: SS07399
2026-03-29 18:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fd68b71-2ea2-5c6f-8fad-2c670f202197 with identifier: SS07399
2026-03-29 18:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fd68b71-2ea2-5c6f-8fad-2c670f202197 with identifier: SS07399 to the API
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:54:22Z',
'fuel_type': 'diesel',
'id': '5fd68b71-2ea2-5c6f-8fad-2c670f202197',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS07399',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 143952,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-01',
'seller_name': None,
'title': 'Opel Zafira Tourer 2.0 CDTI Active Start/Stop',
'transmission': 'manual',
'trim': 'Active Start/Stop',
'year': 2016}
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS07399%27 HTTP/1.1" 200 None
2026-03-29 18:32:10 [auto1.de] INFO: Saving data for SS07399: {'auction_closing_time': 1774886062.0, 'created_time': 1774118481.136479, 'last_price_update_time': 1774809130.695116}
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS07399') HTTP/1.1" 204 0
2026-03-29 18:32:10 [auto1.de] INFO: Found listing with ID: YA55481
2026-03-29 18:32:10 [auto1.de] INFO: Found listing with ID: KP96972
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP96972%27 HTTP/1.1" 200 None
2026-03-29 18:32:10 [auto1.de] INFO: Scrape type for KP96972: 2
2026-03-29 18:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e85f3df2-540f-5ab9-a951-e5f607d325ae with identifier: KP96972
2026-03-29 18:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e85f3df2-540f-5ab9-a951-e5f607d325ae with scrape type 2
2026-03-29 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e85f3df2-540f-5ab9-a951-e5f607d325ae with scrape type 2
2026-03-29 18:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e85f3df2-540f-5ab9-a951-e5f607d325ae, identifier: KP96972
2026-03-29 18:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e85f3df2-540f-5ab9-a951-e5f607d325ae with identifier: KP96972
2026-03-29 18:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e85f3df2-540f-5ab9-a951-e5f607d325ae with identifier: KP96972
2026-03-29 18:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e85f3df2-540f-5ab9-a951-e5f607d325ae with identifier: KP96972 to the API
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:35:52Z',
'fuel_type': 'diesel',
'id': 'e85f3df2-540f-5ab9-a951-e5f607d325ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP96972',
'listing': 'auction',
'make': 'Citroen',
'model': 'C5',
'odometer': 269532,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-09',
'seller_name': None,
'title': 'Citroen C5 2.0 HDi',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP96972%27 HTTP/1.1" 200 None
2026-03-29 18:32:11 [auto1.de] INFO: Saving data for KP96972: {'auction_closing_time': 1774884952.0, 'created_time': 1774033447.879681, 'last_price_update_time': 1774809131.095401}
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP96972') HTTP/1.1" 204 0
2026-03-29 18:32:11 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW59624%27 HTTP/1.1" 200 None
2026-03-29 18:32:11 [auto1.de] INFO: Scrape type for YW59624: 2
2026-03-29 18:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with identifier: YW59624
2026-03-29 18:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with scrape type 2
2026-03-29 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with scrape type 2
2026-03-29 18:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5, identifier: YW59624
2026-03-29 18:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with identifier: YW59624
2026-03-29 18:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with identifier: YW59624
2026-03-29 18:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with identifier: YW59624 to the API
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:31:46Z',
'fuel_type': 'diesel',
'id': '3b0691bd-ee90-5b91-b7ad-c61d5361e0a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW59624',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 127313,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-23',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2017}
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW59624%27 HTTP/1.1" 200 None
2026-03-29 18:32:11 [auto1.de] INFO: Saving data for YW59624: {'auction_closing_time': 1774884706.0, 'created_time': 1773305608.460951, 'last_price_update_time': 1774809131.656853}
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW59624') HTTP/1.1" 204 0
2026-03-29 18:32:11 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46079%27 HTTP/1.1" 200 None
2026-03-29 18:32:11 [auto1.de] INFO: Scrape type for VV46079: 0
2026-03-29 18:32:11 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-29 18:32:11 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM69365%27 HTTP/1.1" 200 None
2026-03-29 18:32:11 [auto1.de] INFO: Scrape type for AM69365: 0
2026-03-29 18:32:11 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-29 18:32:11 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-29 18:32:11 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68514%27 HTTP/1.1" 200 None
2026-03-29 18:32:11 [auto1.de] INFO: Scrape type for NX68514: 2
2026-03-29 18:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with identifier: NX68514
2026-03-29 18:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with scrape type 2
2026-03-29 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with scrape type 2
2026-03-29 18:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08303f5a-9d5c-54bd-868a-4b73e8e897c7, identifier: NX68514
2026-03-29 18:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with identifier: NX68514
2026-03-29 18:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with identifier: NX68514
2026-03-29 18:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with identifier: NX68514 to the API
2026-03-29 18:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:34:42Z',
'fuel_type': 'petrol',
'id': '08303f5a-9d5c-54bd-868a-4b73e8e897c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX68514',
'listing': 'auction',
'make': 'Kia',
'model': "pro_cee'd",
'odometer': 50454,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-02',
'seller_name': None,
'title': "Kia pro_cee'd 1.6 TGDI GT",
'transmission': 'automatic',
'trim': 'GT',
'year': 2022}
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68514%27 HTTP/1.1" 200 None
2026-03-29 18:32:12 [auto1.de] INFO: Saving data for NX68514: {'auction_closing_time': 1774884882.0, 'created_time': 1774294279.71042, 'last_price_update_time': 1774809132.141275}
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX68514') HTTP/1.1" 204 0
2026-03-29 18:32:12 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-29 18:32:12 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW75956%27 HTTP/1.1" 200 None
2026-03-29 18:32:12 [auto1.de] INFO: Scrape type for DW75956: 2
2026-03-29 18:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a090868e-41c7-51ba-ab0d-3328efc78207 with identifier: DW75956
2026-03-29 18:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a090868e-41c7-51ba-ab0d-3328efc78207 with scrape type 2
2026-03-29 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a090868e-41c7-51ba-ab0d-3328efc78207 with scrape type 2
2026-03-29 18:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a090868e-41c7-51ba-ab0d-3328efc78207, identifier: DW75956
2026-03-29 18:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a090868e-41c7-51ba-ab0d-3328efc78207 with identifier: DW75956
2026-03-29 18:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a090868e-41c7-51ba-ab0d-3328efc78207 with identifier: DW75956
2026-03-29 18:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a090868e-41c7-51ba-ab0d-3328efc78207 with identifier: DW75956 to the API
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:45:51Z',
'fuel_type': 'diesel',
'id': 'a090868e-41c7-51ba-ab0d-3328efc78207',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW75956',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 138817,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-01',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2016}
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW75956%27 HTTP/1.1" 200 None
2026-03-29 18:32:12 [auto1.de] INFO: Saving data for DW75956: {'auction_closing_time': 1774885551.0, 'created_time': 1773226019.331426, 'last_price_update_time': 1774809132.65394}
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW75956') HTTP/1.1" 204 0
2026-03-29 18:32:12 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS69815%27 HTTP/1.1" 200 None
2026-03-29 18:32:12 [auto1.de] INFO: Scrape type for DS69815: 0
2026-03-29 18:32:12 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR05539%27 HTTP/1.1" 200 None
2026-03-29 18:32:12 [auto1.de] INFO: Scrape type for AR05539: 2
2026-03-29 18:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02753508-7a13-5340-8199-ecb2445c458c with identifier: AR05539
2026-03-29 18:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02753508-7a13-5340-8199-ecb2445c458c with scrape type 2
2026-03-29 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02753508-7a13-5340-8199-ecb2445c458c with scrape type 2
2026-03-29 18:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02753508-7a13-5340-8199-ecb2445c458c, identifier: AR05539
2026-03-29 18:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02753508-7a13-5340-8199-ecb2445c458c with identifier: AR05539
2026-03-29 18:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02753508-7a13-5340-8199-ecb2445c458c with identifier: AR05539
2026-03-29 18:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02753508-7a13-5340-8199-ecb2445c458c with identifier: AR05539 to the API
2026-03-29 18:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:45:51Z',
'fuel_type': 'petrol',
'id': '02753508-7a13-5340-8199-ecb2445c458c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR05539',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 105365,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-14',
'seller_name': None,
'title': 'Dacia Duster 1.2 TCe Laureate 4x2',
'transmission': 'manual',
'trim': 'Laureate 4x2',
'year': 2015}
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR05539%27 HTTP/1.1" 200 None
2026-03-29 18:32:13 [auto1.de] INFO: Saving data for AR05539: {'auction_closing_time': 1774885551.0, 'created_time': 1773646299.143922, 'last_price_update_time': 1774809133.142952}
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR05539') HTTP/1.1" 204 0
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS08469%27 HTTP/1.1" 200 None
2026-03-29 18:32:13 [auto1.de] INFO: Scrape type for GS08469: 0
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR19321%27 HTTP/1.1" 200 None
2026-03-29 18:32:13 [auto1.de] INFO: Scrape type for FR19321: 0
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB74234%27 HTTP/1.1" 200 None
2026-03-29 18:32:13 [auto1.de] INFO: Scrape type for XB74234: 0
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF63689%27 HTTP/1.1" 200 None
2026-03-29 18:32:13 [auto1.de] INFO: Scrape type for TF63689: 2
2026-03-29 18:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34194588-12f6-54d3-ae6f-f5170e716e17 with identifier: TF63689
2026-03-29 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34194588-12f6-54d3-ae6f-f5170e716e17 with scrape type 2
2026-03-29 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34194588-12f6-54d3-ae6f-f5170e716e17 with scrape type 2
2026-03-29 18:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34194588-12f6-54d3-ae6f-f5170e716e17, identifier: TF63689
2026-03-29 18:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34194588-12f6-54d3-ae6f-f5170e716e17 with identifier: TF63689
2026-03-29 18:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34194588-12f6-54d3-ae6f-f5170e716e17 with identifier: TF63689
2026-03-29 18:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34194588-12f6-54d3-ae6f-f5170e716e17 with identifier: TF63689 to the API
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:55:38Z',
'fuel_type': 'petrol',
'id': '34194588-12f6-54d3-ae6f-f5170e716e17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF63689',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 147337,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-06',
'seller_name': None,
'title': 'BMW 3er 328i xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2014}
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF63689%27 HTTP/1.1" 200 None
2026-03-29 18:32:13 [auto1.de] INFO: Saving data for TF63689: {'auction_closing_time': 1774886138.0, 'created_time': 1774291997.535388, 'last_price_update_time': 1774809133.826669}
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF63689') HTTP/1.1" 204 0
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD16858%27 HTTP/1.1" 200 None
2026-03-29 18:32:13 [auto1.de] INFO: Scrape type for BD16858: 0
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG72840%27 HTTP/1.1" 200 None
2026-03-29 18:32:13 [auto1.de] INFO: Scrape type for VG72840: 0
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: BM86036
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12579%27 HTTP/1.1" 200 None
2026-03-29 18:32:13 [auto1.de] INFO: Scrape type for YD12579: 0
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH12936%27 HTTP/1.1" 200 None
2026-03-29 18:32:13 [auto1.de] INFO: Scrape type for KH12936: 0
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU91903%27 HTTP/1.1" 200 None
2026-03-29 18:32:13 [auto1.de] INFO: Scrape type for NU91903: 0
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG33917%27 HTTP/1.1" 200 None
2026-03-29 18:32:13 [auto1.de] INFO: Scrape type for KG33917: 0
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-29 18:32:13 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE44691%27 HTTP/1.1" 200 None
2026-03-29 18:32:13 [auto1.de] INFO: Scrape type for BE44691: 2
2026-03-29 18:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe0432bc-4c9b-536f-b039-9859227085e4 with identifier: BE44691
2026-03-29 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0432bc-4c9b-536f-b039-9859227085e4 with scrape type 2
2026-03-29 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe0432bc-4c9b-536f-b039-9859227085e4 with scrape type 2
2026-03-29 18:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe0432bc-4c9b-536f-b039-9859227085e4, identifier: BE44691
2026-03-29 18:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe0432bc-4c9b-536f-b039-9859227085e4 with identifier: BE44691
2026-03-29 18:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe0432bc-4c9b-536f-b039-9859227085e4 with identifier: BE44691
2026-03-29 18:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe0432bc-4c9b-536f-b039-9859227085e4 with identifier: BE44691 to the API
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:48:45Z',
'fuel_type': 'petrol',
'id': 'fe0432bc-4c9b-536f-b039-9859227085e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE44691',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 99478,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-11',
'seller_name': None,
'title': 'Ford C-Max 1.5 EcoBoost Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2016}
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE44691%27 HTTP/1.1" 200 None
2026-03-29 18:32:14 [auto1.de] INFO: Saving data for BE44691: {'auction_closing_time': 1774885725.0, 'created_time': 1774607651.424672, 'last_price_update_time': 1774809134.439389}
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE44691') HTTP/1.1" 204 0
2026-03-29 18:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:32:14 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-29 18:32:14 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK29983%27 HTTP/1.1" 200 None
2026-03-29 18:32:14 [auto1.de] INFO: Scrape type for ZK29983: 2
2026-03-29 18:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b56d7da3-1124-502e-a445-776e1972682b with identifier: ZK29983
2026-03-29 18:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b56d7da3-1124-502e-a445-776e1972682b with scrape type 2
2026-03-29 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b56d7da3-1124-502e-a445-776e1972682b with scrape type 2
2026-03-29 18:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b56d7da3-1124-502e-a445-776e1972682b, identifier: ZK29983
2026-03-29 18:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b56d7da3-1124-502e-a445-776e1972682b with identifier: ZK29983
2026-03-29 18:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b56d7da3-1124-502e-a445-776e1972682b with identifier: ZK29983
2026-03-29 18:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b56d7da3-1124-502e-a445-776e1972682b with identifier: ZK29983 to the API
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:46:56Z',
'fuel_type': 'petrol',
'id': 'b56d7da3-1124-502e-a445-776e1972682b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK29983',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Ignis',
'odometer': 13388,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-09',
'seller_name': None,
'title': 'Suzuki Ignis 1.2 DualJet SHVS Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2019}
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK29983%27 HTTP/1.1" 200 None
2026-03-29 18:32:14 [auto1.de] INFO: Saving data for ZK29983: {'auction_closing_time': 1774885616.0, 'created_time': 1773830242.570589, 'last_price_update_time': 1774809134.94141}
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK29983') HTTP/1.1" 204 0
2026-03-29 18:32:14 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR18568%27 HTTP/1.1" 200 None
2026-03-29 18:32:14 [auto1.de] INFO: Scrape type for AR18568: 0
2026-03-29 18:32:14 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 6740 | hits on page: 40
2026-03-29 18:32:14 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-29 18:32:14 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC63717%27 HTTP/1.1" 200 None
2026-03-29 18:32:14 [auto1.de] INFO: Scrape type for FC63717: 2
2026-03-29 18:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4202cc82-8783-587b-94f3-5bf44f83d80a with identifier: FC63717
2026-03-29 18:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4202cc82-8783-587b-94f3-5bf44f83d80a with scrape type 2
2026-03-29 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4202cc82-8783-587b-94f3-5bf44f83d80a with scrape type 2
2026-03-29 18:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4202cc82-8783-587b-94f3-5bf44f83d80a, identifier: FC63717
2026-03-29 18:32:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4202cc82-8783-587b-94f3-5bf44f83d80a with identifier: FC63717
2026-03-29 18:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4202cc82-8783-587b-94f3-5bf44f83d80a with identifier: FC63717
2026-03-29 18:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4202cc82-8783-587b-94f3-5bf44f83d80a with identifier: FC63717 to the API
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:22:37Z',
'fuel_type': 'petrol',
'id': '4202cc82-8783-587b-94f3-5bf44f83d80a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC63717',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 193879,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-05-02',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 280 T Elegance',
'transmission': 'automatic',
'trim': 'T Elegance',
'year': 2007}
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC63717%27 HTTP/1.1" 200 None
2026-03-29 18:32:15 [auto1.de] INFO: Saving data for FC63717: {'auction_closing_time': 1774884157.0, 'created_time': 1773400373.320799, 'last_price_update_time': 1774809135.450922}
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC63717') HTTP/1.1" 204 0
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF63409%27 HTTP/1.1" 200 None
2026-03-29 18:32:15 [auto1.de] INFO: Scrape type for YF63409: 0
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ82398%27 HTTP/1.1" 200 None
2026-03-29 18:32:15 [auto1.de] INFO: Scrape type for JJ82398: 0
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT58980%27 HTTP/1.1" 200 None
2026-03-29 18:32:15 [auto1.de] INFO: Scrape type for KT58980: 0
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF69032%27 HTTP/1.1" 200 None
2026-03-29 18:32:15 [auto1.de] INFO: Scrape type for JF69032: 0
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80660%27 HTTP/1.1" 200 None
2026-03-29 18:32:15 [auto1.de] INFO: Scrape type for UP80660: 0
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV17039%27 HTTP/1.1" 200 None
2026-03-29 18:32:15 [auto1.de] INFO: Scrape type for VV17039: 0
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-29 18:32:15 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49821%27 HTTP/1.1" 200 None
2026-03-29 18:32:15 [auto1.de] INFO: Scrape type for TU49821: 2
2026-03-29 18:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4c1b93f-5b90-55e1-a318-40937b4c67bc with identifier: TU49821
2026-03-29 18:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4c1b93f-5b90-55e1-a318-40937b4c67bc with scrape type 2
2026-03-29 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4c1b93f-5b90-55e1-a318-40937b4c67bc with scrape type 2
2026-03-29 18:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4c1b93f-5b90-55e1-a318-40937b4c67bc, identifier: TU49821
2026-03-29 18:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4c1b93f-5b90-55e1-a318-40937b4c67bc with identifier: TU49821
2026-03-29 18:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4c1b93f-5b90-55e1-a318-40937b4c67bc with identifier: TU49821
2026-03-29 18:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4c1b93f-5b90-55e1-a318-40937b4c67bc with identifier: TU49821 to the API
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-30T15:24:46Z',
'fuel_type': 'petrol',
'id': 'd4c1b93f-5b90-55e1-a318-40937b4c67bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU49821',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'ASX',
'odometer': 81645,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-25',
'seller_name': None,
'title': 'Mitsubishi ASX 1.6 Basis 2WD',
'transmission': 'manual',
'trim': 'Basis 2WD',
'year': 2018}
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49821%27 HTTP/1.1" 200 None
2026-03-29 18:32:15 [auto1.de] INFO: Saving data for TU49821: {'auction_closing_time': 1774884286.0, 'created_time': 1774607850.033683, 'last_price_update_time': 1774809135.989745}
2026-03-29 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU49821') HTTP/1.1" 204 0
2026-03-29 18:32:16 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-29 18:32:16 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-29 18:32:16 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-29 18:32:16 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-29 18:32:16 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-29 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94674%27 HTTP/1.1" 200 None
2026-03-29 18:32:16 [auto1.de] INFO: Scrape type for BK94674: 2
2026-03-29 18:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 198b82d6-c514-566b-92a6-0e5d2dc209e3 with identifier: BK94674
2026-03-29 18:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 198b82d6-c514-566b-92a6-0e5d2dc209e3 with scrape type 2
2026-03-29 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 198b82d6-c514-566b-92a6-0e5d2dc209e3 with scrape type 2
2026-03-29 18:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 198b82d6-c514-566b-92a6-0e5d2dc209e3, identifier: BK94674
2026-03-29 18:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 198b82d6-c514-566b-92a6-0e5d2dc209e3 with identifier: BK94674
2026-03-29 18:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 198b82d6-c514-566b-92a6-0e5d2dc209e3 with identifier: BK94674
2026-03-29 18:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 198b82d6-c514-566b-92a6-0e5d2dc209e3 with identifier: BK94674 to the API
2026-03-29 18:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:44:25Z',
'fuel_type': 'diesel',
'id': '198b82d6-c514-566b-92a6-0e5d2dc209e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK94674',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 154701,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-07',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line 2WD',
'transmission': 'manual',
'trim': 'Exclusive-Line 2WD',
'year': 2016}
2026-03-29 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94674%27 HTTP/1.1" 200 None
2026-03-29 18:32:16 [auto1.de] INFO: Saving data for BK94674: {'auction_closing_time': 1774885465.0, 'created_time': 1773307443.015212, 'last_price_update_time': 1774809136.55473}
2026-03-29 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK94674') HTTP/1.1" 204 0
2026-03-29 18:32:16 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-29 18:32:16 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-29 18:32:16 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-29 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-29 18:32:16 [auto1.de] INFO: Scrape type for JL44277: 2
2026-03-29 18:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19f22e8c-2112-5084-a9a8-ad17ff597449 with identifier: JL44277
2026-03-29 18:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19f22e8c-2112-5084-a9a8-ad17ff597449 with scrape type 2
2026-03-29 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19f22e8c-2112-5084-a9a8-ad17ff597449 with scrape type 2
2026-03-29 18:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19f22e8c-2112-5084-a9a8-ad17ff597449, identifier: JL44277
2026-03-29 18:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19f22e8c-2112-5084-a9a8-ad17ff597449 with identifier: JL44277
2026-03-29 18:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19f22e8c-2112-5084-a9a8-ad17ff597449 with identifier: JL44277
2026-03-29 18:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19f22e8c-2112-5084-a9a8-ad17ff597449 with identifier: JL44277 to the API
2026-03-29 18:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 380,
'expiration_date': '2026-03-30T15:20:39Z',
'fuel_type': 'petrol',
'id': '19f22e8c-2112-5084-a9a8-ad17ff597449',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL44277',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 102170,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-26',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 45 Shooting Brake AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2018}
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-29 18:32:17 [auto1.de] INFO: Saving data for JL44277: {'auction_closing_time': 1774884039.0, 'created_time': 1773400272.865453, 'last_price_update_time': 1774809137.031963}
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL44277') HTTP/1.1" 204 0
2026-03-29 18:32:17 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE51939%27 HTTP/1.1" 200 None
2026-03-29 18:32:17 [auto1.de] INFO: Scrape type for JE51939: 0
2026-03-29 18:32:17 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS86297%27 HTTP/1.1" 200 None
2026-03-29 18:32:17 [auto1.de] INFO: Scrape type for AS86297: 0
2026-03-29 18:32:17 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-29 18:32:17 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR11100%27 HTTP/1.1" 200 None
2026-03-29 18:32:17 [auto1.de] INFO: Scrape type for CR11100: 2
2026-03-29 18:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fd1872c-6273-5317-b4bf-3c69666c1e1a with identifier: CR11100
2026-03-29 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fd1872c-6273-5317-b4bf-3c69666c1e1a with scrape type 2
2026-03-29 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fd1872c-6273-5317-b4bf-3c69666c1e1a with scrape type 2
2026-03-29 18:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fd1872c-6273-5317-b4bf-3c69666c1e1a, identifier: CR11100
2026-03-29 18:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fd1872c-6273-5317-b4bf-3c69666c1e1a with identifier: CR11100
2026-03-29 18:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fd1872c-6273-5317-b4bf-3c69666c1e1a with identifier: CR11100
2026-03-29 18:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fd1872c-6273-5317-b4bf-3c69666c1e1a with identifier: CR11100 to the API
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:06:30Z',
'fuel_type': 'diesel',
'id': '1fd1872c-6273-5317-b4bf-3c69666c1e1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR11100',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 222827,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-08',
'seller_name': None,
'title': "Kia cee'd 1.6 CRDi GT Line",
'transmission': 'manual',
'trim': 'GT Line',
'year': 2016}
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR11100%27 HTTP/1.1" 200 None
2026-03-29 18:32:17 [auto1.de] INFO: Saving data for CR11100: {'auction_closing_time': 1774883190.0, 'created_time': 1773303513.283578, 'last_price_update_time': 1774809137.548212}
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR11100') HTTP/1.1" 204 0
2026-03-29 18:32:17 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN56158%27 HTTP/1.1" 200 None
2026-03-29 18:32:17 [auto1.de] INFO: Scrape type for WN56158: 2
2026-03-29 18:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 137851de-c891-5724-8b0d-4135704ffe21 with identifier: WN56158
2026-03-29 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 137851de-c891-5724-8b0d-4135704ffe21 with scrape type 2
2026-03-29 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 137851de-c891-5724-8b0d-4135704ffe21 with scrape type 2
2026-03-29 18:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 137851de-c891-5724-8b0d-4135704ffe21, identifier: WN56158
2026-03-29 18:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 137851de-c891-5724-8b0d-4135704ffe21 with identifier: WN56158
2026-03-29 18:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 137851de-c891-5724-8b0d-4135704ffe21 with identifier: WN56158
2026-03-29 18:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 137851de-c891-5724-8b0d-4135704ffe21 with identifier: WN56158 to the API
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:16:49Z',
'fuel_type': 'petrol',
'id': '137851de-c891-5724-8b0d-4135704ffe21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN56158',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 109235,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-02',
'seller_name': None,
'title': 'Mazda CX-5 2.0 Center-Line 2WD',
'transmission': 'manual',
'trim': 'Center-Line 2WD',
'year': 2013}
2026-03-29 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN56158%27 HTTP/1.1" 200 None
2026-03-29 18:32:18 [auto1.de] INFO: Saving data for WN56158: {'auction_closing_time': 1774883809.0, 'created_time': 1773992660.163066, 'last_price_update_time': 1774809138.059632}
2026-03-29 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN56158') HTTP/1.1" 204 0
2026-03-29 18:32:18 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-29 18:32:18 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-29 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC39120%27 HTTP/1.1" 200 None
2026-03-29 18:32:18 [auto1.de] INFO: Scrape type for KC39120: 0
2026-03-29 18:32:18 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-29 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM88961%27 HTTP/1.1" 200 None
2026-03-29 18:32:18 [auto1.de] INFO: Scrape type for LM88961: 0
2026-03-29 18:32:18 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-29 18:32:18 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-29 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN54197%27 HTTP/1.1" 200 None
2026-03-29 18:32:18 [auto1.de] INFO: Scrape type for AN54197: 0
2026-03-29 18:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:32:19 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 6740 | hits on page: 40
2026-03-29 18:32:19 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81391%27 HTTP/1.1" 200 None
2026-03-29 18:32:19 [auto1.de] INFO: Scrape type for RB81391: 0
2026-03-29 18:32:19 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ54071%27 HTTP/1.1" 200 None
2026-03-29 18:32:19 [auto1.de] INFO: Scrape type for DJ54071: 0
2026-03-29 18:32:19 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10464%27 HTTP/1.1" 200 None
2026-03-29 18:32:19 [auto1.de] INFO: Scrape type for HM10464: 0
2026-03-29 18:32:19 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW22525%27 HTTP/1.1" 200 None
2026-03-29 18:32:19 [auto1.de] INFO: Scrape type for HW22525: 0
2026-03-29 18:32:19 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-29 18:32:19 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB44844%27 HTTP/1.1" 200 None
2026-03-29 18:32:19 [auto1.de] INFO: Scrape type for DB44844: 0
2026-03-29 18:32:19 [auto1.de] INFO: Found listing with ID: UY73943
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY73943%27 HTTP/1.1" 200 None
2026-03-29 18:32:19 [auto1.de] INFO: Scrape type for UY73943: 2
2026-03-29 18:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85fce79f-7c9f-5a17-b0c0-17b618758970 with identifier: UY73943
2026-03-29 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85fce79f-7c9f-5a17-b0c0-17b618758970 with scrape type 2
2026-03-29 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85fce79f-7c9f-5a17-b0c0-17b618758970 with scrape type 2
2026-03-29 18:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85fce79f-7c9f-5a17-b0c0-17b618758970, identifier: UY73943
2026-03-29 18:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85fce79f-7c9f-5a17-b0c0-17b618758970 with identifier: UY73943
2026-03-29 18:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85fce79f-7c9f-5a17-b0c0-17b618758970 with identifier: UY73943
2026-03-29 18:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85fce79f-7c9f-5a17-b0c0-17b618758970 with identifier: UY73943 to the API
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:55:07Z',
'fuel_type': 'diesel',
'id': '85fce79f-7c9f-5a17-b0c0-17b618758970',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY73943',
'listing': 'auction',
'make': 'Honda',
'model': 'CR-V',
'odometer': 253076,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-26',
'seller_name': None,
'title': 'Honda CR-V 1.6 DTEC Elegance 2WD',
'transmission': 'manual',
'trim': 'Elegance 2WD',
'year': 2016}
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY73943%27 HTTP/1.1" 200 None
2026-03-29 18:32:19 [auto1.de] INFO: Saving data for UY73943: {'auction_closing_time': 1774886107.0, 'created_time': 1773305845.390094, 'last_price_update_time': 1774809139.837174}
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY73943') HTTP/1.1" 204 0
2026-03-29 18:32:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:32:19 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN59671%27 HTTP/1.1" 200 None
2026-03-29 18:32:19 [auto1.de] INFO: Scrape type for TN59671: 2
2026-03-29 18:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b77b7246-133a-54c3-a584-c26e7a6c0d04 with identifier: TN59671
2026-03-29 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b77b7246-133a-54c3-a584-c26e7a6c0d04 with scrape type 2
2026-03-29 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b77b7246-133a-54c3-a584-c26e7a6c0d04 with scrape type 2
2026-03-29 18:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b77b7246-133a-54c3-a584-c26e7a6c0d04, identifier: TN59671
2026-03-29 18:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b77b7246-133a-54c3-a584-c26e7a6c0d04 with identifier: TN59671
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=other HTTP/1.1" 200 None
2026-03-29 18:32:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b77b7246-133a-54c3-a584-c26e7a6c0d04 with identifier: TN59671
2026-03-29 18:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b77b7246-133a-54c3-a584-c26e7a6c0d04 with identifier: TN59671 to the API
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'other',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 179,
'expiration_date': '2026-03-30T15:30:19Z',
'fuel_type': 'diesel',
'id': 'b77b7246-133a-54c3-a584-c26e7a6c0d04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN59671',
'listing': 'auction',
'make': 'Iveco',
'model': 'Daily',
'odometer': 76670,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-31',
'seller_name': None,
'title': 'Iveco Daily 3.0 Diesel Einzelkabine 70 C Radstand 4350',
'transmission': 'manual',
'trim': 'Einzelkabine 70 C Radstand 4350',
'year': 2021}
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN59671%27 HTTP/1.1" 200 None
2026-03-29 18:32:20 [auto1.de] INFO: Saving data for TN59671: {'auction_closing_time': 1774884619.0, 'created_time': 1773917538.259573, 'last_price_update_time': 1774809140.568007}
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN59671') HTTP/1.1" 204 0
2026-03-29 18:32:20 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB75617%27 HTTP/1.1" 200 None
2026-03-29 18:32:20 [auto1.de] INFO: Scrape type for JB75617: 0
2026-03-29 18:32:20 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63268%27 HTTP/1.1" 200 None
2026-03-29 18:32:20 [auto1.de] INFO: Scrape type for GC63268: 0
2026-03-29 18:32:20 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-29 18:32:20 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-29 18:32:20 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-29 18:32:20 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB40940%27 HTTP/1.1" 200 None
2026-03-29 18:32:20 [auto1.de] INFO: Scrape type for VB40940: 0
2026-03-29 18:32:20 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-29 18:32:20 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-29 18:32:20 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09054%27 HTTP/1.1" 200 None
2026-03-29 18:32:20 [auto1.de] INFO: Scrape type for PC09054: 0
2026-03-29 18:32:20 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS06113%27 HTTP/1.1" 200 None
2026-03-29 18:32:20 [auto1.de] INFO: Scrape type for YS06113: 2
2026-03-29 18:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20b4f624-7b43-5d67-96d9-efabbce6d4be with identifier: YS06113
2026-03-29 18:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20b4f624-7b43-5d67-96d9-efabbce6d4be with scrape type 2
2026-03-29 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20b4f624-7b43-5d67-96d9-efabbce6d4be with scrape type 2
2026-03-29 18:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20b4f624-7b43-5d67-96d9-efabbce6d4be, identifier: YS06113
2026-03-29 18:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20b4f624-7b43-5d67-96d9-efabbce6d4be with identifier: YS06113
2026-03-29 18:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20b4f624-7b43-5d67-96d9-efabbce6d4be with identifier: YS06113
2026-03-29 18:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20b4f624-7b43-5d67-96d9-efabbce6d4be with identifier: YS06113 to the API
2026-03-29 18:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:11:25Z',
'fuel_type': 'diesel',
'id': '20b4f624-7b43-5d67-96d9-efabbce6d4be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS06113',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 165944,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-11',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 310 L1 Tourneo Titanium',
'transmission': 'manual',
'trim': '310 L1 Tourneo Titanium',
'year': 2016}
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS06113%27 HTTP/1.1" 200 None
2026-03-29 18:32:21 [auto1.de] INFO: Saving data for YS06113: {'auction_closing_time': 1774883485.0, 'created_time': 1773858992.489227, 'last_price_update_time': 1774809141.116659}
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS06113') HTTP/1.1" 204 0
2026-03-29 18:32:21 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-29 18:32:21 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX34650%27 HTTP/1.1" 200 None
2026-03-29 18:32:21 [auto1.de] INFO: Scrape type for VX34650: 2
2026-03-29 18:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31049a8e-cdb3-51f8-a255-82f089ad50a9 with identifier: VX34650
2026-03-29 18:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31049a8e-cdb3-51f8-a255-82f089ad50a9 with scrape type 2
2026-03-29 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31049a8e-cdb3-51f8-a255-82f089ad50a9 with scrape type 2
2026-03-29 18:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31049a8e-cdb3-51f8-a255-82f089ad50a9, identifier: VX34650
2026-03-29 18:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31049a8e-cdb3-51f8-a255-82f089ad50a9 with identifier: VX34650
2026-03-29 18:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31049a8e-cdb3-51f8-a255-82f089ad50a9 with identifier: VX34650
2026-03-29 18:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31049a8e-cdb3-51f8-a255-82f089ad50a9 with identifier: VX34650 to the API
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:51:34Z',
'fuel_type': 'petrol',
'id': '31049a8e-cdb3-51f8-a255-82f089ad50a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX34650',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 151728,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-04',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2013}
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX34650%27 HTTP/1.1" 200 None
2026-03-29 18:32:21 [auto1.de] INFO: Saving data for VX34650: {'auction_closing_time': 1774885894.0, 'created_time': 1773774705.884662, 'last_price_update_time': 1774809141.679678}
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX34650') HTTP/1.1" 204 0
2026-03-29 18:32:21 [auto1.de] INFO: Found listing with ID: FA27220
2026-03-29 18:32:21 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-29 18:32:21 [auto1.de] INFO: Scrape type for ZK39912: 2
2026-03-29 18:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df8e66fe-d663-5c2a-bba9-abd09e0007a5 with identifier: ZK39912
2026-03-29 18:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df8e66fe-d663-5c2a-bba9-abd09e0007a5 with scrape type 2
2026-03-29 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df8e66fe-d663-5c2a-bba9-abd09e0007a5 with scrape type 2
2026-03-29 18:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df8e66fe-d663-5c2a-bba9-abd09e0007a5, identifier: ZK39912
2026-03-29 18:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df8e66fe-d663-5c2a-bba9-abd09e0007a5 with identifier: ZK39912
2026-03-29 18:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df8e66fe-d663-5c2a-bba9-abd09e0007a5 with identifier: ZK39912
2026-03-29 18:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df8e66fe-d663-5c2a-bba9-abd09e0007a5 with identifier: ZK39912 to the API
2026-03-29 18:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:42:18Z',
'fuel_type': 'petrol',
'id': 'df8e66fe-d663-5c2a-bba9-abd09e0007a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK39912',
'listing': 'auction',
'make': 'Fiat',
'model': '500C',
'odometer': 40337,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-15',
'seller_name': None,
'title': 'Fiat 500C 1.0 Mild-Hybrid Star',
'transmission': 'manual',
'trim': 'Star',
'year': 2020}
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-29 18:32:22 [auto1.de] INFO: Saving data for ZK39912: {'auction_closing_time': 1774885338.0, 'created_time': 1773776283.539138, 'last_price_update_time': 1774809142.123427}
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK39912') HTTP/1.1" 204 0
2026-03-29 18:32:22 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-29 18:32:22 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-29 18:32:22 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN58886%27 HTTP/1.1" 200 None
2026-03-29 18:32:22 [auto1.de] INFO: Scrape type for UN58886: 0
2026-03-29 18:32:22 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-29 18:32:22 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-29 18:32:22 [auto1.de] INFO: Scrape type for FZ50846: 2
2026-03-29 18:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a4de99-3012-53c2-b8d4-49627de505f8 with identifier: FZ50846
2026-03-29 18:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a4de99-3012-53c2-b8d4-49627de505f8 with scrape type 2
2026-03-29 18:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43a4de99-3012-53c2-b8d4-49627de505f8 with scrape type 2
2026-03-29 18:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43a4de99-3012-53c2-b8d4-49627de505f8, identifier: FZ50846
2026-03-29 18:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43a4de99-3012-53c2-b8d4-49627de505f8 with identifier: FZ50846
2026-03-29 18:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43a4de99-3012-53c2-b8d4-49627de505f8 with identifier: FZ50846
2026-03-29 18:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43a4de99-3012-53c2-b8d4-49627de505f8 with identifier: FZ50846 to the API
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:48:29Z',
'fuel_type': 'diesel',
'id': '43a4de99-3012-53c2-b8d4-49627de505f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ50846',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Transporter',
'odometer': 370587,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-23',
'seller_name': None,
'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten BlueMotion',
'transmission': 'manual',
'trim': 'Kasten BlueMotion',
'year': 2014}
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-29 18:32:22 [auto1.de] INFO: Saving data for FZ50846: {'auction_closing_time': 1774885709.0, 'created_time': 1773138597.046821, 'last_price_update_time': 1774809142.626072}
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ50846') HTTP/1.1" 204 0
2026-03-29 18:32:22 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN76212%27 HTTP/1.1" 200 None
2026-03-29 18:32:22 [auto1.de] INFO: Scrape type for JN76212: 0
2026-03-29 18:32:22 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-29 18:32:22 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-29 18:32:22 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF08287%27 HTTP/1.1" 200 None
2026-03-29 18:32:22 [auto1.de] INFO: Scrape type for TF08287: 0
2026-03-29 18:32:22 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-29 18:32:22 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU29288%27 HTTP/1.1" 200 None
2026-03-29 18:32:22 [auto1.de] INFO: Scrape type for TU29288: 2
2026-03-29 18:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with identifier: TU29288
2026-03-29 18:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with scrape type 2
2026-03-29 18:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with scrape type 2
2026-03-29 18:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11cc4c26-e79f-5114-b6e8-e2fd37b6918e, identifier: TU29288
2026-03-29 18:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with identifier: TU29288
2026-03-29 18:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with identifier: TU29288
2026-03-29 18:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with identifier: TU29288 to the API
2026-03-29 18:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:01:18Z',
'fuel_type': 'hybrid',
'id': '11cc4c26-e79f-5114-b6e8-e2fd37b6918e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU29288',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 52168,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-08',
'seller_name': None,
'title': 'MINI Countryman Cooper SE Essential Trim ALL4',
'transmission': 'automatic',
'trim': 'Essential Trim ALL4',
'year': 2022}
2026-03-29 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU29288%27 HTTP/1.1" 200 None
2026-03-29 18:32:23 [auto1.de] INFO: Saving data for TU29288: {'auction_closing_time': 1774882878.0, 'created_time': 1773306982.261137, 'last_price_update_time': 1774809143.1197}
2026-03-29 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU29288') HTTP/1.1" 204 0
2026-03-29 18:32:23 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-29 18:32:23 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-29 18:32:23 [auto1.de] INFO: Found listing with ID: NR54362
2026-03-29 18:32:23 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-29 18:32:23 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-29 18:32:23 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-29 18:32:23 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-29 18:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:32:23 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 6740 | hits on page: 40
2026-03-29 18:32:23 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-29 18:32:23 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-29 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG77275%27 HTTP/1.1" 200 None
2026-03-29 18:32:23 [auto1.de] INFO: Scrape type for AG77275: 0
2026-03-29 18:32:23 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-29 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG37810%27 HTTP/1.1" 200 None
2026-03-29 18:32:23 [auto1.de] INFO: Scrape type for MG37810: 2
2026-03-29 18:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6da3d3d4-b79d-5360-9701-7138af02912b with identifier: MG37810
2026-03-29 18:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da3d3d4-b79d-5360-9701-7138af02912b with scrape type 2
2026-03-29 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6da3d3d4-b79d-5360-9701-7138af02912b with scrape type 2
2026-03-29 18:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6da3d3d4-b79d-5360-9701-7138af02912b, identifier: MG37810
2026-03-29 18:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6da3d3d4-b79d-5360-9701-7138af02912b with identifier: MG37810
2026-03-29 18:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6da3d3d4-b79d-5360-9701-7138af02912b with identifier: MG37810
2026-03-29 18:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6da3d3d4-b79d-5360-9701-7138af02912b with identifier: MG37810 to the API
2026-03-29 18:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:05:48Z',
'fuel_type': 'petrol',
'id': '6da3d3d4-b79d-5360-9701-7138af02912b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG37810',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 86259,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-20',
'seller_name': None,
'title': 'Audi A1 Sportback 1.2 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2013}
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG37810%27 HTTP/1.1" 200 None
2026-03-29 18:32:24 [auto1.de] INFO: Saving data for MG37810: {'auction_closing_time': 1774883148.0, 'created_time': 1774607527.509987, 'last_price_update_time': 1774809144.083147}
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG37810') HTTP/1.1" 204 0
2026-03-29 18:32:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:32:24 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY58400%27 HTTP/1.1" 200 None
2026-03-29 18:32:24 [auto1.de] INFO: Scrape type for BY58400: 2
2026-03-29 18:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03351b3b-653b-557a-b8f3-5dc54c867ff4 with identifier: BY58400
2026-03-29 18:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03351b3b-653b-557a-b8f3-5dc54c867ff4 with scrape type 2
2026-03-29 18:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03351b3b-653b-557a-b8f3-5dc54c867ff4 with scrape type 2
2026-03-29 18:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03351b3b-653b-557a-b8f3-5dc54c867ff4, identifier: BY58400
2026-03-29 18:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03351b3b-653b-557a-b8f3-5dc54c867ff4 with identifier: BY58400
2026-03-29 18:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03351b3b-653b-557a-b8f3-5dc54c867ff4 with identifier: BY58400
2026-03-29 18:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03351b3b-653b-557a-b8f3-5dc54c867ff4 with identifier: BY58400 to the API
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:17:57Z',
'fuel_type': 'diesel',
'id': '03351b3b-653b-557a-b8f3-5dc54c867ff4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY58400',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Cruze',
'odometer': 201900,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-17',
'seller_name': None,
'title': 'Chevrolet Cruze 2.0 Diesel LTZ',
'transmission': 'automatic',
'trim': 'LTZ',
'year': 2011}
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY58400%27 HTTP/1.1" 200 None
2026-03-29 18:32:24 [auto1.de] INFO: Saving data for BY58400: {'auction_closing_time': 1774883877.0, 'created_time': 1772543113.978979, 'last_price_update_time': 1774809144.497256}
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY58400') HTTP/1.1" 204 0
2026-03-29 18:32:24 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM03290%27 HTTP/1.1" 200 None
2026-03-29 18:32:24 [auto1.de] INFO: Scrape type for LM03290: 0
2026-03-29 18:32:24 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-29 18:32:24 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-29 18:32:24 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-29 18:32:24 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ32425%27 HTTP/1.1" 200 None
2026-03-29 18:32:24 [auto1.de] INFO: Scrape type for DJ32425: 2
2026-03-29 18:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with identifier: DJ32425
2026-03-29 18:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with scrape type 2
2026-03-29 18:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with scrape type 2
2026-03-29 18:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c10d3bf-c14a-570c-90e4-6d0c55c32190, identifier: DJ32425
2026-03-29 18:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with identifier: DJ32425
2026-03-29 18:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with identifier: DJ32425
2026-03-29 18:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with identifier: DJ32425 to the API
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:31:09Z',
'fuel_type': 'diesel',
'id': '9c10d3bf-c14a-570c-90e4-6d0c55c32190',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ32425',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 70834,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-19',
'seller_name': None,
'title': 'Opel Mokka X 1.6 CDTI DPF Edition Start/Stop',
'transmission': 'manual',
'trim': 'Edition Start/Stop',
'year': 2016}
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ32425%27 HTTP/1.1" 200 None
2026-03-29 18:32:25 [auto1.de] INFO: Saving data for DJ32425: {'auction_closing_time': 1774884669.0, 'created_time': 1773307966.870438, 'last_price_update_time': 1774809145.045269}
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ32425') HTTP/1.1" 204 0
2026-03-29 18:32:25 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-29 18:32:25 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41377%27 HTTP/1.1" 200 None
2026-03-29 18:32:25 [auto1.de] INFO: Scrape type for DV41377: 2
2026-03-29 18:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43642e65-0815-5bf0-b640-6173f805d69a with identifier: DV41377
2026-03-29 18:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43642e65-0815-5bf0-b640-6173f805d69a with scrape type 2
2026-03-29 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43642e65-0815-5bf0-b640-6173f805d69a with scrape type 2
2026-03-29 18:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43642e65-0815-5bf0-b640-6173f805d69a, identifier: DV41377
2026-03-29 18:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43642e65-0815-5bf0-b640-6173f805d69a with identifier: DV41377
2026-03-29 18:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43642e65-0815-5bf0-b640-6173f805d69a with identifier: DV41377
2026-03-29 18:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43642e65-0815-5bf0-b640-6173f805d69a with identifier: DV41377 to the API
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:40:37Z',
'fuel_type': 'petrol',
'id': '43642e65-0815-5bf0-b640-6173f805d69a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV41377',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 64357,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-08',
'seller_name': None,
'title': 'Opel Zafira 1.8 Family Plus',
'transmission': 'manual',
'trim': 'Family Plus',
'year': 2013}
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41377%27 HTTP/1.1" 200 None
2026-03-29 18:32:25 [auto1.de] INFO: Saving data for DV41377: {'auction_closing_time': 1774885237.0, 'created_time': 1774031494.790696, 'last_price_update_time': 1774809145.503029}
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV41377') HTTP/1.1" 204 0
2026-03-29 18:32:25 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-29 18:32:25 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-29 18:32:25 [auto1.de] INFO: Found listing with ID: UV10868
2026-03-29 18:32:25 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-29 18:32:25 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-29 18:32:25 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP32495%27 HTTP/1.1" 200 None
2026-03-29 18:32:25 [auto1.de] INFO: Scrape type for BP32495: 0
2026-03-29 18:32:25 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52655%27 HTTP/1.1" 200 None
2026-03-29 18:32:25 [auto1.de] INFO: Scrape type for ZM52655: 2
2026-03-29 18:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f2063fc-582c-5785-8b5d-07618afda648 with identifier: ZM52655
2026-03-29 18:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f2063fc-582c-5785-8b5d-07618afda648 with scrape type 2
2026-03-29 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f2063fc-582c-5785-8b5d-07618afda648 with scrape type 2
2026-03-29 18:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f2063fc-582c-5785-8b5d-07618afda648, identifier: ZM52655
2026-03-29 18:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f2063fc-582c-5785-8b5d-07618afda648 with identifier: ZM52655
2026-03-29 18:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f2063fc-582c-5785-8b5d-07618afda648 with identifier: ZM52655
2026-03-29 18:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f2063fc-582c-5785-8b5d-07618afda648 with identifier: ZM52655 to the API
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:43:57Z',
'fuel_type': 'petrol',
'id': '6f2063fc-582c-5785-8b5d-07618afda648',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM52655',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40',
'odometer': 160522,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-02-15',
'seller_name': None,
'title': 'Volvo V40 1.8',
'transmission': 'manual',
'trim': '',
'year': 1999}
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52655%27 HTTP/1.1" 200 None
2026-03-29 18:32:25 [auto1.de] INFO: Saving data for ZM52655: {'auction_closing_time': 1774885437.0, 'created_time': 1774032613.749931, 'last_price_update_time': 1774809145.917326}
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM52655') HTTP/1.1" 204 0
2026-03-29 18:32:26 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-29 18:32:26 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB33034%27 HTTP/1.1" 200 None
2026-03-29 18:32:26 [auto1.de] INFO: Scrape type for BB33034: 2
2026-03-29 18:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b641efa-2fe5-5e81-b564-e66e5de30046 with identifier: BB33034
2026-03-29 18:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b641efa-2fe5-5e81-b564-e66e5de30046 with scrape type 2
2026-03-29 18:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b641efa-2fe5-5e81-b564-e66e5de30046 with scrape type 2
2026-03-29 18:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b641efa-2fe5-5e81-b564-e66e5de30046, identifier: BB33034
2026-03-29 18:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b641efa-2fe5-5e81-b564-e66e5de30046 with identifier: BB33034
2026-03-29 18:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b641efa-2fe5-5e81-b564-e66e5de30046 with identifier: BB33034
2026-03-29 18:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b641efa-2fe5-5e81-b564-e66e5de30046 with identifier: BB33034 to the API
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:25:57Z',
'fuel_type': 'diesel',
'id': '1b641efa-2fe5-5e81-b564-e66e5de30046',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB33034',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 171576,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-12-31',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 1998}
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB33034%27 HTTP/1.1" 200 None
2026-03-29 18:32:26 [auto1.de] INFO: Saving data for BB33034: {'auction_closing_time': 1774884357.0, 'created_time': 1774607724.567191, 'last_price_update_time': 1774809146.477226}
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB33034') HTTP/1.1" 204 0
2026-03-29 18:32:26 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH84206%27 HTTP/1.1" 200 None
2026-03-29 18:32:26 [auto1.de] INFO: Scrape type for JH84206: 0
2026-03-29 18:32:26 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT55268%27 HTTP/1.1" 200 None
2026-03-29 18:32:26 [auto1.de] INFO: Scrape type for HT55268: 0
2026-03-29 18:32:26 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23161%27 HTTP/1.1" 200 None
2026-03-29 18:32:26 [auto1.de] INFO: Scrape type for DG23161: 2
2026-03-29 18:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 434f30db-432a-5581-b21d-950c0a9274e8 with identifier: DG23161
2026-03-29 18:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 434f30db-432a-5581-b21d-950c0a9274e8 with scrape type 2
2026-03-29 18:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 434f30db-432a-5581-b21d-950c0a9274e8 with scrape type 2
2026-03-29 18:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 434f30db-432a-5581-b21d-950c0a9274e8, identifier: DG23161
2026-03-29 18:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 434f30db-432a-5581-b21d-950c0a9274e8 with identifier: DG23161
2026-03-29 18:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 434f30db-432a-5581-b21d-950c0a9274e8 with identifier: DG23161
2026-03-29 18:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 434f30db-432a-5581-b21d-950c0a9274e8 with identifier: DG23161 to the API
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:33:49Z',
'fuel_type': 'petrol',
'id': '434f30db-432a-5581-b21d-950c0a9274e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG23161',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 131636,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-07-12',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2007}
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23161%27 HTTP/1.1" 200 None
2026-03-29 18:32:26 [auto1.de] INFO: Saving data for DG23161: {'auction_closing_time': 1774884829.0, 'created_time': 1774522289.120721, 'last_price_update_time': 1774809146.904446}
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG23161') HTTP/1.1" 204 0
2026-03-29 18:32:26 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-29 18:32:26 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP28928%27 HTTP/1.1" 200 None
2026-03-29 18:32:26 [auto1.de] INFO: Scrape type for GP28928: 0
2026-03-29 18:32:26 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-29 18:32:26 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-29 18:32:26 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF35013%27 HTTP/1.1" 200 None
2026-03-29 18:32:26 [auto1.de] INFO: Scrape type for AF35013: 0
2026-03-29 18:32:26 [auto1.de] INFO: Found listing with ID: JV22464
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV22464%27 HTTP/1.1" 200 None
2026-03-29 18:32:26 [auto1.de] INFO: Scrape type for JV22464: 2
2026-03-29 18:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab4b5d81-4ba3-5bf9-abae-00e756ff67e5 with identifier: JV22464
2026-03-29 18:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab4b5d81-4ba3-5bf9-abae-00e756ff67e5 with scrape type 2
2026-03-29 18:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab4b5d81-4ba3-5bf9-abae-00e756ff67e5 with scrape type 2
2026-03-29 18:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab4b5d81-4ba3-5bf9-abae-00e756ff67e5, identifier: JV22464
2026-03-29 18:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab4b5d81-4ba3-5bf9-abae-00e756ff67e5 with identifier: JV22464
2026-03-29 18:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab4b5d81-4ba3-5bf9-abae-00e756ff67e5 with identifier: JV22464
2026-03-29 18:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab4b5d81-4ba3-5bf9-abae-00e756ff67e5 with identifier: JV22464 to the API
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:29:14Z',
'fuel_type': 'petrol',
'id': 'ab4b5d81-4ba3-5bf9-abae-00e756ff67e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV22464',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 192375,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-31',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2014}
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV22464%27 HTTP/1.1" 200 None
2026-03-29 18:32:27 [auto1.de] INFO: Saving data for JV22464: {'auction_closing_time': 1774884554.0, 'created_time': 1774034432.079096, 'last_price_update_time': 1774809147.365751}
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV22464') HTTP/1.1" 204 0
2026-03-29 18:32:27 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-29 18:32:27 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB85475%27 HTTP/1.1" 200 None
2026-03-29 18:32:27 [auto1.de] INFO: Scrape type for RB85475: 0
2026-03-29 18:32:27 [auto1.de] INFO: Found listing with ID: GY48177
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY48177%27 HTTP/1.1" 200 None
2026-03-29 18:32:27 [auto1.de] INFO: Scrape type for GY48177: 2
2026-03-29 18:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f937f208-bc48-5c82-9169-f40f67d8c916 with identifier: GY48177
2026-03-29 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f937f208-bc48-5c82-9169-f40f67d8c916 with scrape type 2
2026-03-29 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f937f208-bc48-5c82-9169-f40f67d8c916 with scrape type 2
2026-03-29 18:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f937f208-bc48-5c82-9169-f40f67d8c916, identifier: GY48177
2026-03-29 18:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f937f208-bc48-5c82-9169-f40f67d8c916 with identifier: GY48177
2026-03-29 18:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f937f208-bc48-5c82-9169-f40f67d8c916 with identifier: GY48177
2026-03-29 18:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f937f208-bc48-5c82-9169-f40f67d8c916 with identifier: GY48177 to the API
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:55:37Z',
'fuel_type': 'petrol',
'id': 'f937f208-bc48-5c82-9169-f40f67d8c916',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY48177',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 95858,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-13',
'seller_name': None,
'title': 'Smart fortwo 1.0 Turbo Basis pulse',
'transmission': 'automatic',
'trim': 'Basis pulse',
'year': 2014}
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY48177%27 HTTP/1.1" 200 None
2026-03-29 18:32:27 [auto1.de] INFO: Saving data for GY48177: {'auction_closing_time': 1774886137.0, 'created_time': 1774032248.379102, 'last_price_update_time': 1774809147.919025}
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY48177') HTTP/1.1" 204 0
2026-03-29 18:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:32:27 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM82116%27 HTTP/1.1" 200 None
2026-03-29 18:32:27 [auto1.de] INFO: Scrape type for XM82116: 0
2026-03-29 18:32:27 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ74678%27 HTTP/1.1" 200 None
2026-03-29 18:32:27 [auto1.de] INFO: Scrape type for SZ74678: 2
2026-03-29 18:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e002cef3-cd69-5677-9a95-12f44a7e2500 with identifier: SZ74678
2026-03-29 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e002cef3-cd69-5677-9a95-12f44a7e2500 with scrape type 2
2026-03-29 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e002cef3-cd69-5677-9a95-12f44a7e2500 with scrape type 2
2026-03-29 18:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e002cef3-cd69-5677-9a95-12f44a7e2500, identifier: SZ74678
2026-03-29 18:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e002cef3-cd69-5677-9a95-12f44a7e2500 with identifier: SZ74678
2026-03-29 18:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e002cef3-cd69-5677-9a95-12f44a7e2500 with identifier: SZ74678
2026-03-29 18:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e002cef3-cd69-5677-9a95-12f44a7e2500 with identifier: SZ74678 to the API
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:51:30Z',
'fuel_type': 'diesel',
'id': 'e002cef3-cd69-5677-9a95-12f44a7e2500',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ74678',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 135389,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-22',
'seller_name': None,
'title': 'Renault Megane 1.6 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2018}
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ74678%27 HTTP/1.1" 200 None
2026-03-29 18:32:28 [auto1.de] INFO: Saving data for SZ74678: {'auction_closing_time': 1774885890.0, 'created_time': 1773946477.792062, 'last_price_update_time': 1774809148.401583}
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ74678') HTTP/1.1" 204 0
2026-03-29 18:32:28 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18867%27 HTTP/1.1" 200 None
2026-03-29 18:32:28 [auto1.de] INFO: Scrape type for SV18867: 0
2026-03-29 18:32:28 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL47086%27 HTTP/1.1" 200 None
2026-03-29 18:32:28 [auto1.de] INFO: Scrape type for SL47086: 2
2026-03-29 18:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62fd87bc-91b6-5aac-adba-619880342280 with identifier: SL47086
2026-03-29 18:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62fd87bc-91b6-5aac-adba-619880342280 with scrape type 2
2026-03-29 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62fd87bc-91b6-5aac-adba-619880342280 with scrape type 2
2026-03-29 18:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62fd87bc-91b6-5aac-adba-619880342280, identifier: SL47086
2026-03-29 18:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62fd87bc-91b6-5aac-adba-619880342280 with identifier: SL47086
2026-03-29 18:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62fd87bc-91b6-5aac-adba-619880342280 with identifier: SL47086
2026-03-29 18:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62fd87bc-91b6-5aac-adba-619880342280 with identifier: SL47086 to the API
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:57:48Z',
'fuel_type': 'diesel',
'id': '62fd87bc-91b6-5aac-adba-619880342280',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL47086',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 59333,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-19',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 220 d 4Matic Progressive',
'transmission': 'automatic',
'trim': '4Matic Progressive',
'year': 2022}
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL47086%27 HTTP/1.1" 200 None
2026-03-29 18:32:28 [auto1.de] INFO: Saving data for SL47086: {'auction_closing_time': 1774886268.0, 'created_time': 1773859232.539409, 'last_price_update_time': 1774809148.88161}
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL47086') HTTP/1.1" 204 0
2026-03-29 18:32:28 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 6740 | hits on page: 40
2026-03-29 18:32:28 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ65167%27 HTTP/1.1" 200 None
2026-03-29 18:32:28 [auto1.de] INFO: Scrape type for EJ65167: 2
2026-03-29 18:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eae9671e-9421-543e-b9fc-2939da586128 with identifier: EJ65167
2026-03-29 18:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eae9671e-9421-543e-b9fc-2939da586128 with scrape type 2
2026-03-29 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eae9671e-9421-543e-b9fc-2939da586128 with scrape type 2
2026-03-29 18:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eae9671e-9421-543e-b9fc-2939da586128, identifier: EJ65167
2026-03-29 18:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eae9671e-9421-543e-b9fc-2939da586128 with identifier: EJ65167
2026-03-29 18:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eae9671e-9421-543e-b9fc-2939da586128 with identifier: EJ65167
2026-03-29 18:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eae9671e-9421-543e-b9fc-2939da586128 with identifier: EJ65167 to the API
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:43:23Z',
'fuel_type': 'petrol',
'id': 'eae9671e-9421-543e-b9fc-2939da586128',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ65167',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 101389,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-26',
'seller_name': None,
'title': 'Volkswagen Beetle 1.2 TSI Design BlueMotion Tech',
'transmission': 'manual',
'trim': 'Design BlueMotion Tech',
'year': 2016}
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ65167%27 HTTP/1.1" 200 None
2026-03-29 18:32:29 [auto1.de] INFO: Saving data for EJ65167: {'auction_closing_time': 1774885403.0, 'created_time': 1774330258.749606, 'last_price_update_time': 1774809149.39915}
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ65167') HTTP/1.1" 204 0
2026-03-29 18:32:29 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-29 18:32:29 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-29 18:32:29 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-29 18:32:29 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-29 18:32:29 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-29 18:32:29 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-29 18:32:29 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-29 18:32:29 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH65688%27 HTTP/1.1" 200 None
2026-03-29 18:32:29 [auto1.de] INFO: Scrape type for PH65688: 0
2026-03-29 18:32:29 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99769%27 HTTP/1.1" 200 None
2026-03-29 18:32:29 [auto1.de] INFO: Scrape type for JM99769: 2
2026-03-29 18:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with identifier: JM99769
2026-03-29 18:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with scrape type 2
2026-03-29 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with scrape type 2
2026-03-29 18:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f02acfc2-5aee-56b6-b9c8-5a8782c753c8, identifier: JM99769
2026-03-29 18:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:32:29 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14864%27 HTTP/1.1" 200 None
2026-03-29 18:32:29 [auto1.de] INFO: Scrape type for JT14864: 0
2026-03-29 18:32:29 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR97371%27 HTTP/1.1" 200 None
2026-03-29 18:32:29 [auto1.de] INFO: Scrape type for JR97371: 2
2026-03-29 18:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ee31247-563d-5d39-9604-3c7d8bea3d43 with identifier: JR97371
2026-03-29 18:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ee31247-563d-5d39-9604-3c7d8bea3d43 with scrape type 2
2026-03-29 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ee31247-563d-5d39-9604-3c7d8bea3d43 with scrape type 2
2026-03-29 18:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ee31247-563d-5d39-9604-3c7d8bea3d43, identifier: JR97371
2026-03-29 18:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with identifier: JM99769
2026-03-29 18:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with identifier: JM99769
2026-03-29 18:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with identifier: JM99769 to the API
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:06:02Z',
'fuel_type': 'diesel',
'id': 'f02acfc2-5aee-56b6-b9c8-5a8782c753c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM99769',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 350351,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-09',
'seller_name': None,
'title': 'Ford Focus 1.5 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99769%27 HTTP/1.1" 200 None
2026-03-29 18:32:30 [auto1.de] INFO: Saving data for JM99769: {'auction_closing_time': 1774883162.0, 'created_time': 1774607625.25785, 'last_price_update_time': 1774809150.033506}
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM99769') HTTP/1.1" 204 0
2026-03-29 18:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ee31247-563d-5d39-9604-3c7d8bea3d43 with identifier: JR97371
2026-03-29 18:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ee31247-563d-5d39-9604-3c7d8bea3d43 with identifier: JR97371
2026-03-29 18:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ee31247-563d-5d39-9604-3c7d8bea3d43 with identifier: JR97371 to the API
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:37:13Z',
'fuel_type': 'diesel',
'id': '3ee31247-563d-5d39-9604-3c7d8bea3d43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR97371',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 201428,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-31',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Scout 4x4',
'transmission': 'manual',
'trim': 'Scout 4x4',
'year': 2010}
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR97371%27 HTTP/1.1" 200 None
2026-03-29 18:32:30 [auto1.de] INFO: Saving data for JR97371: {'auction_closing_time': 1774885033.0, 'created_time': 1773905443.219309, 'last_price_update_time': 1774809150.481866}
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR97371') HTTP/1.1" 204 0
2026-03-29 18:32:30 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41784%27 HTTP/1.1" 200 None
2026-03-29 18:32:30 [auto1.de] INFO: Scrape type for MF41784: 0
2026-03-29 18:32:30 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR81453%27 HTTP/1.1" 200 None
2026-03-29 18:32:30 [auto1.de] INFO: Scrape type for XR81453: 0
2026-03-29 18:32:30 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06812%27 HTTP/1.1" 200 None
2026-03-29 18:32:30 [auto1.de] INFO: Scrape type for SC06812: 2
2026-03-29 18:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 714de284-560f-5487-aac2-29f81829d383 with identifier: SC06812
2026-03-29 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 714de284-560f-5487-aac2-29f81829d383 with scrape type 2
2026-03-29 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 714de284-560f-5487-aac2-29f81829d383 with scrape type 2
2026-03-29 18:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 714de284-560f-5487-aac2-29f81829d383, identifier: SC06812
2026-03-29 18:32:30 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS79881%27 HTTP/1.1" 200 None
2026-03-29 18:32:30 [auto1.de] INFO: Scrape type for VS79881: 2
2026-03-29 18:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d4d0418-77e4-50a9-b503-3ec70eca58e6 with identifier: VS79881
2026-03-29 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d4d0418-77e4-50a9-b503-3ec70eca58e6 with scrape type 2
2026-03-29 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d4d0418-77e4-50a9-b503-3ec70eca58e6 with scrape type 2
2026-03-29 18:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d4d0418-77e4-50a9-b503-3ec70eca58e6, identifier: VS79881
2026-03-29 18:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 714de284-560f-5487-aac2-29f81829d383 with identifier: SC06812
2026-03-29 18:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 714de284-560f-5487-aac2-29f81829d383 with identifier: SC06812
2026-03-29 18:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 714de284-560f-5487-aac2-29f81829d383 with identifier: SC06812 to the API
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:50:38Z',
'fuel_type': 'petrol',
'id': '714de284-560f-5487-aac2-29f81829d383',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC06812',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 68460,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-04',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI 4Motion BlueMotion',
'transmission': 'automatic',
'trim': '4Motion BlueMotion',
'year': 2019}
2026-03-29 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06812%27 HTTP/1.1" 200 None
2026-03-29 18:32:31 [auto1.de] INFO: Saving data for SC06812: {'auction_closing_time': 1774885838.0, 'created_time': 1773917487.315556, 'last_price_update_time': 1774809151.354017}
2026-03-29 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC06812') HTTP/1.1" 204 0
2026-03-29 18:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d4d0418-77e4-50a9-b503-3ec70eca58e6 with identifier: VS79881
2026-03-29 18:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d4d0418-77e4-50a9-b503-3ec70eca58e6 with identifier: VS79881
2026-03-29 18:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d4d0418-77e4-50a9-b503-3ec70eca58e6 with identifier: VS79881 to the API
2026-03-29 18:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:59:08Z',
'fuel_type': 'diesel',
'id': '5d4d0418-77e4-50a9-b503-3ec70eca58e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS79881',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 306718,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-30',
'seller_name': None,
'title': 'Volkswagen Golf Plus 2.0 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-29 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS79881%27 HTTP/1.1" 200 None
2026-03-29 18:32:31 [auto1.de] INFO: Saving data for VS79881: {'auction_closing_time': 1774886348.0, 'created_time': 1774521762.554843, 'last_price_update_time': 1774809151.712021}
2026-03-29 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS79881') HTTP/1.1" 204 0
2026-03-29 18:32:31 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-29 18:32:31 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-29 18:32:31 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-29 18:32:31 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-29 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY72669%27 HTTP/1.1" 200 None
2026-03-29 18:32:31 [auto1.de] INFO: Scrape type for RY72669: 2
2026-03-29 18:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0fb85a2-a71c-5a84-bdf4-599890367e5f with identifier: RY72669
2026-03-29 18:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0fb85a2-a71c-5a84-bdf4-599890367e5f with scrape type 2
2026-03-29 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0fb85a2-a71c-5a84-bdf4-599890367e5f with scrape type 2
2026-03-29 18:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0fb85a2-a71c-5a84-bdf4-599890367e5f, identifier: RY72669
2026-03-29 18:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0fb85a2-a71c-5a84-bdf4-599890367e5f with identifier: RY72669
2026-03-29 18:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0fb85a2-a71c-5a84-bdf4-599890367e5f with identifier: RY72669
2026-03-29 18:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0fb85a2-a71c-5a84-bdf4-599890367e5f with identifier: RY72669 to the API
2026-03-29 18:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:17:37Z',
'fuel_type': 'diesel',
'id': 'a0fb85a2-a71c-5a84-bdf4-599890367e5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY72669',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 210688,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-14',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 CDI BlueTEC Avantgarde',
'transmission': 'automatic',
'trim': 'BlueTEC Avantgarde',
'year': 2015}
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY72669%27 HTTP/1.1" 200 None
2026-03-29 18:32:32 [auto1.de] INFO: Saving data for RY72669: {'auction_closing_time': 1774883857.0, 'created_time': 1773426714.173984, 'last_price_update_time': 1774809152.165196}
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY72669') HTTP/1.1" 204 0
2026-03-29 18:32:32 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-29 18:32:32 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY28321%27 HTTP/1.1" 200 None
2026-03-29 18:32:32 [auto1.de] INFO: Scrape type for MY28321: 0
2026-03-29 18:32:32 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK00341%27 HTTP/1.1" 200 None
2026-03-29 18:32:32 [auto1.de] INFO: Scrape type for FK00341: 0
2026-03-29 18:32:32 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-29 18:32:32 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-29 18:32:32 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE46493%27 HTTP/1.1" 200 None
2026-03-29 18:32:32 [auto1.de] INFO: Scrape type for LE46493: 0
2026-03-29 18:32:32 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-29 18:32:32 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-29 18:32:32 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-29 18:32:32 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-29 18:32:32 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX26895%27 HTTP/1.1" 200 None
2026-03-29 18:32:32 [auto1.de] INFO: Scrape type for MX26895: 0
2026-03-29 18:32:32 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS81826%27 HTTP/1.1" 200 None
2026-03-29 18:32:32 [auto1.de] INFO: Scrape type for CS81826: 0
2026-03-29 18:32:32 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT72401%27 HTTP/1.1" 200 None
2026-03-29 18:32:32 [auto1.de] INFO: Scrape type for LT72401: 2
2026-03-29 18:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with identifier: LT72401
2026-03-29 18:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with scrape type 2
2026-03-29 18:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with scrape type 2
2026-03-29 18:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10f9c18c-fc62-57c5-940b-b10fe2d77b38, identifier: LT72401
2026-03-29 18:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with identifier: LT72401
2026-03-29 18:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with identifier: LT72401
2026-03-29 18:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with identifier: LT72401 to the API
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:58:52Z',
'fuel_type': 'petrol',
'id': '10f9c18c-fc62-57c5-940b-b10fe2d77b38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT72401',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 121290,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-13',
'seller_name': None,
'title': 'Opel Astra 1.4 SIDI Turbo Active Start/Stop',
'transmission': 'manual',
'trim': 'Active Start/Stop',
'year': 2017}
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT72401%27 HTTP/1.1" 200 None
2026-03-29 18:32:32 [auto1.de] INFO: Saving data for LT72401: {'auction_closing_time': 1774886332.0, 'created_time': 1773305828.571073, 'last_price_update_time': 1774809152.741602}
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT72401') HTTP/1.1" 204 0
2026-03-29 18:32:32 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65077%27 HTTP/1.1" 200 None
2026-03-29 18:32:32 [auto1.de] INFO: Scrape type for LJ65077: 2
2026-03-29 18:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with identifier: LJ65077
2026-03-29 18:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with scrape type 2
2026-03-29 18:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with scrape type 2
2026-03-29 18:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de5a2bb0-d02f-5b12-9f1c-78afc3302cfc, identifier: LJ65077
2026-03-29 18:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with identifier: LJ65077
2026-03-29 18:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with identifier: LJ65077
2026-03-29 18:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with identifier: LJ65077 to the API
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:54:50Z',
'fuel_type': 'diesel',
'id': 'de5a2bb0-d02f-5b12-9f1c-78afc3302cfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ65077',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 294927,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-07',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2019}
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65077%27 HTTP/1.1" 200 None
2026-03-29 18:32:33 [auto1.de] INFO: Saving data for LJ65077: {'auction_closing_time': 1774886090.0, 'created_time': 1773427287.035825, 'last_price_update_time': 1774809153.268915}
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ65077') HTTP/1.1" 204 0
2026-03-29 18:32:33 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-29 18:32:33 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-29 18:32:33 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB37681%27 HTTP/1.1" 200 None
2026-03-29 18:32:33 [auto1.de] INFO: Scrape type for SB37681: 2
2026-03-29 18:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4355646-53fc-5eae-9198-793cb8312dfd with identifier: SB37681
2026-03-29 18:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4355646-53fc-5eae-9198-793cb8312dfd with scrape type 2
2026-03-29 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4355646-53fc-5eae-9198-793cb8312dfd with scrape type 2
2026-03-29 18:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4355646-53fc-5eae-9198-793cb8312dfd, identifier: SB37681
2026-03-29 18:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4355646-53fc-5eae-9198-793cb8312dfd with identifier: SB37681
2026-03-29 18:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4355646-53fc-5eae-9198-793cb8312dfd with identifier: SB37681
2026-03-29 18:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4355646-53fc-5eae-9198-793cb8312dfd with identifier: SB37681 to the API
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 380,
'expiration_date': '2026-03-30T15:31:20Z',
'fuel_type': 'diesel',
'id': 'a4355646-53fc-5eae-9198-793cb8312dfd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB37681',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 148708,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-17',
'seller_name': None,
'title': 'BMW X5 M50d',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB37681%27 HTTP/1.1" 200 None
2026-03-29 18:32:33 [auto1.de] INFO: Saving data for SB37681: {'auction_closing_time': 1774884680.0, 'created_time': 1774521868.278871, 'last_price_update_time': 1774809153.670669}
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB37681') HTTP/1.1" 204 0
2026-03-29 18:32:33 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ62454%27 HTTP/1.1" 200 None
2026-03-29 18:32:33 [auto1.de] INFO: Scrape type for HJ62454: 0
2026-03-29 18:32:33 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-29 18:32:33 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41663%27 HTTP/1.1" 200 None
2026-03-29 18:32:33 [auto1.de] INFO: Scrape type for SP41663: 0
2026-03-29 18:32:33 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-29 18:32:33 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD80009%27 HTTP/1.1" 200 None
2026-03-29 18:32:33 [auto1.de] INFO: Scrape type for PD80009: 2
2026-03-29 18:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with identifier: PD80009
2026-03-29 18:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with scrape type 2
2026-03-29 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with scrape type 2
2026-03-29 18:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 857ec4fb-2a56-5289-85b9-c2dd0013eb20, identifier: PD80009
2026-03-29 18:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with identifier: PD80009
2026-03-29 18:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with identifier: PD80009
2026-03-29 18:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with identifier: PD80009 to the API
2026-03-29 18:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:36:37Z',
'fuel_type': 'diesel',
'id': '857ec4fb-2a56-5289-85b9-c2dd0013eb20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD80009',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 252762,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-21',
'seller_name': None,
'title': 'Audi A4 3.0 V6 TDI quattro S line Sportpaket plus',
'transmission': 'automatic',
'trim': 'quattro S line Sportpaket plus',
'year': 2013}
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD80009%27 HTTP/1.1" 200 None
2026-03-29 18:32:34 [auto1.de] INFO: Saving data for PD80009: {'auction_closing_time': 1774884997.0, 'created_time': 1774294710.373887, 'last_price_update_time': 1774809154.175444}
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD80009') HTTP/1.1" 204 0
2026-03-29 18:32:34 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF82631%27 HTTP/1.1" 200 None
2026-03-29 18:32:34 [auto1.de] INFO: Scrape type for EF82631: 2
2026-03-29 18:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with identifier: EF82631
2026-03-29 18:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with scrape type 2
2026-03-29 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with scrape type 2
2026-03-29 18:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b, identifier: EF82631
2026-03-29 18:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with identifier: EF82631
2026-03-29 18:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with identifier: EF82631
2026-03-29 18:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with identifier: EF82631 to the API
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:50:23Z',
'fuel_type': 'petrol',
'id': 'fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF82631',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto Evo',
'odometer': 74750,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-14',
'seller_name': None,
'title': 'Fiat Punto Evo 1.4 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2010}
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF82631%27 HTTP/1.1" 200 None
2026-03-29 18:32:34 [auto1.de] INFO: Saving data for EF82631: {'auction_closing_time': 1774885823.0, 'created_time': 1773773966.992262, 'last_price_update_time': 1774809154.660673}
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF82631') HTTP/1.1" 204 0
2026-03-29 18:32:34 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL48246%27 HTTP/1.1" 200 None
2026-03-29 18:32:34 [auto1.de] INFO: Scrape type for PL48246: 2
2026-03-29 18:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with identifier: PL48246
2026-03-29 18:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with scrape type 2
2026-03-29 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with scrape type 2
2026-03-29 18:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6, identifier: PL48246
2026-03-29 18:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with identifier: PL48246
2026-03-29 18:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with identifier: PL48246
2026-03-29 18:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with identifier: PL48246 to the API
2026-03-29 18:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:26:30Z',
'fuel_type': 'petrol',
'id': '016cb832-c848-5eb9-ad0c-7a8fe7acb9c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL48246',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 82976,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-25',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 180 Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2019}
2026-03-29 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL48246%27 HTTP/1.1" 200 None
2026-03-29 18:32:35 [auto1.de] INFO: Saving data for PL48246: {'auction_closing_time': 1774884390.0, 'created_time': 1772543840.915684, 'last_price_update_time': 1774809155.110934}
2026-03-29 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL48246') HTTP/1.1" 204 0
2026-03-29 18:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:32:42 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 6740 | hits on page: 40
2026-03-29 18:32:42 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-29 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN78852%27 HTTP/1.1" 200 None
2026-03-29 18:32:42 [auto1.de] INFO: Scrape type for BN78852: 2
2026-03-29 18:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ef4403a-87cf-5d9e-aad1-dc958444df3d with identifier: BN78852
2026-03-29 18:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d with scrape type 2
2026-03-29 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d with scrape type 2
2026-03-29 18:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ef4403a-87cf-5d9e-aad1-dc958444df3d, identifier: BN78852
2026-03-29 18:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ef4403a-87cf-5d9e-aad1-dc958444df3d with identifier: BN78852
2026-03-29 18:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ef4403a-87cf-5d9e-aad1-dc958444df3d with identifier: BN78852
2026-03-29 18:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ef4403a-87cf-5d9e-aad1-dc958444df3d with identifier: BN78852 to the API
2026-03-29 18:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 184,
'expiration_date': '2026-03-30T15:58:48Z',
'fuel_type': 'diesel',
'id': '9ef4403a-87cf-5d9e-aad1-dc958444df3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN78852',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 55493,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-04',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
'transmission': 'manual',
'trim': 'Sports-Line AWD',
'year': 2019}
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN78852%27 HTTP/1.1" 200 None
2026-03-29 18:32:43 [auto1.de] INFO: Saving data for BN78852: {'auction_closing_time': 1774886328.0, 'created_time': 1774607772.607082, 'last_price_update_time': 1774809163.108298}
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN78852') HTTP/1.1" 204 0
2026-03-29 18:32:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:32:43 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-29 18:32:43 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-29 18:32:43 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-29 18:32:43 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS72141%27 HTTP/1.1" 200 None
2026-03-29 18:32:43 [auto1.de] INFO: Scrape type for LS72141: 0
2026-03-29 18:32:43 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-29 18:32:43 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-29 18:32:43 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-29 18:32:43 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ96817%27 HTTP/1.1" 200 None
2026-03-29 18:32:43 [auto1.de] INFO: Scrape type for BZ96817: 2
2026-03-29 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8813e3d3-be1d-5c4a-ab65-59260910fd45 with identifier: BZ96817
2026-03-29 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8813e3d3-be1d-5c4a-ab65-59260910fd45 with scrape type 2
2026-03-29 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8813e3d3-be1d-5c4a-ab65-59260910fd45 with scrape type 2
2026-03-29 18:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8813e3d3-be1d-5c4a-ab65-59260910fd45, identifier: BZ96817
2026-03-29 18:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8813e3d3-be1d-5c4a-ab65-59260910fd45 with identifier: BZ96817
2026-03-29 18:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8813e3d3-be1d-5c4a-ab65-59260910fd45 with identifier: BZ96817
2026-03-29 18:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8813e3d3-be1d-5c4a-ab65-59260910fd45 with identifier: BZ96817 to the API
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:33:28Z',
'fuel_type': 'petrol',
'id': '8813e3d3-be1d-5c4a-ab65-59260910fd45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ96817',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 44288,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-24',
'seller_name': None,
'title': 'Jeep Renegade 1.4 M-Air Limited 4WD',
'transmission': 'automatic',
'trim': 'Limited 4WD',
'year': 2017}
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ96817%27 HTTP/1.1" 200 None
2026-03-29 18:32:43 [auto1.de] INFO: Saving data for BZ96817: {'auction_closing_time': 1774884808.0, 'created_time': 1773427048.339126, 'last_price_update_time': 1774809163.621294}
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ96817') HTTP/1.1" 204 0
2026-03-29 18:32:43 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94001%27 HTTP/1.1" 200 None
2026-03-29 18:32:43 [auto1.de] INFO: Scrape type for GE94001: 2
2026-03-29 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with identifier: GE94001
2026-03-29 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with scrape type 2
2026-03-29 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with scrape type 2
2026-03-29 18:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e618fac-94aa-5c5b-9e49-ba83593bfd3d, identifier: GE94001
2026-03-29 18:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with identifier: GE94001
2026-03-29 18:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with identifier: GE94001
2026-03-29 18:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with identifier: GE94001 to the API
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:35:38Z',
'fuel_type': 'diesel',
'id': '4e618fac-94aa-5c5b-9e49-ba83593bfd3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE94001',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 252005,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-27',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94001%27 HTTP/1.1" 200 None
2026-03-29 18:32:44 [auto1.de] INFO: Saving data for GE94001: {'auction_closing_time': 1774884938.0, 'created_time': 1773660205.167234, 'last_price_update_time': 1774809164.087237}
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE94001') HTTP/1.1" 204 0
2026-03-29 18:32:44 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-29 18:32:44 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-29 18:32:44 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-29 18:32:44 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM83282%27 HTTP/1.1" 200 None
2026-03-29 18:32:44 [auto1.de] INFO: Scrape type for CM83282: 0
2026-03-29 18:32:44 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ33462%27 HTTP/1.1" 200 None
2026-03-29 18:32:44 [auto1.de] INFO: Scrape type for UJ33462: 2
2026-03-29 18:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1aea173f-8d29-55f9-bff2-23473d024d4c with identifier: UJ33462
2026-03-29 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aea173f-8d29-55f9-bff2-23473d024d4c with scrape type 2
2026-03-29 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1aea173f-8d29-55f9-bff2-23473d024d4c with scrape type 2
2026-03-29 18:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1aea173f-8d29-55f9-bff2-23473d024d4c, identifier: UJ33462
2026-03-29 18:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1aea173f-8d29-55f9-bff2-23473d024d4c with identifier: UJ33462
2026-03-29 18:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1aea173f-8d29-55f9-bff2-23473d024d4c with identifier: UJ33462
2026-03-29 18:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1aea173f-8d29-55f9-bff2-23473d024d4c with identifier: UJ33462 to the API
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:34:16Z',
'fuel_type': 'petrol',
'id': '1aea173f-8d29-55f9-bff2-23473d024d4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ33462',
'listing': 'auction',
'make': 'Ford',
'model': 'Fusion',
'odometer': 149615,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-30',
'seller_name': None,
'title': 'Ford Fusion 1.4 Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2011}
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ33462%27 HTTP/1.1" 200 None
2026-03-29 18:32:44 [auto1.de] INFO: Saving data for UJ33462: {'auction_closing_time': 1774884856.0, 'created_time': 1773138689.244776, 'last_price_update_time': 1774809164.566021}
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ33462') HTTP/1.1" 204 0
2026-03-29 18:32:44 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40099%27 HTTP/1.1" 200 None
2026-03-29 18:32:44 [auto1.de] INFO: Scrape type for EJ40099: 2
2026-03-29 18:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with identifier: EJ40099
2026-03-29 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with scrape type 2
2026-03-29 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with scrape type 2
2026-03-29 18:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d6958c0-2d41-5ef8-9680-ce1b28f6a377, identifier: EJ40099
2026-03-29 18:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with identifier: EJ40099
2026-03-29 18:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with identifier: EJ40099
2026-03-29 18:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with identifier: EJ40099 to the API
2026-03-29 18:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:24:39Z',
'fuel_type': 'petrol',
'id': '8d6958c0-2d41-5ef8-9680-ce1b28f6a377',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ40099',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 113390,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-01',
'seller_name': None,
'title': 'Opel Corsa 1.2 Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2012}
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40099%27 HTTP/1.1" 200 None
2026-03-29 18:32:45 [auto1.de] INFO: Saving data for EJ40099: {'auction_closing_time': 1774884279.0, 'created_time': 1773469063.801623, 'last_price_update_time': 1774809165.143303}
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ40099') HTTP/1.1" 204 0
2026-03-29 18:32:45 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV29491%27 HTTP/1.1" 200 None
2026-03-29 18:32:45 [auto1.de] INFO: Scrape type for CV29491: 0
2026-03-29 18:32:45 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-29 18:32:45 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52465%27 HTTP/1.1" 200 None
2026-03-29 18:32:45 [auto1.de] INFO: Scrape type for RS52465: 2
2026-03-29 18:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 872c3017-0b3c-54e7-983e-91275867c156 with identifier: RS52465
2026-03-29 18:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 872c3017-0b3c-54e7-983e-91275867c156 with scrape type 2
2026-03-29 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 872c3017-0b3c-54e7-983e-91275867c156 with scrape type 2
2026-03-29 18:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 872c3017-0b3c-54e7-983e-91275867c156, identifier: RS52465
2026-03-29 18:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 872c3017-0b3c-54e7-983e-91275867c156 with identifier: RS52465
2026-03-29 18:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 872c3017-0b3c-54e7-983e-91275867c156 with identifier: RS52465
2026-03-29 18:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 872c3017-0b3c-54e7-983e-91275867c156 with identifier: RS52465 to the API
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 367,
'expiration_date': '2026-03-30T15:16:19Z',
'fuel_type': 'petrol',
'id': '872c3017-0b3c-54e7-983e-91275867c156',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS52465',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 109869,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-02',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2017}
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52465%27 HTTP/1.1" 200 None
2026-03-29 18:32:45 [auto1.de] INFO: Saving data for RS52465: {'auction_closing_time': 1774883779.0, 'created_time': 1773427714.732821, 'last_price_update_time': 1774809165.609425}
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS52465') HTTP/1.1" 204 0
2026-03-29 18:32:45 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-29 18:32:45 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-29 18:32:45 [auto1.de] INFO: Found listing with ID: BS44912
2026-03-29 18:32:45 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-29 18:32:45 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-29 18:32:45 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-29 18:32:45 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW85438%27 HTTP/1.1" 200 None
2026-03-29 18:32:45 [auto1.de] INFO: Scrape type for XW85438: 2
2026-03-29 18:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed233fae-2093-5187-848c-918828d3cf8d with identifier: XW85438
2026-03-29 18:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed233fae-2093-5187-848c-918828d3cf8d with scrape type 2
2026-03-29 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed233fae-2093-5187-848c-918828d3cf8d with scrape type 2
2026-03-29 18:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed233fae-2093-5187-848c-918828d3cf8d, identifier: XW85438
2026-03-29 18:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed233fae-2093-5187-848c-918828d3cf8d with identifier: XW85438
2026-03-29 18:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed233fae-2093-5187-848c-918828d3cf8d with identifier: XW85438
2026-03-29 18:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed233fae-2093-5187-848c-918828d3cf8d with identifier: XW85438 to the API
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:11:28Z',
'fuel_type': 'diesel',
'id': 'ed233fae-2093-5187-848c-918828d3cf8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW85438',
'listing': 'auction',
'make': 'Toyota',
'model': 'Avensis',
'odometer': 210445,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-04-30',
'seller_name': None,
'title': 'Toyota Avensis 2.2 D-4D D-Cat Executive Liftback',
'transmission': 'manual',
'trim': 'D-Cat Executive Liftback',
'year': 2007}
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW85438%27 HTTP/1.1" 200 None
2026-03-29 18:32:46 [auto1.de] INFO: Saving data for XW85438: {'auction_closing_time': 1774883488.0, 'created_time': 1774294153.149817, 'last_price_update_time': 1774809166.090567}
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW85438') HTTP/1.1" 204 0
2026-03-29 18:32:46 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72633%27 HTTP/1.1" 200 None
2026-03-29 18:32:46 [auto1.de] INFO: Scrape type for GJ72633: 2
2026-03-29 18:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38d2034b-5971-5cc1-a857-48298aecee5c with identifier: GJ72633
2026-03-29 18:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38d2034b-5971-5cc1-a857-48298aecee5c with scrape type 2
2026-03-29 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38d2034b-5971-5cc1-a857-48298aecee5c with scrape type 2
2026-03-29 18:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38d2034b-5971-5cc1-a857-48298aecee5c, identifier: GJ72633
2026-03-29 18:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38d2034b-5971-5cc1-a857-48298aecee5c with identifier: GJ72633
2026-03-29 18:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38d2034b-5971-5cc1-a857-48298aecee5c with identifier: GJ72633
2026-03-29 18:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38d2034b-5971-5cc1-a857-48298aecee5c with identifier: GJ72633 to the API
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:50:57Z',
'fuel_type': 'diesel',
'id': '38d2034b-5971-5cc1-a857-48298aecee5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ72633',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 286016,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-10',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2018}
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72633%27 HTTP/1.1" 200 None
2026-03-29 18:32:46 [auto1.de] INFO: Saving data for GJ72633: {'auction_closing_time': 1774885857.0, 'created_time': 1774521158.073127, 'last_price_update_time': 1774809166.577093}
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ72633') HTTP/1.1" 204 0
2026-03-29 18:32:46 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE78461%27 HTTP/1.1" 200 None
2026-03-29 18:32:46 [auto1.de] INFO: Scrape type for WE78461: 2
2026-03-29 18:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2649402-d15a-58da-8f45-22e6df2d71eb with identifier: WE78461
2026-03-29 18:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2649402-d15a-58da-8f45-22e6df2d71eb with scrape type 2
2026-03-29 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2649402-d15a-58da-8f45-22e6df2d71eb with scrape type 2
2026-03-29 18:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2649402-d15a-58da-8f45-22e6df2d71eb, identifier: WE78461
2026-03-29 18:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2649402-d15a-58da-8f45-22e6df2d71eb with identifier: WE78461
2026-03-29 18:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2649402-d15a-58da-8f45-22e6df2d71eb with identifier: WE78461
2026-03-29 18:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2649402-d15a-58da-8f45-22e6df2d71eb with identifier: WE78461 to the API
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:18:14Z',
'fuel_type': 'diesel',
'id': 'd2649402-d15a-58da-8f45-22e6df2d71eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE78461',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 193408,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-27',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2016}
2026-03-29 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE78461%27 HTTP/1.1" 200 None
2026-03-29 18:32:47 [auto1.de] INFO: Saving data for WE78461: {'auction_closing_time': 1774883894.0, 'created_time': 1774607624.516571, 'last_price_update_time': 1774809167.005883}
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE78461') HTTP/1.1" 204 0
2026-03-29 18:32:47 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB70854%27 HTTP/1.1" 200 None
2026-03-29 18:32:47 [auto1.de] INFO: Scrape type for BB70854: 2
2026-03-29 18:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae2fbc24-becd-59b5-8a83-2a7165984a28 with identifier: BB70854
2026-03-29 18:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae2fbc24-becd-59b5-8a83-2a7165984a28 with scrape type 2
2026-03-29 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae2fbc24-becd-59b5-8a83-2a7165984a28 with scrape type 2
2026-03-29 18:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae2fbc24-becd-59b5-8a83-2a7165984a28, identifier: BB70854
2026-03-29 18:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae2fbc24-becd-59b5-8a83-2a7165984a28 with identifier: BB70854
2026-03-29 18:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae2fbc24-becd-59b5-8a83-2a7165984a28 with identifier: BB70854
2026-03-29 18:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae2fbc24-becd-59b5-8a83-2a7165984a28 with identifier: BB70854 to the API
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:23:42Z',
'fuel_type': 'diesel',
'id': 'ae2fbc24-becd-59b5-8a83-2a7165984a28',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB70854',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 273860,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-04-27',
'seller_name': None,
'title': 'Volvo XC90 2.4 D5 Momentum',
'transmission': 'automatic',
'trim': 'Momentum',
'year': 2006}
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB70854%27 HTTP/1.1" 200 None
2026-03-29 18:32:47 [auto1.de] INFO: Saving data for BB70854: {'auction_closing_time': 1774884222.0, 'created_time': 1773398979.879557, 'last_price_update_time': 1774809167.426049}
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB70854') HTTP/1.1" 204 0
2026-03-29 18:32:47 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP85116%27 HTTP/1.1" 200 None
2026-03-29 18:32:47 [auto1.de] INFO: Scrape type for VP85116: 0
2026-03-29 18:32:47 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-29 18:32:47 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-29 18:32:47 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-29 18:32:47 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-29 18:32:47 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ88373%27 HTTP/1.1" 200 None
2026-03-29 18:32:47 [auto1.de] INFO: Scrape type for AJ88373: 2
2026-03-29 18:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with identifier: AJ88373
2026-03-29 18:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with scrape type 2
2026-03-29 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with scrape type 2
2026-03-29 18:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cb2324e-3a11-5df2-afa9-a0db06eb3189, identifier: AJ88373
2026-03-29 18:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with identifier: AJ88373
2026-03-29 18:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with identifier: AJ88373
2026-03-29 18:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with identifier: AJ88373 to the API
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:55:31Z',
'fuel_type': 'petrol',
'id': '1cb2324e-3a11-5df2-afa9-a0db06eb3189',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ88373',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 217602,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-28',
'seller_name': None,
'title': 'BMW 1er 118i',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ88373%27 HTTP/1.1" 200 None
2026-03-29 18:32:47 [auto1.de] INFO: Saving data for AJ88373: {'auction_closing_time': 1774886131.0, 'created_time': 1773466636.811886, 'last_price_update_time': 1774809167.922116}
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ88373') HTTP/1.1" 204 0
2026-03-29 18:32:47 [auto1.de] INFO: Found listing with ID: ZM17001
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM17001%27 HTTP/1.1" 200 None
2026-03-29 18:32:47 [auto1.de] INFO: Scrape type for ZM17001: 2
2026-03-29 18:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b74b62a6-8a41-539c-870c-d453d75145b9 with identifier: ZM17001
2026-03-29 18:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b74b62a6-8a41-539c-870c-d453d75145b9 with scrape type 2
2026-03-29 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b74b62a6-8a41-539c-870c-d453d75145b9 with scrape type 2
2026-03-29 18:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b74b62a6-8a41-539c-870c-d453d75145b9, identifier: ZM17001
2026-03-29 18:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b74b62a6-8a41-539c-870c-d453d75145b9 with identifier: ZM17001
2026-03-29 18:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b74b62a6-8a41-539c-870c-d453d75145b9 with identifier: ZM17001
2026-03-29 18:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b74b62a6-8a41-539c-870c-d453d75145b9 with identifier: ZM17001 to the API
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:42:34Z',
'fuel_type': 'petrol',
'id': 'b74b62a6-8a41-539c-870c-d453d75145b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM17001',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 108063,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-28',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
'transmission': 'automatic',
'trim': 'GTI "Performance" BlueMotion',
'year': 2014}
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM17001%27 HTTP/1.1" 200 None
2026-03-29 18:32:48 [auto1.de] INFO: Saving data for ZM17001: {'auction_closing_time': 1774885354.0, 'created_time': 1774722675.569035, 'last_price_update_time': 1774809168.361541}
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM17001') HTTP/1.1" 204 0
2026-03-29 18:32:48 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43942%27 HTTP/1.1" 200 None
2026-03-29 18:32:48 [auto1.de] INFO: Scrape type for HA43942: 0
2026-03-29 18:32:48 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-29 18:32:48 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-29 18:32:48 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-29 18:32:48 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 6740 | hits on page: 40
2026-03-29 18:32:48 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX50182%27 HTTP/1.1" 200 None
2026-03-29 18:32:48 [auto1.de] INFO: Scrape type for WX50182: 0
2026-03-29 18:32:48 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU31630%27 HTTP/1.1" 200 None
2026-03-29 18:32:48 [auto1.de] INFO: Scrape type for DU31630: 0
2026-03-29 18:32:48 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF91285%27 HTTP/1.1" 200 None
2026-03-29 18:32:48 [auto1.de] INFO: Scrape type for KF91285: 2
2026-03-29 18:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with identifier: KF91285
2026-03-29 18:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with scrape type 2
2026-03-29 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with scrape type 2
2026-03-29 18:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fdc03d9-bc57-5b61-b085-bce43f022bc9, identifier: KF91285
2026-03-29 18:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with identifier: KF91285
2026-03-29 18:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with identifier: KF91285
2026-03-29 18:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with identifier: KF91285 to the API
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:56:55Z',
'fuel_type': 'petrol',
'id': '4fdc03d9-bc57-5b61-b085-bce43f022bc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF91285',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 103954,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-29',
'seller_name': None,
'title': 'Peugeot 207 1.6 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2008}
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF91285%27 HTTP/1.1" 200 None
2026-03-29 18:32:48 [auto1.de] INFO: Saving data for KF91285: {'auction_closing_time': 1774886215.0, 'created_time': 1773305079.028194, 'last_price_update_time': 1774809168.91603}
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF91285') HTTP/1.1" 204 0
2026-03-29 18:32:49 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-29 18:32:49 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-29 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE25361%27 HTTP/1.1" 200 None
2026-03-29 18:32:49 [auto1.de] INFO: Scrape type for SE25361: 0
2026-03-29 18:32:49 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-29 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF17432%27 HTTP/1.1" 200 None
2026-03-29 18:32:49 [auto1.de] INFO: Scrape type for DF17432: 2
2026-03-29 18:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15fba982-c75b-5b0d-bb14-56f7808719b3 with identifier: DF17432
2026-03-29 18:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15fba982-c75b-5b0d-bb14-56f7808719b3 with scrape type 2
2026-03-29 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15fba982-c75b-5b0d-bb14-56f7808719b3 with scrape type 2
2026-03-29 18:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15fba982-c75b-5b0d-bb14-56f7808719b3, identifier: DF17432
2026-03-29 18:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15fba982-c75b-5b0d-bb14-56f7808719b3 with identifier: DF17432
2026-03-29 18:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15fba982-c75b-5b0d-bb14-56f7808719b3 with identifier: DF17432
2026-03-29 18:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15fba982-c75b-5b0d-bb14-56f7808719b3 with identifier: DF17432 to the API
2026-03-29 18:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:15:54Z',
'fuel_type': 'petrol',
'id': '15fba982-c75b-5b0d-bb14-56f7808719b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF17432',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 71020,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-07',
'seller_name': None,
'title': 'Opel Astra 1.4 SIDI Turbo Dynamic Start/Stop',
'transmission': 'manual',
'trim': 'Dynamic Start/Stop',
'year': 2017}
2026-03-29 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF17432%27 HTTP/1.1" 200 None
2026-03-29 18:32:49 [auto1.de] INFO: Saving data for DF17432: {'auction_closing_time': 1774883754.0, 'created_time': 1773138727.980088, 'last_price_update_time': 1774809169.517717}
2026-03-29 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF17432') HTTP/1.1" 204 0
2026-03-29 18:32:49 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-29 18:32:49 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-29 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN46705%27 HTTP/1.1" 200 None
2026-03-29 18:32:49 [auto1.de] INFO: Scrape type for EN46705: 2
2026-03-29 18:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3640239-69bd-5ce3-877b-7f4b6ed81c7a with identifier: EN46705
2026-03-29 18:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a with scrape type 2
2026-03-29 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a with scrape type 2
2026-03-29 18:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3640239-69bd-5ce3-877b-7f4b6ed81c7a, identifier: EN46705
2026-03-29 18:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3640239-69bd-5ce3-877b-7f4b6ed81c7a with identifier: EN46705
2026-03-29 18:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3640239-69bd-5ce3-877b-7f4b6ed81c7a with identifier: EN46705
2026-03-29 18:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3640239-69bd-5ce3-877b-7f4b6ed81c7a with identifier: EN46705 to the API
2026-03-29 18:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:22:41Z',
'fuel_type': 'diesel',
'id': 'f3640239-69bd-5ce3-877b-7f4b6ed81c7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN46705',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Caravelle',
'odometer': 368178,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-26',
'seller_name': None,
'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline lang',
'transmission': 'automatic',
'trim': 'Comfortline lang',
'year': 2017}
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN46705%27 HTTP/1.1" 200 None
2026-03-29 18:32:50 [auto1.de] INFO: Saving data for EN46705: {'auction_closing_time': 1774884161.0, 'created_time': 1774608351.743091, 'last_price_update_time': 1774809170.050586}
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN46705') HTTP/1.1" 204 0
2026-03-29 18:32:50 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68072%27 HTTP/1.1" 200 None
2026-03-29 18:32:50 [auto1.de] INFO: Scrape type for WA68072: 2
2026-03-29 18:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06692bba-450b-5ecf-900c-b803d00518f9 with identifier: WA68072
2026-03-29 18:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06692bba-450b-5ecf-900c-b803d00518f9 with scrape type 2
2026-03-29 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06692bba-450b-5ecf-900c-b803d00518f9 with scrape type 2
2026-03-29 18:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06692bba-450b-5ecf-900c-b803d00518f9, identifier: WA68072
2026-03-29 18:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06692bba-450b-5ecf-900c-b803d00518f9 with identifier: WA68072
2026-03-29 18:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06692bba-450b-5ecf-900c-b803d00518f9 with identifier: WA68072
2026-03-29 18:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06692bba-450b-5ecf-900c-b803d00518f9 with identifier: WA68072 to the API
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:09:30Z',
'fuel_type': 'diesel',
'id': '06692bba-450b-5ecf-900c-b803d00518f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA68072',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 261807,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-31',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2012}
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68072%27 HTTP/1.1" 200 None
2026-03-29 18:32:50 [auto1.de] INFO: Saving data for WA68072: {'auction_closing_time': 1774883370.0, 'created_time': 1773426767.144878, 'last_price_update_time': 1774809170.473317}
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA68072') HTTP/1.1" 204 0
2026-03-29 18:32:50 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD93100%27 HTTP/1.1" 200 None
2026-03-29 18:32:50 [auto1.de] INFO: Scrape type for CD93100: 0
2026-03-29 18:32:50 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-29 18:32:50 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-29 18:32:50 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-29 18:32:50 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-29 18:32:50 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-29 18:32:50 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55209%27 HTTP/1.1" 200 None
2026-03-29 18:32:50 [auto1.de] INFO: Scrape type for LV55209: 0
2026-03-29 18:32:50 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-29 18:32:50 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV32404%27 HTTP/1.1" 200 None
2026-03-29 18:32:50 [auto1.de] INFO: Scrape type for JV32404: 2
2026-03-29 18:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with identifier: JV32404
2026-03-29 18:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with scrape type 2
2026-03-29 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with scrape type 2
2026-03-29 18:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d2535b8-9fd6-519a-a0c4-0e668ad58837, identifier: JV32404
2026-03-29 18:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with identifier: JV32404
2026-03-29 18:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with identifier: JV32404
2026-03-29 18:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with identifier: JV32404 to the API
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 232,
'expiration_date': '2026-03-30T15:56:40Z',
'fuel_type': 'diesel',
'id': '9d2535b8-9fd6-519a-a0c4-0e668ad58837',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV32404',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 351956,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-10-18',
'seller_name': None,
'title': 'Audi A4 3.0 V6 TDI quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2006}
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV32404%27 HTTP/1.1" 200 None
2026-03-29 18:32:51 [auto1.de] INFO: Saving data for JV32404: {'auction_closing_time': 1774886200.0, 'created_time': 1773400107.858584, 'last_price_update_time': 1774809171.055094}
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV32404') HTTP/1.1" 204 0
2026-03-29 18:32:51 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33794%27 HTTP/1.1" 200 None
2026-03-29 18:32:51 [auto1.de] INFO: Scrape type for LC33794: 2
2026-03-29 18:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0 with identifier: LC33794
2026-03-29 18:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0 with scrape type 2
2026-03-29 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0 with scrape type 2
2026-03-29 18:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0, identifier: LC33794
2026-03-29 18:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0 with identifier: LC33794
2026-03-29 18:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0 with identifier: LC33794
2026-03-29 18:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0 with identifier: LC33794 to the API
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-30T15:05:03Z',
'fuel_type': 'petrol',
'id': '3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC33794',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 154230,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-14',
'seller_name': None,
'title': 'Kia Sportage 1.6 GDI Dream Team 2WD',
'transmission': 'manual',
'trim': 'Dream Team 2WD',
'year': 2018}
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33794%27 HTTP/1.1" 200 None
2026-03-29 18:32:51 [auto1.de] INFO: Saving data for LC33794: {'auction_closing_time': 1774883103.0, 'created_time': 1774522508.369997, 'last_price_update_time': 1774809171.567945}
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC33794') HTTP/1.1" 204 0
2026-03-29 18:32:51 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-29 18:32:51 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP02844%27 HTTP/1.1" 200 None
2026-03-29 18:32:51 [auto1.de] INFO: Scrape type for HP02844: 2
2026-03-29 18:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e553ccfd-61d0-5d44-88cc-e20964938d6c with identifier: HP02844
2026-03-29 18:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e553ccfd-61d0-5d44-88cc-e20964938d6c with scrape type 2
2026-03-29 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e553ccfd-61d0-5d44-88cc-e20964938d6c with scrape type 2
2026-03-29 18:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e553ccfd-61d0-5d44-88cc-e20964938d6c, identifier: HP02844
2026-03-29 18:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e553ccfd-61d0-5d44-88cc-e20964938d6c with identifier: HP02844
2026-03-29 18:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e553ccfd-61d0-5d44-88cc-e20964938d6c with identifier: HP02844
2026-03-29 18:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e553ccfd-61d0-5d44-88cc-e20964938d6c with identifier: HP02844 to the API
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 510,
'expiration_date': '2026-03-30T15:23:47Z',
'fuel_type': 'petrol',
'id': 'e553ccfd-61d0-5d44-88cc-e20964938d6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP02844',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 58472,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-13',
'seller_name': None,
'title': 'BMW 4er M4 Competition',
'transmission': 'automatic',
'trim': 'Competition',
'year': 2021}
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP02844%27 HTTP/1.1" 200 None
2026-03-29 18:32:51 [auto1.de] INFO: Saving data for HP02844: {'auction_closing_time': 1774884227.0, 'created_time': 1774349441.735659, 'last_price_update_time': 1774809171.984221}
2026-03-29 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP02844') HTTP/1.1" 204 0
2026-03-29 18:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:32:52 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04435%27 HTTP/1.1" 200 None
2026-03-29 18:32:52 [auto1.de] INFO: Scrape type for JY04435: 2
2026-03-29 18:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with identifier: JY04435
2026-03-29 18:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with scrape type 2
2026-03-29 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with scrape type 2
2026-03-29 18:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd2b0f88-1c5e-585c-8b03-0fc35bb792b6, identifier: JY04435
2026-03-29 18:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with identifier: JY04435
2026-03-29 18:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with identifier: JY04435
2026-03-29 18:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with identifier: JY04435 to the API
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:52:24Z',
'fuel_type': 'diesel',
'id': 'dd2b0f88-1c5e-585c-8b03-0fc35bb792b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY04435',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 74296,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-11',
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2020}
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04435%27 HTTP/1.1" 200 None
2026-03-29 18:32:52 [auto1.de] INFO: Saving data for JY04435: {'auction_closing_time': 1774885944.0, 'created_time': 1773306973.136709, 'last_price_update_time': 1774809172.444285}
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY04435') HTTP/1.1" 204 0
2026-03-29 18:32:52 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-29 18:32:52 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-29 18:32:52 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-29 18:32:52 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-29 18:32:52 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA32254%27 HTTP/1.1" 200 None
2026-03-29 18:32:52 [auto1.de] INFO: Scrape type for TA32254: 0
2026-03-29 18:32:52 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-29 18:32:52 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD63050%27 HTTP/1.1" 200 None
2026-03-29 18:32:52 [auto1.de] INFO: Scrape type for RD63050: 2
2026-03-29 18:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with identifier: RD63050
2026-03-29 18:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with scrape type 2
2026-03-29 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with scrape type 2
2026-03-29 18:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 373e7dad-f1ce-5295-9c9b-2c9d07066e8c, identifier: RD63050
2026-03-29 18:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with identifier: RD63050
2026-03-29 18:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with identifier: RD63050
2026-03-29 18:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with identifier: RD63050 to the API
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:14:23Z',
'fuel_type': 'diesel',
'id': '373e7dad-f1ce-5295-9c9b-2c9d07066e8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD63050',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 127550,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-14',
'seller_name': None,
'title': 'Audi Q5 40 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD63050%27 HTTP/1.1" 200 None
2026-03-29 18:32:52 [auto1.de] INFO: Saving data for RD63050: {'auction_closing_time': 1774883663.0, 'created_time': 1773307953.531655, 'last_price_update_time': 1774809172.940224}
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD63050') HTTP/1.1" 204 0
2026-03-29 18:32:53 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 6740 | hits on page: 40
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK33509%27 HTTP/1.1" 200 None
2026-03-29 18:32:53 [auto1.de] INFO: Scrape type for FK33509: 0
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28655%27 HTTP/1.1" 200 None
2026-03-29 18:32:53 [auto1.de] INFO: Scrape type for RM28655: 0
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC35382%27 HTTP/1.1" 200 None
2026-03-29 18:32:53 [auto1.de] INFO: Scrape type for KC35382: 2
2026-03-29 18:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb615a1b-1996-5280-a7b5-0122438e64ae with identifier: KC35382
2026-03-29 18:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb615a1b-1996-5280-a7b5-0122438e64ae with scrape type 2
2026-03-29 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb615a1b-1996-5280-a7b5-0122438e64ae with scrape type 2
2026-03-29 18:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb615a1b-1996-5280-a7b5-0122438e64ae, identifier: KC35382
2026-03-29 18:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb615a1b-1996-5280-a7b5-0122438e64ae with identifier: KC35382
2026-03-29 18:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb615a1b-1996-5280-a7b5-0122438e64ae with identifier: KC35382
2026-03-29 18:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb615a1b-1996-5280-a7b5-0122438e64ae with identifier: KC35382 to the API
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:58:14Z',
'fuel_type': 'diesel',
'id': 'cb615a1b-1996-5280-a7b5-0122438e64ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC35382',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 202577,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-12',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line 2WD',
'transmission': 'manual',
'trim': 'Exclusive-Line 2WD',
'year': 2016}
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC35382%27 HTTP/1.1" 200 None
2026-03-29 18:32:53 [auto1.de] INFO: Saving data for KC35382: {'auction_closing_time': 1774886294.0, 'created_time': 1774607711.85655, 'last_price_update_time': 1774809173.512455}
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC35382') HTTP/1.1" 204 0
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB57303%27 HTTP/1.1" 200 None
2026-03-29 18:32:53 [auto1.de] INFO: Scrape type for LB57303: 0
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK29715%27 HTTP/1.1" 200 None
2026-03-29 18:32:53 [auto1.de] INFO: Scrape type for CK29715: 0
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT17427%27 HTTP/1.1" 200 None
2026-03-29 18:32:53 [auto1.de] INFO: Scrape type for WT17427: 0
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX86501%27 HTTP/1.1" 200 None
2026-03-29 18:32:53 [auto1.de] INFO: Scrape type for DX86501: 0
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY38504%27 HTTP/1.1" 200 None
2026-03-29 18:32:53 [auto1.de] INFO: Scrape type for VY38504: 2
2026-03-29 18:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with identifier: VY38504
2026-03-29 18:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with scrape type 2
2026-03-29 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with scrape type 2
2026-03-29 18:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e6ea5b5-9c84-5faf-bee5-397c07a344e5, identifier: VY38504
2026-03-29 18:32:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX73478%27 HTTP/1.1" 200 None
2026-03-29 18:32:53 [auto1.de] INFO: Scrape type for WX73478: 0
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH40869%27 HTTP/1.1" 200 None
2026-03-29 18:32:53 [auto1.de] INFO: Scrape type for DH40869: 0
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-29 18:32:53 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG70910%27 HTTP/1.1" 200 None
2026-03-29 18:32:53 [auto1.de] INFO: Scrape type for WG70910: 2
2026-03-29 18:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5487ad7d-755c-502f-a860-25a0c4077329 with identifier: WG70910
2026-03-29 18:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5487ad7d-755c-502f-a860-25a0c4077329 with scrape type 2
2026-03-29 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5487ad7d-755c-502f-a860-25a0c4077329 with scrape type 2
2026-03-29 18:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5487ad7d-755c-502f-a860-25a0c4077329, identifier: WG70910
2026-03-29 18:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with identifier: VY38504
2026-03-29 18:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with identifier: VY38504
2026-03-29 18:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with identifier: VY38504 to the API
2026-03-29 18:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:04:46Z',
'fuel_type': 'petrol',
'id': '1e6ea5b5-9c84-5faf-bee5-397c07a344e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY38504',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 202407,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-14',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI Sport & Style 4Motion',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion',
'year': 2013}
2026-03-29 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY38504%27 HTTP/1.1" 200 None
2026-03-29 18:32:54 [auto1.de] INFO: Saving data for VY38504: {'auction_closing_time': 1774883086.0, 'created_time': 1773469060.326289, 'last_price_update_time': 1774809174.244294}
2026-03-29 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY38504') HTTP/1.1" 204 0
2026-03-29 18:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5487ad7d-755c-502f-a860-25a0c4077329 with identifier: WG70910
2026-03-29 18:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5487ad7d-755c-502f-a860-25a0c4077329 with identifier: WG70910
2026-03-29 18:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5487ad7d-755c-502f-a860-25a0c4077329 with identifier: WG70910 to the API
2026-03-29 18:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:53:45Z',
'fuel_type': 'diesel',
'id': '5487ad7d-755c-502f-a860-25a0c4077329',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG70910',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 155652,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-25',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TDI United',
'transmission': 'automatic',
'trim': 'United',
'year': 2021}
2026-03-29 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG70910%27 HTTP/1.1" 200 None
2026-03-29 18:32:54 [auto1.de] INFO: Saving data for WG70910: {'auction_closing_time': 1774886025.0, 'created_time': 1773304018.839119, 'last_price_update_time': 1774809174.718475}
2026-03-29 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG70910') HTTP/1.1" 204 0
2026-03-29 18:32:54 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-29 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH21308%27 HTTP/1.1" 200 None
2026-03-29 18:32:54 [auto1.de] INFO: Scrape type for JH21308: 2
2026-03-29 18:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23b91a1-eda2-53eb-b8ac-64b47f7760bc with identifier: JH21308
2026-03-29 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23b91a1-eda2-53eb-b8ac-64b47f7760bc with scrape type 2
2026-03-29 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f23b91a1-eda2-53eb-b8ac-64b47f7760bc with scrape type 2
2026-03-29 18:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f23b91a1-eda2-53eb-b8ac-64b47f7760bc, identifier: JH21308
2026-03-29 18:32:54 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-29 18:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f23b91a1-eda2-53eb-b8ac-64b47f7760bc with identifier: JH21308
2026-03-29 18:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f23b91a1-eda2-53eb-b8ac-64b47f7760bc with identifier: JH21308
2026-03-29 18:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f23b91a1-eda2-53eb-b8ac-64b47f7760bc with identifier: JH21308 to the API
2026-03-29 18:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:07:29Z',
'fuel_type': 'petrol',
'id': 'f23b91a1-eda2-53eb-b8ac-64b47f7760bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH21308',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLC-Klasse',
'odometer': 25372,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-31',
'seller_name': None,
'title': 'Mercedes-Benz SLC-Klasse SLC 200 CGI',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH21308%27 HTTP/1.1" 200 None
2026-03-29 18:32:55 [auto1.de] INFO: Saving data for JH21308: {'auction_closing_time': 1774883249.0, 'created_time': 1774034477.494268, 'last_price_update_time': 1774809175.1724}
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH21308') HTTP/1.1" 204 0
2026-03-29 18:32:55 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB88794%27 HTTP/1.1" 200 None
2026-03-29 18:32:55 [auto1.de] INFO: Scrape type for TB88794: 0
2026-03-29 18:32:55 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA01437%27 HTTP/1.1" 200 None
2026-03-29 18:32:55 [auto1.de] INFO: Scrape type for FA01437: 2
2026-03-29 18:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf7faba9-cc21-5799-99dc-585bf8cf5059 with identifier: FA01437
2026-03-29 18:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf7faba9-cc21-5799-99dc-585bf8cf5059 with scrape type 2
2026-03-29 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf7faba9-cc21-5799-99dc-585bf8cf5059 with scrape type 2
2026-03-29 18:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf7faba9-cc21-5799-99dc-585bf8cf5059, identifier: FA01437
2026-03-29 18:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf7faba9-cc21-5799-99dc-585bf8cf5059 with identifier: FA01437
2026-03-29 18:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf7faba9-cc21-5799-99dc-585bf8cf5059 with identifier: FA01437
2026-03-29 18:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf7faba9-cc21-5799-99dc-585bf8cf5059 with identifier: FA01437 to the API
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:14:52Z',
'fuel_type': 'diesel',
'id': 'cf7faba9-cc21-5799-99dc-585bf8cf5059',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA01437',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 182275,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-10',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2017}
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA01437%27 HTTP/1.1" 200 None
2026-03-29 18:32:55 [auto1.de] INFO: Saving data for FA01437: {'auction_closing_time': 1774883692.0, 'created_time': 1773468869.642692, 'last_price_update_time': 1774809175.641783}
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA01437') HTTP/1.1" 204 0
2026-03-29 18:32:55 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA69574%27 HTTP/1.1" 200 None
2026-03-29 18:32:55 [auto1.de] INFO: Scrape type for SA69574: 0
2026-03-29 18:32:55 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB54670%27 HTTP/1.1" 200 None
2026-03-29 18:32:55 [auto1.de] INFO: Scrape type for BB54670: 0
2026-03-29 18:32:55 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY94981%27 HTTP/1.1" 200 None
2026-03-29 18:32:55 [auto1.de] INFO: Scrape type for XY94981: 2
2026-03-29 18:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2e085d5-3bf4-5f8e-8239-88d6fec3b2e7 with identifier: XY94981
2026-03-29 18:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2e085d5-3bf4-5f8e-8239-88d6fec3b2e7 with scrape type 2
2026-03-29 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2e085d5-3bf4-5f8e-8239-88d6fec3b2e7 with scrape type 2
2026-03-29 18:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2e085d5-3bf4-5f8e-8239-88d6fec3b2e7, identifier: XY94981
2026-03-29 18:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2e085d5-3bf4-5f8e-8239-88d6fec3b2e7 with identifier: XY94981
2026-03-29 18:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2e085d5-3bf4-5f8e-8239-88d6fec3b2e7 with identifier: XY94981
2026-03-29 18:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2e085d5-3bf4-5f8e-8239-88d6fec3b2e7 with identifier: XY94981 to the API
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:01:59Z',
'fuel_type': 'petrol',
'id': 'd2e085d5-3bf4-5f8e-8239-88d6fec3b2e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY94981',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 87931,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-11',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 250 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2018}
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY94981%27 HTTP/1.1" 200 None
2026-03-29 18:32:56 [auto1.de] INFO: Saving data for XY94981: {'auction_closing_time': 1774882919.0, 'created_time': 1773302159.890707, 'last_price_update_time': 1774809176.091719}
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY94981') HTTP/1.1" 204 0
2026-03-29 18:32:56 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-29 18:32:56 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-29 18:32:56 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65606%27 HTTP/1.1" 200 None
2026-03-29 18:32:56 [auto1.de] INFO: Scrape type for JH65606: 0
2026-03-29 18:32:56 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-29 18:32:56 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB25597%27 HTTP/1.1" 200 None
2026-03-29 18:32:56 [auto1.de] INFO: Scrape type for DB25597: 2
2026-03-29 18:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with identifier: DB25597
2026-03-29 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with scrape type 2
2026-03-29 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with scrape type 2
2026-03-29 18:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74, identifier: DB25597
2026-03-29 18:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with identifier: DB25597
2026-03-29 18:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with identifier: DB25597
2026-03-29 18:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with identifier: DB25597 to the API
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:30:37Z',
'fuel_type': 'diesel',
'id': '0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB25597',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 253231,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-02',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2012}
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB25597%27 HTTP/1.1" 200 None
2026-03-29 18:32:56 [auto1.de] INFO: Saving data for DB25597: {'auction_closing_time': 1774884637.0, 'created_time': 1773898264.840139, 'last_price_update_time': 1774809176.555972}
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB25597') HTTP/1.1" 204 0
2026-03-29 18:32:56 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-29 18:32:56 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ38333%27 HTTP/1.1" 200 None
2026-03-29 18:32:56 [auto1.de] INFO: Scrape type for YZ38333: 2
2026-03-29 18:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fd05870-8ece-588f-b3e9-a1a146a40638 with identifier: YZ38333
2026-03-29 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fd05870-8ece-588f-b3e9-a1a146a40638 with scrape type 2
2026-03-29 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fd05870-8ece-588f-b3e9-a1a146a40638 with scrape type 2
2026-03-29 18:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fd05870-8ece-588f-b3e9-a1a146a40638, identifier: YZ38333
2026-03-29 18:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fd05870-8ece-588f-b3e9-a1a146a40638 with identifier: YZ38333
2026-03-29 18:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fd05870-8ece-588f-b3e9-a1a146a40638 with identifier: YZ38333
2026-03-29 18:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fd05870-8ece-588f-b3e9-a1a146a40638 with identifier: YZ38333 to the API
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:40:24Z',
'fuel_type': 'petrol',
'id': '1fd05870-8ece-588f-b3e9-a1a146a40638',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ38333',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 125343,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-23',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 United',
'transmission': 'manual',
'trim': 'United',
'year': 2009}
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ38333%27 HTTP/1.1" 200 None
2026-03-29 18:32:57 [auto1.de] INFO: Saving data for YZ38333: {'auction_closing_time': 1774885224.0, 'created_time': 1773776269.351749, 'last_price_update_time': 1774809177.098898}
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ38333') HTTP/1.1" 204 0
2026-03-29 18:32:57 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-29 18:32:57 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-29 18:32:57 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-29 18:32:57 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-29 18:32:57 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-29 18:32:57 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR66726%27 HTTP/1.1" 200 None
2026-03-29 18:32:57 [auto1.de] INFO: Scrape type for DR66726: 0
2026-03-29 18:32:57 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG14507%27 HTTP/1.1" 200 None
2026-03-29 18:32:57 [auto1.de] INFO: Scrape type for GG14507: 2
2026-03-29 18:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5380c6c-6f5f-547b-951a-a508a6b76001 with identifier: GG14507
2026-03-29 18:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5380c6c-6f5f-547b-951a-a508a6b76001 with scrape type 2
2026-03-29 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5380c6c-6f5f-547b-951a-a508a6b76001 with scrape type 2
2026-03-29 18:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5380c6c-6f5f-547b-951a-a508a6b76001, identifier: GG14507
2026-03-29 18:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5380c6c-6f5f-547b-951a-a508a6b76001 with identifier: GG14507
2026-03-29 18:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5380c6c-6f5f-547b-951a-a508a6b76001 with identifier: GG14507
2026-03-29 18:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5380c6c-6f5f-547b-951a-a508a6b76001 with identifier: GG14507 to the API
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:42:12Z',
'fuel_type': 'diesel',
'id': 'e5380c6c-6f5f-547b-951a-a508a6b76001',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG14507',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 300747,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-04',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 250 CDI T 4Matic BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T 4Matic BlueEfficiency Avantgarde',
'year': 2011}
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG14507%27 HTTP/1.1" 200 None
2026-03-29 18:32:57 [auto1.de] INFO: Saving data for GG14507: {'auction_closing_time': 1774885332.0, 'created_time': 1774293749.214221, 'last_price_update_time': 1774809177.552718}
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG14507') HTTP/1.1" 204 0
2026-03-29 18:32:57 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-29 18:32:57 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG84958%27 HTTP/1.1" 200 None
2026-03-29 18:32:57 [auto1.de] INFO: Scrape type for VG84958: 0
2026-03-29 18:32:57 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL40040%27 HTTP/1.1" 200 None
2026-03-29 18:32:57 [auto1.de] INFO: Scrape type for WL40040: 0
2026-03-29 18:32:57 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH25554%27 HTTP/1.1" 200 None
2026-03-29 18:32:57 [auto1.de] INFO: Scrape type for EH25554: 0
2026-03-29 18:32:57 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT97344%27 HTTP/1.1" 200 None
2026-03-29 18:32:57 [auto1.de] INFO: Scrape type for JT97344: 2
2026-03-29 18:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with identifier: JT97344
2026-03-29 18:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with scrape type 2
2026-03-29 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with scrape type 2
2026-03-29 18:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16, identifier: JT97344
2026-03-29 18:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with identifier: JT97344
2026-03-29 18:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with identifier: JT97344
2026-03-29 18:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with identifier: JT97344 to the API
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:40:46Z',
'fuel_type': 'petrol',
'id': '5e7cdcb4-4aba-585c-98fe-7da47fcbfc16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT97344',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 125822,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-02',
'seller_name': None,
'title': 'BMW 2er 218i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2015}
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT97344%27 HTTP/1.1" 200 None
2026-03-29 18:32:58 [auto1.de] INFO: Saving data for JT97344: {'auction_closing_time': 1774885246.0, 'created_time': 1774607725.328708, 'last_price_update_time': 1774809178.101418}
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT97344') HTTP/1.1" 204 0
2026-03-29 18:32:58 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG00954%27 HTTP/1.1" 200 None
2026-03-29 18:32:58 [auto1.de] INFO: Scrape type for WG00954: 2
2026-03-29 18:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fe462a8-b767-5b35-b861-127b922df1d7 with identifier: WG00954
2026-03-29 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fe462a8-b767-5b35-b861-127b922df1d7 with scrape type 2
2026-03-29 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fe462a8-b767-5b35-b861-127b922df1d7 with scrape type 2
2026-03-29 18:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fe462a8-b767-5b35-b861-127b922df1d7, identifier: WG00954
2026-03-29 18:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fe462a8-b767-5b35-b861-127b922df1d7 with identifier: WG00954
2026-03-29 18:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fe462a8-b767-5b35-b861-127b922df1d7 with identifier: WG00954
2026-03-29 18:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fe462a8-b767-5b35-b861-127b922df1d7 with identifier: WG00954 to the API
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:20:56Z',
'fuel_type': 'petrol',
'id': '6fe462a8-b767-5b35-b861-127b922df1d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG00954',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 120213,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-20',
'seller_name': None,
'title': 'Opel Corsa 1.2 Edition "111 Jahre"',
'transmission': 'manual',
'trim': 'Edition "111 Jahre"',
'year': 2011}
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG00954%27 HTTP/1.1" 200 None
2026-03-29 18:32:58 [auto1.de] INFO: Saving data for WG00954: {'auction_closing_time': 1774884056.0, 'created_time': 1774607894.251306, 'last_price_update_time': 1774809178.756704}
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG00954') HTTP/1.1" 204 0
2026-03-29 18:32:58 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-29 18:32:58 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK88723%27 HTTP/1.1" 200 None
2026-03-29 18:32:58 [auto1.de] INFO: Scrape type for YK88723: 0
2026-03-29 18:32:58 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-29 18:32:58 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF89419%27 HTTP/1.1" 200 None
2026-03-29 18:32:58 [auto1.de] INFO: Scrape type for TF89419: 0
2026-03-29 18:32:58 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-29 18:32:58 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-29 18:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:32:58 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 6740 | hits on page: 40
2026-03-29 18:32:58 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15442%27 HTTP/1.1" 200 None
2026-03-29 18:32:58 [auto1.de] INFO: Scrape type for LF15442: 2
2026-03-29 18:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with identifier: LF15442
2026-03-29 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with scrape type 2
2026-03-29 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with scrape type 2
2026-03-29 18:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d8a1e38-17c9-54b9-8f4c-3c3262128163, identifier: LF15442
2026-03-29 18:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with identifier: LF15442
2026-03-29 18:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with identifier: LF15442
2026-03-29 18:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with identifier: LF15442 to the API
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:02:50Z',
'fuel_type': 'diesel',
'id': '9d8a1e38-17c9-54b9-8f4c-3c3262128163',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF15442',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 201291,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-02',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Highline BlueMotion Tech',
'year': 2016}
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15442%27 HTTP/1.1" 200 None
2026-03-29 18:32:59 [auto1.de] INFO: Saving data for LF15442: {'auction_closing_time': 1774882970.0, 'created_time': 1773426875.995379, 'last_price_update_time': 1774809179.393538}
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF15442') HTTP/1.1" 204 0
2026-03-29 18:32:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:32:59 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP18010%27 HTTP/1.1" 200 None
2026-03-29 18:32:59 [auto1.de] INFO: Scrape type for HP18010: 2
2026-03-29 18:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ace3c96b-073d-5738-ba17-0aac289b23c1 with identifier: HP18010
2026-03-29 18:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ace3c96b-073d-5738-ba17-0aac289b23c1 with scrape type 2
2026-03-29 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ace3c96b-073d-5738-ba17-0aac289b23c1 with scrape type 2
2026-03-29 18:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ace3c96b-073d-5738-ba17-0aac289b23c1, identifier: HP18010
2026-03-29 18:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ace3c96b-073d-5738-ba17-0aac289b23c1 with identifier: HP18010
2026-03-29 18:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ace3c96b-073d-5738-ba17-0aac289b23c1 with identifier: HP18010
2026-03-29 18:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ace3c96b-073d-5738-ba17-0aac289b23c1 with identifier: HP18010 to the API
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:42:05Z',
'fuel_type': 'petrol',
'id': 'ace3c96b-073d-5738-ba17-0aac289b23c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP18010',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 131920,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-01',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2010}
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP18010%27 HTTP/1.1" 200 None
2026-03-29 18:32:59 [auto1.de] INFO: Saving data for HP18010: {'auction_closing_time': 1774885325.0, 'created_time': 1773946331.362141, 'last_price_update_time': 1774809179.835987}
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP18010') HTTP/1.1" 204 0
2026-03-29 18:32:59 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54596%27 HTTP/1.1" 200 None
2026-03-29 18:32:59 [auto1.de] INFO: Scrape type for HJ54596: 0
2026-03-29 18:32:59 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23018%27 HTTP/1.1" 200 None
2026-03-29 18:32:59 [auto1.de] INFO: Scrape type for MR23018: 2
2026-03-29 18:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20e4d939-4e07-5d3d-b5e9-7460306fa189 with identifier: MR23018
2026-03-29 18:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20e4d939-4e07-5d3d-b5e9-7460306fa189 with scrape type 2
2026-03-29 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20e4d939-4e07-5d3d-b5e9-7460306fa189 with scrape type 2
2026-03-29 18:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20e4d939-4e07-5d3d-b5e9-7460306fa189, identifier: MR23018
2026-03-29 18:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20e4d939-4e07-5d3d-b5e9-7460306fa189 with identifier: MR23018
2026-03-29 18:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20e4d939-4e07-5d3d-b5e9-7460306fa189 with identifier: MR23018
2026-03-29 18:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20e4d939-4e07-5d3d-b5e9-7460306fa189 with identifier: MR23018 to the API
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:02:56Z',
'fuel_type': 'diesel',
'id': '20e4d939-4e07-5d3d-b5e9-7460306fa189',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR23018',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 254114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-21',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2013}
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23018%27 HTTP/1.1" 200 None
2026-03-29 18:33:00 [auto1.de] INFO: Saving data for MR23018: {'auction_closing_time': 1774882976.0, 'created_time': 1773307857.020933, 'last_price_update_time': 1774809180.312157}
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR23018') HTTP/1.1" 204 0
2026-03-29 18:33:00 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-29 18:33:00 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-29 18:33:00 [auto1.de] INFO: Found listing with ID: JL88490
2026-03-29 18:33:00 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-29 18:33:00 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-29 18:33:00 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87000%27 HTTP/1.1" 200 None
2026-03-29 18:33:00 [auto1.de] INFO: Scrape type for HP87000: 0
2026-03-29 18:33:00 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-29 18:33:00 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-29 18:33:00 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-29 18:33:00 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35615%27 HTTP/1.1" 200 None
2026-03-29 18:33:00 [auto1.de] INFO: Scrape type for HZ35615: 0
2026-03-29 18:33:00 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-29 18:33:00 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK99321%27 HTTP/1.1" 200 None
2026-03-29 18:33:00 [auto1.de] INFO: Scrape type for SK99321: 0
2026-03-29 18:33:00 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-29 18:33:00 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ11294%27 HTTP/1.1" 200 None
2026-03-29 18:33:00 [auto1.de] INFO: Scrape type for HJ11294: 2
2026-03-29 18:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with identifier: HJ11294
2026-03-29 18:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with scrape type 2
2026-03-29 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with scrape type 2
2026-03-29 18:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd7549f7-c69e-5a96-b13b-3aa8c51f7459, identifier: HJ11294
2026-03-29 18:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with identifier: HJ11294
2026-03-29 18:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with identifier: HJ11294
2026-03-29 18:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with identifier: HJ11294 to the API
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:17:58Z',
'fuel_type': 'diesel',
'id': 'fd7549f7-c69e-5a96-b13b-3aa8c51f7459',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ11294',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 146693,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-11',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ11294%27 HTTP/1.1" 200 None
2026-03-29 18:33:00 [auto1.de] INFO: Saving data for HJ11294: {'auction_closing_time': 1774883878.0, 'created_time': 1773302707.12766, 'last_price_update_time': 1774809180.929998}
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ11294') HTTP/1.1" 204 0
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER42295%27 HTTP/1.1" 200 None
2026-03-29 18:33:01 [auto1.de] INFO: Scrape type for ER42295: 0
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL53901%27 HTTP/1.1" 200 None
2026-03-29 18:33:01 [auto1.de] INFO: Scrape type for SL53901: 2
2026-03-29 18:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a8432f3-4b26-593b-b06f-581645d131fe with identifier: SL53901
2026-03-29 18:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a8432f3-4b26-593b-b06f-581645d131fe with scrape type 2
2026-03-29 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a8432f3-4b26-593b-b06f-581645d131fe with scrape type 2
2026-03-29 18:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a8432f3-4b26-593b-b06f-581645d131fe, identifier: SL53901
2026-03-29 18:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a8432f3-4b26-593b-b06f-581645d131fe with identifier: SL53901
2026-03-29 18:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a8432f3-4b26-593b-b06f-581645d131fe with identifier: SL53901
2026-03-29 18:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a8432f3-4b26-593b-b06f-581645d131fe with identifier: SL53901 to the API
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:16:28Z',
'fuel_type': 'diesel',
'id': '3a8432f3-4b26-593b-b06f-581645d131fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL53901',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Citan',
'odometer': 32749,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-05',
'seller_name': None,
'title': 'Mercedes-Benz Citan 110 CDI Worker Plus',
'transmission': 'manual',
'trim': 'Worker Plus',
'year': 2022}
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL53901%27 HTTP/1.1" 200 None
2026-03-29 18:33:01 [auto1.de] INFO: Saving data for SL53901: {'auction_closing_time': 1774883788.0, 'created_time': 1774636254.105925, 'last_price_update_time': 1774809181.505678}
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL53901') HTTP/1.1" 204 0
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC59357%27 HTTP/1.1" 200 None
2026-03-29 18:33:01 [auto1.de] INFO: Scrape type for DC59357: 0
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-29 18:33:01 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW94281%27 HTTP/1.1" 200 None
2026-03-29 18:33:01 [auto1.de] INFO: Scrape type for DW94281: 2
2026-03-29 18:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 192065ea-4837-5530-b55a-136c4bd63fb6 with identifier: DW94281
2026-03-29 18:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 192065ea-4837-5530-b55a-136c4bd63fb6 with scrape type 2
2026-03-29 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 192065ea-4837-5530-b55a-136c4bd63fb6 with scrape type 2
2026-03-29 18:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 192065ea-4837-5530-b55a-136c4bd63fb6, identifier: DW94281
2026-03-29 18:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 192065ea-4837-5530-b55a-136c4bd63fb6 with identifier: DW94281
2026-03-29 18:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 192065ea-4837-5530-b55a-136c4bd63fb6 with identifier: DW94281
2026-03-29 18:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 192065ea-4837-5530-b55a-136c4bd63fb6 with identifier: DW94281 to the API
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:33:21Z',
'fuel_type': 'petrol',
'id': '192065ea-4837-5530-b55a-136c4bd63fb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW94281',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 188120,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-31',
'seller_name': None,
'title': 'Ford Focus 1.6 Viva',
'transmission': 'manual',
'trim': 'Viva',
'year': 2010}
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW94281%27 HTTP/1.1" 200 None
2026-03-29 18:33:01 [auto1.de] INFO: Saving data for DW94281: {'auction_closing_time': 1774884801.0, 'created_time': 1773399868.924884, 'last_price_update_time': 1774809181.995143}
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW94281') HTTP/1.1" 204 0
2026-03-29 18:33:02 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD47640%27 HTTP/1.1" 200 None
2026-03-29 18:33:02 [auto1.de] INFO: Scrape type for VD47640: 2
2026-03-29 18:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54967f61-1aaa-5902-8603-1d7d74a7eb13 with identifier: VD47640
2026-03-29 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54967f61-1aaa-5902-8603-1d7d74a7eb13 with scrape type 2
2026-03-29 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54967f61-1aaa-5902-8603-1d7d74a7eb13 with scrape type 2
2026-03-29 18:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54967f61-1aaa-5902-8603-1d7d74a7eb13, identifier: VD47640
2026-03-29 18:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54967f61-1aaa-5902-8603-1d7d74a7eb13 with identifier: VD47640
2026-03-29 18:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54967f61-1aaa-5902-8603-1d7d74a7eb13 with identifier: VD47640
2026-03-29 18:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54967f61-1aaa-5902-8603-1d7d74a7eb13 with identifier: VD47640 to the API
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:29:20Z',
'fuel_type': 'petrol',
'id': '54967f61-1aaa-5902-8603-1d7d74a7eb13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD47640',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 282939,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-07-24',
'seller_name': None,
'title': 'Volkswagen Touran 1.6 United',
'transmission': 'manual',
'trim': 'United',
'year': 2008}
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD47640%27 HTTP/1.1" 200 None
2026-03-29 18:33:02 [auto1.de] INFO: Saving data for VD47640: {'auction_closing_time': 1774884560.0, 'created_time': 1774607731.474976, 'last_price_update_time': 1774809182.5519}
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD47640') HTTP/1.1" 204 0
2026-03-29 18:33:02 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-29 18:33:02 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV26569%27 HTTP/1.1" 200 None
2026-03-29 18:33:02 [auto1.de] INFO: Scrape type for UV26569: 0
2026-03-29 18:33:02 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-29 18:33:02 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD15809%27 HTTP/1.1" 200 None
2026-03-29 18:33:02 [auto1.de] INFO: Scrape type for LD15809: 0
2026-03-29 18:33:02 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-29 18:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:33:02 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 6740 | hits on page: 40
2026-03-29 18:33:02 [auto1.de] INFO: Found listing with ID: KV36004
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV36004%27 HTTP/1.1" 200 None
2026-03-29 18:33:02 [auto1.de] INFO: Scrape type for KV36004: 2
2026-03-29 18:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d with identifier: KV36004
2026-03-29 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d with scrape type 2
2026-03-29 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d with scrape type 2
2026-03-29 18:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d, identifier: KV36004
2026-03-29 18:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d with identifier: KV36004
2026-03-29 18:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d with identifier: KV36004
2026-03-29 18:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d with identifier: KV36004 to the API
2026-03-29 18:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:05:27Z',
'fuel_type': 'diesel',
'id': '1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV36004',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 270105,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-20',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2012}
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV36004%27 HTTP/1.1" 200 None
2026-03-29 18:33:03 [auto1.de] INFO: Saving data for KV36004: {'auction_closing_time': 1774883127.0, 'created_time': 1774722685.968977, 'last_price_update_time': 1774809183.136821}
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV36004') HTTP/1.1" 204 0
2026-03-29 18:33:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH75068%27 HTTP/1.1" 200 None
2026-03-29 18:33:03 [auto1.de] INFO: Scrape type for TH75068: 0
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ25562%27 HTTP/1.1" 200 None
2026-03-29 18:33:03 [auto1.de] INFO: Scrape type for JZ25562: 0
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ96778%27 HTTP/1.1" 200 None
2026-03-29 18:33:03 [auto1.de] INFO: Scrape type for JZ96778: 2
2026-03-29 18:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ced0e941-4b30-58ce-865e-e5008967fd8f with identifier: JZ96778
2026-03-29 18:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ced0e941-4b30-58ce-865e-e5008967fd8f with scrape type 2
2026-03-29 18:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ced0e941-4b30-58ce-865e-e5008967fd8f with scrape type 2
2026-03-29 18:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ced0e941-4b30-58ce-865e-e5008967fd8f, identifier: JZ96778
2026-03-29 18:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ced0e941-4b30-58ce-865e-e5008967fd8f with identifier: JZ96778
2026-03-29 18:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ced0e941-4b30-58ce-865e-e5008967fd8f with identifier: JZ96778
2026-03-29 18:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ced0e941-4b30-58ce-865e-e5008967fd8f with identifier: JZ96778 to the API
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:31:01Z',
'fuel_type': 'diesel',
'id': 'ced0e941-4b30-58ce-865e-e5008967fd8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ96778',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 243132,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-13',
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
'transmission': 'automatic',
'trim': 'BlueMotion',
'year': 2012}
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ96778%27 HTTP/1.1" 200 None
2026-03-29 18:33:03 [auto1.de] INFO: Saving data for JZ96778: {'auction_closing_time': 1774884661.0, 'created_time': 1774607648.338541, 'last_price_update_time': 1774809183.651882}
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ96778') HTTP/1.1" 204 0
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX84018%27 HTTP/1.1" 200 None
2026-03-29 18:33:03 [auto1.de] INFO: Scrape type for EX84018: 0
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX95086%27 HTTP/1.1" 200 None
2026-03-29 18:33:03 [auto1.de] INFO: Scrape type for SX95086: 0
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL93555%27 HTTP/1.1" 200 None
2026-03-29 18:33:03 [auto1.de] INFO: Scrape type for AL93555: 0
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF74811%27 HTTP/1.1" 200 None
2026-03-29 18:33:03 [auto1.de] INFO: Scrape type for ZF74811: 0
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE98572%27 HTTP/1.1" 200 None
2026-03-29 18:33:03 [auto1.de] INFO: Scrape type for KE98572: 0
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09519%27 HTTP/1.1" 200 None
2026-03-29 18:33:03 [auto1.de] INFO: Scrape type for WE09519: 0
2026-03-29 18:33:03 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF84548%27 HTTP/1.1" 200 None
2026-03-29 18:33:03 [auto1.de] INFO: Scrape type for CF84548: 2
2026-03-29 18:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cb5ca63-2080-5f02-9c0c-d701d0603bb5 with identifier: CF84548
2026-03-29 18:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cb5ca63-2080-5f02-9c0c-d701d0603bb5 with scrape type 2
2026-03-29 18:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cb5ca63-2080-5f02-9c0c-d701d0603bb5 with scrape type 2
2026-03-29 18:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2cb5ca63-2080-5f02-9c0c-d701d0603bb5, identifier: CF84548
2026-03-29 18:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2cb5ca63-2080-5f02-9c0c-d701d0603bb5 with identifier: CF84548
2026-03-29 18:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2cb5ca63-2080-5f02-9c0c-d701d0603bb5 with identifier: CF84548
2026-03-29 18:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2cb5ca63-2080-5f02-9c0c-d701d0603bb5 with identifier: CF84548 to the API
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:12:45Z',
'fuel_type': 'petrol',
'id': '2cb5ca63-2080-5f02-9c0c-d701d0603bb5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF84548',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 239995,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-28',
'seller_name': None,
'title': 'Skoda Fabia 1.4 Young',
'transmission': 'manual',
'trim': 'Young',
'year': 2009}
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF84548%27 HTTP/1.1" 200 None
2026-03-29 18:33:04 [auto1.de] INFO: Saving data for CF84548: {'auction_closing_time': 1774883565.0, 'created_time': 1774031483.038633, 'last_price_update_time': 1774809184.262599}
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF84548') HTTP/1.1" 204 0
2026-03-29 18:33:04 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE96933%27 HTTP/1.1" 200 None
2026-03-29 18:33:04 [auto1.de] INFO: Scrape type for HE96933: 2
2026-03-29 18:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with identifier: HE96933
2026-03-29 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with scrape type 2
2026-03-29 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with scrape type 2
2026-03-29 18:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce, identifier: HE96933
2026-03-29 18:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with identifier: HE96933
2026-03-29 18:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with identifier: HE96933
2026-03-29 18:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with identifier: HE96933 to the API
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:18:57Z',
'fuel_type': 'diesel',
'id': '82c9a233-8f06-5e3b-a244-71c5b7cfc8ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE96933',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand C-Max',
'odometer': 244830,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-07',
'seller_name': None,
'title': 'Ford Grand C-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2011}
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE96933%27 HTTP/1.1" 200 None
2026-03-29 18:33:04 [auto1.de] INFO: Saving data for HE96933: {'auction_closing_time': 1774883937.0, 'created_time': 1773305051.836881, 'last_price_update_time': 1774809184.944553}
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE96933') HTTP/1.1" 204 0
2026-03-29 18:33:04 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD70113%27 HTTP/1.1" 200 None
2026-03-29 18:33:04 [auto1.de] INFO: Scrape type for JD70113: 0
2026-03-29 18:33:04 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-29 18:33:04 [auto1.de] INFO: Found listing with ID: TH33543
2026-03-29 18:33:04 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-29 18:33:04 [auto1.de] INFO: Found listing with ID: TD06456
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD06456%27 HTTP/1.1" 200 None
2026-03-29 18:33:04 [auto1.de] INFO: Scrape type for TD06456: 2
2026-03-29 18:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9315ac04-4684-569c-b4fa-4b70ff8f16cb with identifier: TD06456
2026-03-29 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9315ac04-4684-569c-b4fa-4b70ff8f16cb with scrape type 2
2026-03-29 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9315ac04-4684-569c-b4fa-4b70ff8f16cb with scrape type 2
2026-03-29 18:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9315ac04-4684-569c-b4fa-4b70ff8f16cb, identifier: TD06456
2026-03-29 18:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9315ac04-4684-569c-b4fa-4b70ff8f16cb with identifier: TD06456
2026-03-29 18:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9315ac04-4684-569c-b4fa-4b70ff8f16cb with identifier: TD06456
2026-03-29 18:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9315ac04-4684-569c-b4fa-4b70ff8f16cb with identifier: TD06456 to the API
2026-03-29 18:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 325,
'expiration_date': '2026-03-30T15:23:26Z',
'fuel_type': 'diesel',
'id': '9315ac04-4684-569c-b4fa-4b70ff8f16cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD06456',
'listing': 'auction',
'make': 'Audi',
'model': 'SQ5',
'odometer': 138299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-15',
'seller_name': None,
'title': 'Audi SQ5 3.0 V6 TDI quattro Competition',
'transmission': 'automatic',
'trim': 'quattro Competition',
'year': 2017}
2026-03-29 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD06456%27 HTTP/1.1" 200 None
2026-03-29 18:33:05 [auto1.de] INFO: Saving data for TD06456: {'auction_closing_time': 1774884206.0, 'created_time': 1774349175.336749, 'last_price_update_time': 1774809185.37421}
2026-03-29 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD06456') HTTP/1.1" 204 0
2026-03-29 18:33:05 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-29 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT71149%27 HTTP/1.1" 200 None
2026-03-29 18:33:05 [auto1.de] INFO: Scrape type for XT71149: 2
2026-03-29 18:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4 with identifier: XT71149
2026-03-29 18:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4 with scrape type 2
2026-03-29 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4 with scrape type 2
2026-03-29 18:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4, identifier: XT71149
2026-03-29 18:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4 with identifier: XT71149
2026-03-29 18:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4 with identifier: XT71149
2026-03-29 18:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4 with identifier: XT71149 to the API
2026-03-29 18:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:35:35Z',
'fuel_type': 'diesel',
'id': '3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT71149',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 210635,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-31',
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-29 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT71149%27 HTTP/1.1" 200 None
2026-03-29 18:33:06 [auto1.de] INFO: Saving data for XT71149: {'auction_closing_time': 1774884935.0, 'created_time': 1773466882.38484, 'last_price_update_time': 1774809186.984503}
2026-03-29 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT71149') HTTP/1.1" 204 0
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS14523%27 HTTP/1.1" 200 None
2026-03-29 18:33:07 [auto1.de] INFO: Scrape type for NS14523: 0
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU38157%27 HTTP/1.1" 200 None
2026-03-29 18:33:07 [auto1.de] INFO: Scrape type for NU38157: 0
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV77194%27 HTTP/1.1" 200 None
2026-03-29 18:33:07 [auto1.de] INFO: Scrape type for JV77194: 0
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73044%27 HTTP/1.1" 200 None
2026-03-29 18:33:07 [auto1.de] INFO: Scrape type for DG73044: 0
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB72988%27 HTTP/1.1" 200 None
2026-03-29 18:33:07 [auto1.de] INFO: Scrape type for AB72988: 0
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31495%27 HTTP/1.1" 200 None
2026-03-29 18:33:07 [auto1.de] INFO: Scrape type for BA31495: 0
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26589%27 HTTP/1.1" 200 None
2026-03-29 18:33:07 [auto1.de] INFO: Scrape type for XN26589: 2
2026-03-29 18:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74897efa-cfcb-5863-93d9-b0587ef97589 with identifier: XN26589
2026-03-29 18:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74897efa-cfcb-5863-93d9-b0587ef97589 with scrape type 2
2026-03-29 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74897efa-cfcb-5863-93d9-b0587ef97589 with scrape type 2
2026-03-29 18:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74897efa-cfcb-5863-93d9-b0587ef97589, identifier: XN26589
2026-03-29 18:33:07 [scrapy.extensions.logstats] INFO: Crawled 42 pages (at 9 pages/min), scraped 165 items (at 98 items/min)
2026-03-29 18:33:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74897efa-cfcb-5863-93d9-b0587ef97589 with identifier: XN26589
2026-03-29 18:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74897efa-cfcb-5863-93d9-b0587ef97589 with identifier: XN26589
2026-03-29 18:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74897efa-cfcb-5863-93d9-b0587ef97589 with identifier: XN26589 to the API
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:51:29Z',
'fuel_type': 'diesel',
'id': '74897efa-cfcb-5863-93d9-b0587ef97589',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN26589',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 208478,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-06',
'seller_name': None,
'title': 'BMW 3er 320d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2013}
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26589%27 HTTP/1.1" 200 None
2026-03-29 18:33:07 [auto1.de] INFO: Saving data for XN26589: {'auction_closing_time': 1774885889.0, 'created_time': 1774608401.123056, 'last_price_update_time': 1774809187.554053}
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN26589') HTTP/1.1" 204 0
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ53831%27 HTTP/1.1" 200 None
2026-03-29 18:33:07 [auto1.de] INFO: Scrape type for LJ53831: 0
2026-03-29 18:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:33:07 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 6740 | hits on page: 40
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11203%27 HTTP/1.1" 200 None
2026-03-29 18:33:07 [auto1.de] INFO: Scrape type for UL11203: 0
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE93045%27 HTTP/1.1" 200 None
2026-03-29 18:33:07 [auto1.de] INFO: Scrape type for AE93045: 0
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: US43373
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30949%27 HTTP/1.1" 200 None
2026-03-29 18:33:07 [auto1.de] INFO: Scrape type for ZL30949: 0
2026-03-29 18:33:07 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82608%27 HTTP/1.1" 200 None
2026-03-29 18:33:07 [auto1.de] INFO: Scrape type for SA82608: 2
2026-03-29 18:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with identifier: SA82608
2026-03-29 18:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with scrape type 2
2026-03-29 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with scrape type 2
2026-03-29 18:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a09a46bf-24eb-5a77-8f2d-815a0973ddf4, identifier: SA82608
2026-03-29 18:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with identifier: SA82608
2026-03-29 18:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with identifier: SA82608
2026-03-29 18:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with identifier: SA82608 to the API
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:48:08Z',
'fuel_type': 'petrol',
'id': 'a09a46bf-24eb-5a77-8f2d-815a0973ddf4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA82608',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 7544,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-23',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2020}
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82608%27 HTTP/1.1" 200 None
2026-03-29 18:33:08 [auto1.de] INFO: Saving data for SA82608: {'auction_closing_time': 1774885688.0, 'created_time': 1773660078.102642, 'last_price_update_time': 1774809188.390974}
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA82608') HTTP/1.1" 204 0
2026-03-29 18:33:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:33:08 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ78567%27 HTTP/1.1" 200 None
2026-03-29 18:33:08 [auto1.de] INFO: Scrape type for BZ78567: 0
2026-03-29 18:33:08 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-29 18:33:08 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG96363%27 HTTP/1.1" 200 None
2026-03-29 18:33:08 [auto1.de] INFO: Scrape type for WG96363: 2
2026-03-29 18:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2049c80d-8e00-5e96-ae1f-ad568d2d9583 with identifier: WG96363
2026-03-29 18:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2049c80d-8e00-5e96-ae1f-ad568d2d9583 with scrape type 2
2026-03-29 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2049c80d-8e00-5e96-ae1f-ad568d2d9583 with scrape type 2
2026-03-29 18:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2049c80d-8e00-5e96-ae1f-ad568d2d9583, identifier: WG96363
2026-03-29 18:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2049c80d-8e00-5e96-ae1f-ad568d2d9583 with identifier: WG96363
2026-03-29 18:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2049c80d-8e00-5e96-ae1f-ad568d2d9583 with identifier: WG96363
2026-03-29 18:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2049c80d-8e00-5e96-ae1f-ad568d2d9583 with identifier: WG96363 to the API
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:01:25Z',
'fuel_type': 'petrol',
'id': '2049c80d-8e00-5e96-ae1f-ad568d2d9583',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG96363',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 304199,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-08',
'seller_name': None,
'title': 'Volkswagen Touran 1.4 TSI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2007}
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG96363%27 HTTP/1.1" 200 None
2026-03-29 18:33:08 [auto1.de] INFO: Saving data for WG96363: {'auction_closing_time': 1774882885.0, 'created_time': 1774522499.680884, 'last_price_update_time': 1774809188.821226}
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG96363') HTTP/1.1" 204 0
2026-03-29 18:33:08 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC62608%27 HTTP/1.1" 200 None
2026-03-29 18:33:08 [auto1.de] INFO: Scrape type for ZC62608: 2
2026-03-29 18:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a72532a-4689-5c03-9d16-9e00acd0c1ed with identifier: ZC62608
2026-03-29 18:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a72532a-4689-5c03-9d16-9e00acd0c1ed with scrape type 2
2026-03-29 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a72532a-4689-5c03-9d16-9e00acd0c1ed with scrape type 2
2026-03-29 18:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a72532a-4689-5c03-9d16-9e00acd0c1ed, identifier: ZC62608
2026-03-29 18:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a72532a-4689-5c03-9d16-9e00acd0c1ed with identifier: ZC62608
2026-03-29 18:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a72532a-4689-5c03-9d16-9e00acd0c1ed with identifier: ZC62608
2026-03-29 18:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a72532a-4689-5c03-9d16-9e00acd0c1ed with identifier: ZC62608 to the API
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 145,
'expiration_date': '2026-03-30T15:22:31Z',
'fuel_type': 'diesel',
'id': '6a72532a-4689-5c03-9d16-9e00acd0c1ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC62608',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 78140,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-22',
'seller_name': None,
'title': 'Renault Trafic 2.0 dCi L2H1 3,0t Komfort',
'transmission': 'manual',
'trim': 'L2H1 3,0t Komfort',
'year': 2021}
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC62608%27 HTTP/1.1" 200 None
2026-03-29 18:33:09 [auto1.de] INFO: Saving data for ZC62608: {'auction_closing_time': 1774884151.0, 'created_time': 1773774740.948386, 'last_price_update_time': 1774809189.384935}
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC62608') HTTP/1.1" 204 0
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS52652%27 HTTP/1.1" 200 None
2026-03-29 18:33:09 [auto1.de] INFO: Scrape type for PS52652: 0
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP99772%27 HTTP/1.1" 200 None
2026-03-29 18:33:09 [auto1.de] INFO: Scrape type for CP99772: 0
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU77879%27 HTTP/1.1" 200 None
2026-03-29 18:33:09 [auto1.de] INFO: Scrape type for MU77879: 0
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ44121%27 HTTP/1.1" 200 None
2026-03-29 18:33:09 [auto1.de] INFO: Scrape type for VJ44121: 2
2026-03-29 18:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 465d821b-8521-53ac-abd8-97b7f86f927e with identifier: VJ44121
2026-03-29 18:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 465d821b-8521-53ac-abd8-97b7f86f927e with scrape type 2
2026-03-29 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 465d821b-8521-53ac-abd8-97b7f86f927e with scrape type 2
2026-03-29 18:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 465d821b-8521-53ac-abd8-97b7f86f927e, identifier: VJ44121
2026-03-29 18:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 465d821b-8521-53ac-abd8-97b7f86f927e with identifier: VJ44121
2026-03-29 18:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 465d821b-8521-53ac-abd8-97b7f86f927e with identifier: VJ44121
2026-03-29 18:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 465d821b-8521-53ac-abd8-97b7f86f927e with identifier: VJ44121 to the API
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:17:18Z',
'fuel_type': 'diesel',
'id': '465d821b-8521-53ac-abd8-97b7f86f927e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ44121',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 216972,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-28',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2012}
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ44121%27 HTTP/1.1" 200 None
2026-03-29 18:33:09 [auto1.de] INFO: Saving data for VJ44121: {'auction_closing_time': 1774883838.0, 'created_time': 1774521687.857479, 'last_price_update_time': 1774809189.842555}
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ44121') HTTP/1.1" 204 0
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY16661%27 HTTP/1.1" 200 None
2026-03-29 18:33:09 [auto1.de] INFO: Scrape type for SY16661: 0
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77262%27 HTTP/1.1" 200 None
2026-03-29 18:33:09 [auto1.de] INFO: Scrape type for DW77262: 0
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-29 18:33:09 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-29 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ49091%27 HTTP/1.1" 200 None
2026-03-29 18:33:10 [auto1.de] INFO: Scrape type for FZ49091: 2
2026-03-29 18:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793 with identifier: FZ49091
2026-03-29 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793 with scrape type 2
2026-03-29 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793 with scrape type 2
2026-03-29 18:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793, identifier: FZ49091
2026-03-29 18:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793 with identifier: FZ49091
2026-03-29 18:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793 with identifier: FZ49091
2026-03-29 18:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793 with identifier: FZ49091 to the API
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:24:49Z',
'fuel_type': 'diesel',
'id': '6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ49091',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 244217,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-24',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.9 TDI United',
'transmission': 'manual',
'trim': 'United',
'year': 2008}
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ49091%27 HTTP/1.1" 200 None
2026-03-29 18:33:10 [auto1.de] INFO: Saving data for FZ49091: {'auction_closing_time': 1774884289.0, 'created_time': 1773467880.312678, 'last_price_update_time': 1774809190.397054}
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ49091') HTTP/1.1" 204 0
2026-03-29 18:33:10 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-29 18:33:10 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW56805%27 HTTP/1.1" 200 None
2026-03-29 18:33:10 [auto1.de] INFO: Scrape type for PW56805: 2
2026-03-29 18:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caff4273-ad1e-5925-b420-08df34cd9682 with identifier: PW56805
2026-03-29 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caff4273-ad1e-5925-b420-08df34cd9682 with scrape type 2
2026-03-29 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caff4273-ad1e-5925-b420-08df34cd9682 with scrape type 2
2026-03-29 18:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caff4273-ad1e-5925-b420-08df34cd9682, identifier: PW56805
2026-03-29 18:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caff4273-ad1e-5925-b420-08df34cd9682 with identifier: PW56805
2026-03-29 18:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caff4273-ad1e-5925-b420-08df34cd9682 with identifier: PW56805
2026-03-29 18:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caff4273-ad1e-5925-b420-08df34cd9682 with identifier: PW56805 to the API
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:29:35Z',
'fuel_type': 'diesel',
'id': 'caff4273-ad1e-5925-b420-08df34cd9682',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW56805',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 149304,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-28',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'manual',
'trim': '',
'year': 2016}
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW56805%27 HTTP/1.1" 200 None
2026-03-29 18:33:10 [auto1.de] INFO: Saving data for PW56805: {'auction_closing_time': 1774884575.0, 'created_time': 1773660454.240943, 'last_price_update_time': 1774809190.932118}
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW56805') HTTP/1.1" 204 0
2026-03-29 18:33:10 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-29 18:33:10 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-29 18:33:10 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-29 18:33:10 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN95277%27 HTTP/1.1" 200 None
2026-03-29 18:33:10 [auto1.de] INFO: Scrape type for VN95277: 2
2026-03-29 18:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dde03c7a-e316-5370-8e1d-50c5ccd2f772 with identifier: VN95277
2026-03-29 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dde03c7a-e316-5370-8e1d-50c5ccd2f772 with scrape type 2
2026-03-29 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dde03c7a-e316-5370-8e1d-50c5ccd2f772 with scrape type 2
2026-03-29 18:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dde03c7a-e316-5370-8e1d-50c5ccd2f772, identifier: VN95277
2026-03-29 18:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dde03c7a-e316-5370-8e1d-50c5ccd2f772 with identifier: VN95277
2026-03-29 18:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dde03c7a-e316-5370-8e1d-50c5ccd2f772 with identifier: VN95277
2026-03-29 18:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dde03c7a-e316-5370-8e1d-50c5ccd2f772 with identifier: VN95277 to the API
2026-03-29 18:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:55:45Z',
'fuel_type': 'diesel',
'id': 'dde03c7a-e316-5370-8e1d-50c5ccd2f772',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN95277',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 252462,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-02',
'seller_name': None,
'title': 'BMW 3er 320d GT',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN95277%27 HTTP/1.1" 200 None
2026-03-29 18:33:11 [auto1.de] INFO: Saving data for VN95277: {'auction_closing_time': 1774886145.0, 'created_time': 1774262589.516157, 'last_price_update_time': 1774809191.396154}
2026-03-29 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN95277') HTTP/1.1" 204 0
2026-03-29 18:33:11 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-29 18:33:11 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-29 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB91859%27 HTTP/1.1" 200 None
2026-03-29 18:33:11 [auto1.de] INFO: Scrape type for XB91859: 0
2026-03-29 18:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:33:12 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 6740 | hits on page: 40
2026-03-29 18:33:12 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-29 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF62239%27 HTTP/1.1" 200 None
2026-03-29 18:33:12 [auto1.de] INFO: Scrape type for GF62239: 2
2026-03-29 18:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fa94e8c-48c3-5744-a920-05845ee84e20 with identifier: GF62239
2026-03-29 18:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fa94e8c-48c3-5744-a920-05845ee84e20 with scrape type 2
2026-03-29 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fa94e8c-48c3-5744-a920-05845ee84e20 with scrape type 2
2026-03-29 18:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fa94e8c-48c3-5744-a920-05845ee84e20, identifier: GF62239
2026-03-29 18:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fa94e8c-48c3-5744-a920-05845ee84e20 with identifier: GF62239
2026-03-29 18:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fa94e8c-48c3-5744-a920-05845ee84e20 with identifier: GF62239
2026-03-29 18:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fa94e8c-48c3-5744-a920-05845ee84e20 with identifier: GF62239 to the API
2026-03-29 18:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:52:17Z',
'fuel_type': 'diesel',
'id': '8fa94e8c-48c3-5744-a920-05845ee84e20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF62239',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto Evo',
'odometer': 179392,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-19',
'seller_name': None,
'title': 'Fiat Punto Evo 1.3 JTD Cult',
'transmission': 'manual',
'trim': 'Cult',
'year': 2014}
2026-03-29 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF62239%27 HTTP/1.1" 200 None
2026-03-29 18:33:12 [auto1.de] INFO: Saving data for GF62239: {'auction_closing_time': 1774885937.0, 'created_time': 1773399870.549056, 'last_price_update_time': 1774809192.871736}
2026-03-29 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF62239') HTTP/1.1" 204 0
2026-03-29 18:33:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:33:12 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-29 18:33:12 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-29 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01818%27 HTTP/1.1" 200 None
2026-03-29 18:33:12 [auto1.de] INFO: Scrape type for HL01818: 0
2026-03-29 18:33:12 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-29 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL81757%27 HTTP/1.1" 200 None
2026-03-29 18:33:12 [auto1.de] INFO: Scrape type for UL81757: 0
2026-03-29 18:33:12 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-29 18:33:12 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-29 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL73218%27 HTTP/1.1" 200 None
2026-03-29 18:33:12 [auto1.de] INFO: Scrape type for EL73218: 2
2026-03-29 18:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6b366a2-ee0e-5512-87f3-35fa687c2911 with identifier: EL73218
2026-03-29 18:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6b366a2-ee0e-5512-87f3-35fa687c2911 with scrape type 2
2026-03-29 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6b366a2-ee0e-5512-87f3-35fa687c2911 with scrape type 2
2026-03-29 18:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6b366a2-ee0e-5512-87f3-35fa687c2911, identifier: EL73218
2026-03-29 18:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6b366a2-ee0e-5512-87f3-35fa687c2911 with identifier: EL73218
2026-03-29 18:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6b366a2-ee0e-5512-87f3-35fa687c2911 with identifier: EL73218
2026-03-29 18:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6b366a2-ee0e-5512-87f3-35fa687c2911 with identifier: EL73218 to the API
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:46:57Z',
'fuel_type': 'diesel',
'id': 'e6b366a2-ee0e-5512-87f3-35fa687c2911',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL73218',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 203512,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-18',
'seller_name': None,
'title': 'BMW X3 xDrive 35d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL73218%27 HTTP/1.1" 200 None
2026-03-29 18:33:13 [auto1.de] INFO: Saving data for EL73218: {'auction_closing_time': 1774885617.0, 'created_time': 1773308230.640036, 'last_price_update_time': 1774809193.381169}
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL73218') HTTP/1.1" 204 0
2026-03-29 18:33:13 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-29 18:33:13 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV55429%27 HTTP/1.1" 200 None
2026-03-29 18:33:13 [auto1.de] INFO: Scrape type for BV55429: 2
2026-03-29 18:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with identifier: BV55429
2026-03-29 18:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with scrape type 2
2026-03-29 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with scrape type 2
2026-03-29 18:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f9f3241-f4e9-5dc0-93f2-0a175476e266, identifier: BV55429
2026-03-29 18:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with identifier: BV55429
2026-03-29 18:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with identifier: BV55429
2026-03-29 18:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with identifier: BV55429 to the API
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:42:33Z',
'fuel_type': 'diesel',
'id': '0f9f3241-f4e9-5dc0-93f2-0a175476e266',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV55429',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Viano',
'odometer': 258012,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-26',
'seller_name': None,
'title': 'Mercedes-Benz Viano 2.1 CDI kompakt Trend',
'transmission': 'automatic',
'trim': 'kompakt Trend',
'year': 2010}
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV55429%27 HTTP/1.1" 200 None
2026-03-29 18:33:13 [auto1.de] INFO: Saving data for BV55429: {'auction_closing_time': 1774885353.0, 'created_time': 1773466624.841306, 'last_price_update_time': 1774809193.912024}
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV55429') HTTP/1.1" 204 0
2026-03-29 18:33:13 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV61627%27 HTTP/1.1" 200 None
2026-03-29 18:33:13 [auto1.de] INFO: Scrape type for HV61627: 0
2026-03-29 18:33:13 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-29 18:33:13 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33073%27 HTTP/1.1" 200 None
2026-03-29 18:33:13 [auto1.de] INFO: Scrape type for EC33073: 2
2026-03-29 18:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daac7975-829c-5726-8424-3d07b3a3d396 with identifier: EC33073
2026-03-29 18:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daac7975-829c-5726-8424-3d07b3a3d396 with scrape type 2
2026-03-29 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daac7975-829c-5726-8424-3d07b3a3d396 with scrape type 2
2026-03-29 18:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: daac7975-829c-5726-8424-3d07b3a3d396, identifier: EC33073
2026-03-29 18:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: daac7975-829c-5726-8424-3d07b3a3d396 with identifier: EC33073
2026-03-29 18:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: daac7975-829c-5726-8424-3d07b3a3d396 with identifier: EC33073
2026-03-29 18:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: daac7975-829c-5726-8424-3d07b3a3d396 with identifier: EC33073 to the API
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:31:12Z',
'fuel_type': 'petrol',
'id': 'daac7975-829c-5726-8424-3d07b3a3d396',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC33073',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 68450,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-06',
'seller_name': None,
'title': 'Volkswagen Polo 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2020}
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33073%27 HTTP/1.1" 200 None
2026-03-29 18:33:14 [auto1.de] INFO: Saving data for EC33073: {'auction_closing_time': 1774884672.0, 'created_time': 1774293756.55904, 'last_price_update_time': 1774809194.405761}
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC33073') HTTP/1.1" 204 0
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57461%27 HTTP/1.1" 200 None
2026-03-29 18:33:14 [auto1.de] INFO: Scrape type for VJ57461: 0
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW06761%27 HTTP/1.1" 200 None
2026-03-29 18:33:14 [auto1.de] INFO: Scrape type for ZW06761: 0
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB43733%27 HTTP/1.1" 200 None
2026-03-29 18:33:14 [auto1.de] INFO: Scrape type for KB43733: 0
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC13487%27 HTTP/1.1" 200 None
2026-03-29 18:33:14 [auto1.de] INFO: Scrape type for XC13487: 0
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ92098%27 HTTP/1.1" 200 None
2026-03-29 18:33:14 [auto1.de] INFO: Scrape type for AZ92098: 0
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL05117%27 HTTP/1.1" 200 None
2026-03-29 18:33:14 [auto1.de] INFO: Scrape type for JL05117: 0
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU22691%27 HTTP/1.1" 200 None
2026-03-29 18:33:14 [auto1.de] INFO: Scrape type for LU22691: 0
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP14233%27 HTTP/1.1" 200 None
2026-03-29 18:33:14 [auto1.de] INFO: Scrape type for JP14233: 0
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ14861%27 HTTP/1.1" 200 None
2026-03-29 18:33:14 [auto1.de] INFO: Scrape type for AZ14861: 0
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-29 18:33:14 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS23837%27 HTTP/1.1" 200 None
2026-03-29 18:33:14 [auto1.de] INFO: Scrape type for KS23837: 2
2026-03-29 18:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9702932a-50a8-54af-9bce-3a4249a89b0b with identifier: KS23837
2026-03-29 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9702932a-50a8-54af-9bce-3a4249a89b0b with scrape type 2
2026-03-29 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9702932a-50a8-54af-9bce-3a4249a89b0b with scrape type 2
2026-03-29 18:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9702932a-50a8-54af-9bce-3a4249a89b0b, identifier: KS23837
2026-03-29 18:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9702932a-50a8-54af-9bce-3a4249a89b0b with identifier: KS23837
2026-03-29 18:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9702932a-50a8-54af-9bce-3a4249a89b0b with identifier: KS23837
2026-03-29 18:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9702932a-50a8-54af-9bce-3a4249a89b0b with identifier: KS23837 to the API
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:30:27Z',
'fuel_type': 'diesel',
'id': '9702932a-50a8-54af-9bce-3a4249a89b0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS23837',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 87729,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-10',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi 320 L1 Trend',
'transmission': 'manual',
'trim': '320 L1 Trend',
'year': 2020}
2026-03-29 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS23837%27 HTTP/1.1" 200 None
2026-03-29 18:33:15 [auto1.de] INFO: Saving data for KS23837: {'auction_closing_time': 1774884627.0, 'created_time': 1772540493.153206, 'last_price_update_time': 1774809195.033167}
2026-03-29 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS23837') HTTP/1.1" 204 0
2026-03-29 18:33:15 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-29 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA19207%27 HTTP/1.1" 200 None
2026-03-29 18:33:15 [auto1.de] INFO: Scrape type for GA19207: 0
2026-03-29 18:33:15 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-29 18:33:15 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-29 18:33:15 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-29 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR29385%27 HTTP/1.1" 200 None
2026-03-29 18:33:15 [auto1.de] INFO: Scrape type for CR29385: 2
2026-03-29 18:33:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac3d4731-f68c-59c7-9a4c-4f683965d7df with identifier: CR29385
2026-03-29 18:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3d4731-f68c-59c7-9a4c-4f683965d7df with scrape type 2
2026-03-29 18:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac3d4731-f68c-59c7-9a4c-4f683965d7df with scrape type 2
2026-03-29 18:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac3d4731-f68c-59c7-9a4c-4f683965d7df, identifier: CR29385
2026-03-29 18:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac3d4731-f68c-59c7-9a4c-4f683965d7df with identifier: CR29385
2026-03-29 18:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac3d4731-f68c-59c7-9a4c-4f683965d7df with identifier: CR29385
2026-03-29 18:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac3d4731-f68c-59c7-9a4c-4f683965d7df with identifier: CR29385 to the API
2026-03-29 18:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 227,
'expiration_date': '2026-03-30T15:09:33Z',
'fuel_type': 'petrol',
'id': 'ac3d4731-f68c-59c7-9a4c-4f683965d7df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR29385',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 34263,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-21',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic Avantgarde',
'transmission': 'automatic',
'trim': '4Matic Avantgarde',
'year': 2022}
2026-03-29 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR29385%27 HTTP/1.1" 200 None
2026-03-29 18:33:15 [auto1.de] INFO: Saving data for CR29385: {'auction_closing_time': 1774883373.0, 'created_time': 1774608327.545426, 'last_price_update_time': 1774809195.600472}
2026-03-29 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR29385') HTTP/1.1" 204 0
2026-03-29 18:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:33:16 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 6740 | hits on page: 40
2026-03-29 18:33:16 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-29 18:33:16 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-29 18:33:16 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF53882%27 HTTP/1.1" 200 None
2026-03-29 18:33:16 [auto1.de] INFO: Scrape type for HF53882: 0
2026-03-29 18:33:16 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89253%27 HTTP/1.1" 200 None
2026-03-29 18:33:16 [auto1.de] INFO: Scrape type for SS89253: 2
2026-03-29 18:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 236cca1f-c6f8-590b-b5ab-ba94fa420791 with identifier: SS89253
2026-03-29 18:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 236cca1f-c6f8-590b-b5ab-ba94fa420791 with scrape type 2
2026-03-29 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 236cca1f-c6f8-590b-b5ab-ba94fa420791 with scrape type 2
2026-03-29 18:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 236cca1f-c6f8-590b-b5ab-ba94fa420791, identifier: SS89253
2026-03-29 18:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 236cca1f-c6f8-590b-b5ab-ba94fa420791 with identifier: SS89253
2026-03-29 18:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 236cca1f-c6f8-590b-b5ab-ba94fa420791 with identifier: SS89253
2026-03-29 18:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 236cca1f-c6f8-590b-b5ab-ba94fa420791 with identifier: SS89253 to the API
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:37:03Z',
'fuel_type': 'diesel',
'id': '236cca1f-c6f8-590b-b5ab-ba94fa420791',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS89253',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 103162,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-20',
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Momentum Pro 2WD',
'transmission': 'automatic',
'trim': 'Momentum Pro 2WD',
'year': 2020}
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89253%27 HTTP/1.1" 200 None
2026-03-29 18:33:16 [auto1.de] INFO: Saving data for SS89253: {'auction_closing_time': 1774885023.0, 'created_time': 1773345363.901135, 'last_price_update_time': 1774809196.506124}
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS89253') HTTP/1.1" 204 0
2026-03-29 18:33:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:33:16 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA77532%27 HTTP/1.1" 200 None
2026-03-29 18:33:16 [auto1.de] INFO: Scrape type for GA77532: 0
2026-03-29 18:33:16 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-29 18:33:16 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN72573%27 HTTP/1.1" 200 None
2026-03-29 18:33:16 [auto1.de] INFO: Scrape type for WN72573: 0
2026-03-29 18:33:16 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-29 18:33:16 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV14674%27 HTTP/1.1" 200 None
2026-03-29 18:33:16 [auto1.de] INFO: Scrape type for HV14674: 2
2026-03-29 18:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with identifier: HV14674
2026-03-29 18:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with scrape type 2
2026-03-29 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with scrape type 2
2026-03-29 18:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b6065a7-f2e8-517f-9ebf-b3a66b65262b, identifier: HV14674
2026-03-29 18:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with identifier: HV14674
2026-03-29 18:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with identifier: HV14674
2026-03-29 18:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with identifier: HV14674 to the API
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:34Z',
'fuel_type': 'petrol',
'id': '5b6065a7-f2e8-517f-9ebf-b3a66b65262b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV14674',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 71275,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-17',
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost ST-Line X',
'transmission': 'manual',
'trim': 'ST-Line X',
'year': 2021}
2026-03-29 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV14674%27 HTTP/1.1" 200 None
2026-03-29 18:33:17 [auto1.de] INFO: Saving data for HV14674: {'auction_closing_time': 1774885594.0, 'created_time': 1773344940.750079, 'last_price_update_time': 1774809197.003768}
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV14674') HTTP/1.1" 204 0
2026-03-29 18:33:17 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-29 18:33:17 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE42693%27 HTTP/1.1" 200 None
2026-03-29 18:33:17 [auto1.de] INFO: Scrape type for AE42693: 2
2026-03-29 18:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38a77704-a115-57a5-8d8e-81e4c93c25b3 with identifier: AE42693
2026-03-29 18:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38a77704-a115-57a5-8d8e-81e4c93c25b3 with scrape type 2
2026-03-29 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38a77704-a115-57a5-8d8e-81e4c93c25b3 with scrape type 2
2026-03-29 18:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38a77704-a115-57a5-8d8e-81e4c93c25b3, identifier: AE42693
2026-03-29 18:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38a77704-a115-57a5-8d8e-81e4c93c25b3 with identifier: AE42693
2026-03-29 18:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38a77704-a115-57a5-8d8e-81e4c93c25b3 with identifier: AE42693
2026-03-29 18:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38a77704-a115-57a5-8d8e-81e4c93c25b3 with identifier: AE42693 to the API
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:37:14Z',
'fuel_type': 'diesel',
'id': '38a77704-a115-57a5-8d8e-81e4c93c25b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE42693',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40',
'odometer': 86474,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-04',
'seller_name': None,
'title': 'Volvo V40 2.0 D2 R-Design',
'transmission': 'manual',
'trim': 'R-Design',
'year': 2018}
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE42693%27 HTTP/1.1" 200 None
2026-03-29 18:33:17 [auto1.de] INFO: Saving data for AE42693: {'auction_closing_time': 1774885034.0, 'created_time': 1773138906.562178, 'last_price_update_time': 1774809197.552419}
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE42693') HTTP/1.1" 204 0
2026-03-29 18:33:17 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-29 18:33:17 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-29 18:33:17 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN26053%27 HTTP/1.1" 200 None
2026-03-29 18:33:17 [auto1.de] INFO: Scrape type for DN26053: 2
2026-03-29 18:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8c1afa4-a631-5da0-9597-470271a17205 with identifier: DN26053
2026-03-29 18:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8c1afa4-a631-5da0-9597-470271a17205 with scrape type 2
2026-03-29 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8c1afa4-a631-5da0-9597-470271a17205 with scrape type 2
2026-03-29 18:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8c1afa4-a631-5da0-9597-470271a17205, identifier: DN26053
2026-03-29 18:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8c1afa4-a631-5da0-9597-470271a17205 with identifier: DN26053
2026-03-29 18:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8c1afa4-a631-5da0-9597-470271a17205 with identifier: DN26053
2026-03-29 18:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8c1afa4-a631-5da0-9597-470271a17205 with identifier: DN26053 to the API
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:58:07Z',
'fuel_type': 'petrol',
'id': 'd8c1afa4-a631-5da0-9597-470271a17205',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN26053',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 92401,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-02-04',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2008}
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN26053%27 HTTP/1.1" 200 None
2026-03-29 18:33:17 [auto1.de] INFO: Saving data for DN26053: {'auction_closing_time': 1774886287.0, 'created_time': 1774521651.697173, 'last_price_update_time': 1774809197.961155}
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN26053') HTTP/1.1" 204 0
2026-03-29 18:33:17 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-29 18:33:17 [auto1.de] INFO: Found listing with ID: PC60624
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60624%27 HTTP/1.1" 200 None
2026-03-29 18:33:17 [auto1.de] INFO: Scrape type for PC60624: 2
2026-03-29 18:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 446aeec3-53df-5223-9dae-8eab800064e4 with identifier: PC60624
2026-03-29 18:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 446aeec3-53df-5223-9dae-8eab800064e4 with scrape type 2
2026-03-29 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 446aeec3-53df-5223-9dae-8eab800064e4 with scrape type 2
2026-03-29 18:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 446aeec3-53df-5223-9dae-8eab800064e4, identifier: PC60624
2026-03-29 18:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 446aeec3-53df-5223-9dae-8eab800064e4 with identifier: PC60624
2026-03-29 18:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 446aeec3-53df-5223-9dae-8eab800064e4 with identifier: PC60624
2026-03-29 18:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 446aeec3-53df-5223-9dae-8eab800064e4 with identifier: PC60624 to the API
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:13:22Z',
'fuel_type': 'petrol',
'id': '446aeec3-53df-5223-9dae-8eab800064e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC60624',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 70196,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-21',
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive passion',
'year': 2011}
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60624%27 HTTP/1.1" 200 None
2026-03-29 18:33:18 [auto1.de] INFO: Saving data for PC60624: {'auction_closing_time': 1774883602.0, 'created_time': 1774118761.395545, 'last_price_update_time': 1774809198.365234}
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC60624') HTTP/1.1" 204 0
2026-03-29 18:33:18 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-29 18:33:18 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-29 18:33:18 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-29 18:33:18 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ46216%27 HTTP/1.1" 200 None
2026-03-29 18:33:18 [auto1.de] INFO: Scrape type for NJ46216: 0
2026-03-29 18:33:18 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-29 18:33:18 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH16310%27 HTTP/1.1" 200 None
2026-03-29 18:33:18 [auto1.de] INFO: Scrape type for KH16310: 0
2026-03-29 18:33:18 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34905%27 HTTP/1.1" 200 None
2026-03-29 18:33:18 [auto1.de] INFO: Scrape type for UH34905: 0
2026-03-29 18:33:18 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE72170%27 HTTP/1.1" 200 None
2026-03-29 18:33:18 [auto1.de] INFO: Scrape type for KE72170: 0
2026-03-29 18:33:18 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-29 18:33:18 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-29 18:33:18 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN13363%27 HTTP/1.1" 200 None
2026-03-29 18:33:18 [auto1.de] INFO: Scrape type for AN13363: 2
2026-03-29 18:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea377221-4d6e-5a72-9b42-5f52df4920c1 with identifier: AN13363
2026-03-29 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea377221-4d6e-5a72-9b42-5f52df4920c1 with scrape type 2
2026-03-29 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea377221-4d6e-5a72-9b42-5f52df4920c1 with scrape type 2
2026-03-29 18:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea377221-4d6e-5a72-9b42-5f52df4920c1, identifier: AN13363
2026-03-29 18:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea377221-4d6e-5a72-9b42-5f52df4920c1 with identifier: AN13363
2026-03-29 18:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea377221-4d6e-5a72-9b42-5f52df4920c1 with identifier: AN13363
2026-03-29 18:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea377221-4d6e-5a72-9b42-5f52df4920c1 with identifier: AN13363 to the API
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:00:29Z',
'fuel_type': 'petrol',
'id': 'ea377221-4d6e-5a72-9b42-5f52df4920c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN13363',
'listing': 'auction',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 167227,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'Skoda Yeti 1.4 TSI Ambition Plus Edition',
'transmission': 'manual',
'trim': 'Ambition Plus Edition',
'year': 2012}
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN13363%27 HTTP/1.1" 200 None
2026-03-29 18:33:18 [auto1.de] INFO: Saving data for AN13363: {'auction_closing_time': 1774882829.0, 'created_time': 1773858712.672628, 'last_price_update_time': 1774809198.898651}
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN13363') HTTP/1.1" 204 0
2026-03-29 18:33:19 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-29 18:33:19 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB62953%27 HTTP/1.1" 200 None
2026-03-29 18:33:19 [auto1.de] INFO: Scrape type for VB62953: 2
2026-03-29 18:33:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6368ec0b-2807-54e6-8004-70afefba5de6 with identifier: VB62953
2026-03-29 18:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6368ec0b-2807-54e6-8004-70afefba5de6 with scrape type 2
2026-03-29 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6368ec0b-2807-54e6-8004-70afefba5de6 with scrape type 2
2026-03-29 18:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6368ec0b-2807-54e6-8004-70afefba5de6, identifier: VB62953
2026-03-29 18:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6368ec0b-2807-54e6-8004-70afefba5de6 with identifier: VB62953
2026-03-29 18:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6368ec0b-2807-54e6-8004-70afefba5de6 with identifier: VB62953
2026-03-29 18:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6368ec0b-2807-54e6-8004-70afefba5de6 with identifier: VB62953 to the API
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:40:51Z',
'fuel_type': 'diesel',
'id': '6368ec0b-2807-54e6-8004-70afefba5de6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB62953',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 138384,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-12',
'seller_name': None,
'title': 'BMW X1 xDrive 20d Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2017}
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB62953%27 HTTP/1.1" 200 None
2026-03-29 18:33:19 [auto1.de] INFO: Saving data for VB62953: {'auction_closing_time': 1774885251.0, 'created_time': 1773304889.673313, 'last_price_update_time': 1774809199.459325}
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB62953') HTTP/1.1" 204 0
2026-03-29 18:33:19 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48624%27 HTTP/1.1" 200 None
2026-03-29 18:33:19 [auto1.de] INFO: Scrape type for WS48624: 0
2026-03-29 18:33:19 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91854%27 HTTP/1.1" 200 None
2026-03-29 18:33:19 [auto1.de] INFO: Scrape type for LC91854: 2
2026-03-29 18:33:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with identifier: LC91854
2026-03-29 18:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with scrape type 2
2026-03-29 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with scrape type 2
2026-03-29 18:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19d8c31a-db4b-5a8a-86a3-e22584b70f1d, identifier: LC91854
2026-03-29 18:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with identifier: LC91854
2026-03-29 18:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with identifier: LC91854
2026-03-29 18:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with identifier: LC91854 to the API
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:07:41Z',
'fuel_type': 'diesel',
'id': '19d8c31a-db4b-5a8a-86a3-e22584b70f1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC91854',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 298768,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-11',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2016}
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91854%27 HTTP/1.1" 200 None
2026-03-29 18:33:19 [auto1.de] INFO: Saving data for LC91854: {'auction_closing_time': 1774883261.0, 'created_time': 1774608182.975268, 'last_price_update_time': 1774809199.938436}
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC91854') HTTP/1.1" 204 0
2026-03-29 18:33:19 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-29 18:33:19 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-29 18:33:19 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY85938%27 HTTP/1.1" 200 None
2026-03-29 18:33:19 [auto1.de] INFO: Scrape type for SY85938: 2
2026-03-29 18:33:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 142b977a-64dc-5d77-9022-f457bb951ffb with identifier: SY85938
2026-03-29 18:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 142b977a-64dc-5d77-9022-f457bb951ffb with scrape type 2
2026-03-29 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 142b977a-64dc-5d77-9022-f457bb951ffb with scrape type 2
2026-03-29 18:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 142b977a-64dc-5d77-9022-f457bb951ffb, identifier: SY85938
2026-03-29 18:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 142b977a-64dc-5d77-9022-f457bb951ffb with identifier: SY85938
2026-03-29 18:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 142b977a-64dc-5d77-9022-f457bb951ffb with identifier: SY85938
2026-03-29 18:33:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 142b977a-64dc-5d77-9022-f457bb951ffb with identifier: SY85938 to the API
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:02:07Z',
'fuel_type': 'petrol',
'id': '142b977a-64dc-5d77-9022-f457bb951ffb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY85938',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 57515,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-08',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY85938%27 HTTP/1.1" 200 None
2026-03-29 18:33:20 [auto1.de] INFO: Saving data for SY85938: {'auction_closing_time': 1774882927.0, 'created_time': 1773427041.458803, 'last_price_update_time': 1774809200.415906}
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY85938') HTTP/1.1" 204 0
2026-03-29 18:33:20 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY45695%27 HTTP/1.1" 200 None
2026-03-29 18:33:20 [auto1.de] INFO: Scrape type for YY45695: 0
2026-03-29 18:33:20 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-29 18:33:20 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-29 18:33:20 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-29 18:33:20 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-29 18:33:20 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45914%27 HTTP/1.1" 200 None
2026-03-29 18:33:20 [auto1.de] INFO: Scrape type for UB45914: 2
2026-03-29 18:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with identifier: UB45914
2026-03-29 18:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with scrape type 2
2026-03-29 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with scrape type 2
2026-03-29 18:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9b5d624-463b-5ff3-adf8-fda5f7a092b0, identifier: UB45914
2026-03-29 18:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with identifier: UB45914
2026-03-29 18:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with identifier: UB45914
2026-03-29 18:33:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with identifier: UB45914 to the API
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:46:40Z',
'fuel_type': 'petrol',
'id': 'b9b5d624-463b-5ff3-adf8-fda5f7a092b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB45914',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 14299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-26',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2023}
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45914%27 HTTP/1.1" 200 None
2026-03-29 18:33:20 [auto1.de] INFO: Saving data for UB45914: {'auction_closing_time': 1774885600.0, 'created_time': 1773134726.310967, 'last_price_update_time': 1774809200.895124}
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB45914') HTTP/1.1" 204 0
2026-03-29 18:33:21 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 6740 | hits on page: 40
2026-03-29 18:33:21 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88975%27 HTTP/1.1" 200 None
2026-03-29 18:33:21 [auto1.de] INFO: Scrape type for ZM88975: 2
2026-03-29 18:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with identifier: ZM88975
2026-03-29 18:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with scrape type 2
2026-03-29 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with scrape type 2
2026-03-29 18:33:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e4010db-f408-54ff-8bb7-bd1b5ed02f72, identifier: ZM88975
2026-03-29 18:33:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with identifier: ZM88975
2026-03-29 18:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with identifier: ZM88975
2026-03-29 18:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with identifier: ZM88975 to the API
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:17:08Z',
'fuel_type': 'petrol',
'id': '8e4010db-f408-54ff-8bb7-bd1b5ed02f72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM88975',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 147322,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-19',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.2 TSI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2013}
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88975%27 HTTP/1.1" 200 None
2026-03-29 18:33:21 [auto1.de] INFO: Saving data for ZM88975: {'auction_closing_time': 1774883828.0, 'created_time': 1773306829.193955, 'last_price_update_time': 1774809201.480995}
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM88975') HTTP/1.1" 204 0
2026-03-29 18:33:21 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB91533%27 HTTP/1.1" 200 None
2026-03-29 18:33:21 [auto1.de] INFO: Scrape type for EB91533: 0
2026-03-29 18:33:21 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH43382%27 HTTP/1.1" 200 None
2026-03-29 18:33:21 [auto1.de] INFO: Scrape type for UH43382: 0
2026-03-29 18:33:21 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-29 18:33:21 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW86422%27 HTTP/1.1" 200 None
2026-03-29 18:33:21 [auto1.de] INFO: Scrape type for NW86422: 0
2026-03-29 18:33:21 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN92632%27 HTTP/1.1" 200 None
2026-03-29 18:33:21 [auto1.de] INFO: Scrape type for WN92632: 2
2026-03-29 18:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be8cb0d0-41f9-556b-9e1f-825682638539 with identifier: WN92632
2026-03-29 18:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be8cb0d0-41f9-556b-9e1f-825682638539 with scrape type 2
2026-03-29 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be8cb0d0-41f9-556b-9e1f-825682638539 with scrape type 2
2026-03-29 18:33:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be8cb0d0-41f9-556b-9e1f-825682638539, identifier: WN92632
2026-03-29 18:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be8cb0d0-41f9-556b-9e1f-825682638539 with identifier: WN92632
2026-03-29 18:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be8cb0d0-41f9-556b-9e1f-825682638539 with identifier: WN92632
2026-03-29 18:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be8cb0d0-41f9-556b-9e1f-825682638539 with identifier: WN92632 to the API
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:13:54Z',
'fuel_type': 'petrol',
'id': 'be8cb0d0-41f9-556b-9e1f-825682638539',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN92632',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 121444,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-07',
'seller_name': None,
'title': 'Opel Astra 1.6 Innovation "110 Jahre"',
'transmission': 'manual',
'trim': 'Innovation "110 Jahre"',
'year': 2009}
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN92632%27 HTTP/1.1" 200 None
2026-03-29 18:33:21 [auto1.de] INFO: Saving data for WN92632: {'auction_closing_time': 1774883634.0, 'created_time': 1774118514.126491, 'last_price_update_time': 1774809201.947702}
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN92632') HTTP/1.1" 204 0
2026-03-29 18:33:21 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-29 18:33:21 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-29 18:33:21 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ18760%27 HTTP/1.1" 200 None
2026-03-29 18:33:21 [auto1.de] INFO: Scrape type for LJ18760: 0
2026-03-29 18:33:21 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-29 18:33:21 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-29 18:33:21 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-29 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98596%27 HTTP/1.1" 200 None
2026-03-29 18:33:22 [auto1.de] INFO: Scrape type for EU98596: 0
2026-03-29 18:33:22 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH81029%27 HTTP/1.1" 200 None
2026-03-29 18:33:22 [auto1.de] INFO: Scrape type for YH81029: 2
2026-03-29 18:33:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with identifier: YH81029
2026-03-29 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with scrape type 2
2026-03-29 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with scrape type 2
2026-03-29 18:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcf3a7a7-47d6-538c-aa4a-bbc0b712916d, identifier: YH81029
2026-03-29 18:33:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with identifier: YH81029
2026-03-29 18:33:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with identifier: YH81029
2026-03-29 18:33:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with identifier: YH81029 to the API
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:24:22Z',
'fuel_type': 'diesel',
'id': 'fcf3a7a7-47d6-538c-aa4a-bbc0b712916d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH81029',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLS-Klasse',
'odometer': 343530,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-10',
'seller_name': None,
'title': 'Mercedes-Benz CLS-Klasse CLS 250 d Shooting Brake 4Matic BlueTEC',
'transmission': 'automatic',
'trim': '4Matic BlueTEC',
'year': 2015}
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH81029%27 HTTP/1.1" 200 None
2026-03-29 18:33:22 [auto1.de] INFO: Saving data for YH81029: {'auction_closing_time': 1774884262.0, 'created_time': 1774330253.387537, 'last_price_update_time': 1774809202.503204}
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH81029') HTTP/1.1" 204 0
2026-03-29 18:33:22 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26961%27 HTTP/1.1" 200 None
2026-03-29 18:33:22 [auto1.de] INFO: Scrape type for BY26961: 0
2026-03-29 18:33:22 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-29 18:33:22 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-29 18:33:22 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-29 18:33:22 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-29 18:33:22 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW87137%27 HTTP/1.1" 200 None
2026-03-29 18:33:22 [auto1.de] INFO: Scrape type for HW87137: 0
2026-03-29 18:33:22 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR77511%27 HTTP/1.1" 200 None
2026-03-29 18:33:22 [auto1.de] INFO: Scrape type for RR77511: 0
2026-03-29 18:33:22 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD81187%27 HTTP/1.1" 200 None
2026-03-29 18:33:22 [auto1.de] INFO: Scrape type for FD81187: 2
2026-03-29 18:33:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e3c76b9-2cc8-572d-91a5-afe9f402d1fc with identifier: FD81187
2026-03-29 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e3c76b9-2cc8-572d-91a5-afe9f402d1fc with scrape type 2
2026-03-29 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e3c76b9-2cc8-572d-91a5-afe9f402d1fc with scrape type 2
2026-03-29 18:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e3c76b9-2cc8-572d-91a5-afe9f402d1fc, identifier: FD81187
2026-03-29 18:33:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e3c76b9-2cc8-572d-91a5-afe9f402d1fc with identifier: FD81187
2026-03-29 18:33:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e3c76b9-2cc8-572d-91a5-afe9f402d1fc with identifier: FD81187
2026-03-29 18:33:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e3c76b9-2cc8-572d-91a5-afe9f402d1fc with identifier: FD81187 to the API
2026-03-29 18:33:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 310,
'expiration_date': '2026-03-30T15:25:17Z',
'fuel_type': 'petrol',
'id': '5e3c76b9-2cc8-572d-91a5-afe9f402d1fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD81187',
'listing': 'auction',
'make': 'Audi',
'model': 'S3',
'odometer': 75962,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-03',
'seller_name': None,
'title': 'Audi S3 2.0 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2022}
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD81187%27 HTTP/1.1" 200 None
2026-03-29 18:33:23 [auto1.de] INFO: Saving data for FD81187: {'auction_closing_time': 1774884317.0, 'created_time': 1773224653.148912, 'last_price_update_time': 1774809203.164559}
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD81187') HTTP/1.1" 204 0
2026-03-29 18:33:23 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD54604%27 HTTP/1.1" 200 None
2026-03-29 18:33:23 [auto1.de] INFO: Scrape type for TD54604: 2
2026-03-29 18:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17b15ff8-c947-5a41-9ebe-b88869245f47 with identifier: TD54604
2026-03-29 18:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17b15ff8-c947-5a41-9ebe-b88869245f47 with scrape type 2
2026-03-29 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17b15ff8-c947-5a41-9ebe-b88869245f47 with scrape type 2
2026-03-29 18:33:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17b15ff8-c947-5a41-9ebe-b88869245f47, identifier: TD54604
2026-03-29 18:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17b15ff8-c947-5a41-9ebe-b88869245f47 with identifier: TD54604
2026-03-29 18:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17b15ff8-c947-5a41-9ebe-b88869245f47 with identifier: TD54604
2026-03-29 18:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17b15ff8-c947-5a41-9ebe-b88869245f47 with identifier: TD54604 to the API
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:55:27Z',
'fuel_type': 'diesel',
'id': '17b15ff8-c947-5a41-9ebe-b88869245f47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD54604',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 195114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-03',
'seller_name': None,
'title': 'Opel Astra 1.7 CDTI Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2015}
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD54604%27 HTTP/1.1" 200 None
2026-03-29 18:33:23 [auto1.de] INFO: Saving data for TD54604: {'auction_closing_time': 1774886127.0, 'created_time': 1773341236.375464, 'last_price_update_time': 1774809203.633813}
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD54604') HTTP/1.1" 204 0
2026-03-29 18:33:23 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM39243%27 HTTP/1.1" 200 None
2026-03-29 18:33:23 [auto1.de] INFO: Scrape type for JM39243: 0
2026-03-29 18:33:23 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61709%27 HTTP/1.1" 200 None
2026-03-29 18:33:23 [auto1.de] INFO: Scrape type for VH61709: 0
2026-03-29 18:33:23 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-29 18:33:23 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT08770%27 HTTP/1.1" 200 None
2026-03-29 18:33:23 [auto1.de] INFO: Scrape type for MT08770: 0
2026-03-29 18:33:23 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-29 18:33:23 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-29 18:33:23 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-29 18:33:23 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD09262%27 HTTP/1.1" 200 None
2026-03-29 18:33:23 [auto1.de] INFO: Scrape type for CD09262: 0
2026-03-29 18:33:23 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-29 18:33:23 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG95649%27 HTTP/1.1" 200 None
2026-03-29 18:33:23 [auto1.de] INFO: Scrape type for SG95649: 2
2026-03-29 18:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63121b03-2810-5332-bf32-522e5a1e5c04 with identifier: SG95649
2026-03-29 18:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63121b03-2810-5332-bf32-522e5a1e5c04 with scrape type 2
2026-03-29 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63121b03-2810-5332-bf32-522e5a1e5c04 with scrape type 2
2026-03-29 18:33:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63121b03-2810-5332-bf32-522e5a1e5c04, identifier: SG95649
2026-03-29 18:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63121b03-2810-5332-bf32-522e5a1e5c04 with identifier: SG95649
2026-03-29 18:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63121b03-2810-5332-bf32-522e5a1e5c04 with identifier: SG95649
2026-03-29 18:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63121b03-2810-5332-bf32-522e5a1e5c04 with identifier: SG95649 to the API
2026-03-29 18:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 272,
'expiration_date': '2026-03-30T15:25:06Z',
'fuel_type': 'petrol',
'id': '63121b03-2810-5332-bf32-522e5a1e5c04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG95649',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 71295,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-26',
'seller_name': None,
'title': 'Peugeot 308 1.6 THP GTi',
'transmission': 'manual',
'trim': 'GTi',
'year': 2017}
2026-03-29 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG95649%27 HTTP/1.1" 200 None
2026-03-29 18:33:24 [auto1.de] INFO: Saving data for SG95649: {'auction_closing_time': 1774884306.0, 'created_time': 1774521841.913664, 'last_price_update_time': 1774809204.119849}
2026-03-29 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG95649') HTTP/1.1" 204 0
2026-03-29 18:33:24 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-29 18:33:24 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-29 18:33:24 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-29 18:33:24 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-29 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG01801%27 HTTP/1.1" 200 None
2026-03-29 18:33:24 [auto1.de] INFO: Scrape type for RG01801: 0
2026-03-29 18:33:24 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-29 18:33:24 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-29 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT85879%27 HTTP/1.1" 200 None
2026-03-29 18:33:24 [auto1.de] INFO: Scrape type for DT85879: 0
2026-03-29 18:33:24 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-29 18:33:24 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-29 18:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:33:25 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 6740 | hits on page: 40
2026-03-29 18:33:25 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-29 18:33:25 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-29 18:33:25 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-29 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA93761%27 HTTP/1.1" 200 None
2026-03-29 18:33:25 [auto1.de] INFO: Scrape type for YA93761: 0
2026-03-29 18:33:25 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-29 18:33:25 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-29 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS20731%27 HTTP/1.1" 200 None
2026-03-29 18:33:25 [auto1.de] INFO: Scrape type for JS20731: 0
2026-03-29 18:33:25 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-29 18:33:25 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-29 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS69685%27 HTTP/1.1" 200 None
2026-03-29 18:33:25 [auto1.de] INFO: Scrape type for GS69685: 2
2026-03-29 18:33:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05059f83-d70d-53c8-a1a3-992f8729741f with identifier: GS69685
2026-03-29 18:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05059f83-d70d-53c8-a1a3-992f8729741f with scrape type 2
2026-03-29 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05059f83-d70d-53c8-a1a3-992f8729741f with scrape type 2
2026-03-29 18:33:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05059f83-d70d-53c8-a1a3-992f8729741f, identifier: GS69685
2026-03-29 18:33:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05059f83-d70d-53c8-a1a3-992f8729741f with identifier: GS69685
2026-03-29 18:33:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05059f83-d70d-53c8-a1a3-992f8729741f with identifier: GS69685
2026-03-29 18:33:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05059f83-d70d-53c8-a1a3-992f8729741f with identifier: GS69685 to the API
2026-03-29 18:33:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:16:11Z',
'fuel_type': 'petrol',
'id': '05059f83-d70d-53c8-a1a3-992f8729741f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS69685',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 110483,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-01',
'seller_name': None,
'title': 'Skoda Fabia 1.2 Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2009}
2026-03-29 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS69685%27 HTTP/1.1" 200 None
2026-03-29 18:33:25 [auto1.de] INFO: Saving data for GS69685: {'auction_closing_time': 1774883771.0, 'created_time': 1773306723.420779, 'last_price_update_time': 1774809205.912086}
2026-03-29 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS69685') HTTP/1.1" 204 0
2026-03-29 18:33:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:33:26 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-29 18:33:26 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-29 18:33:26 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-29 18:33:26 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97689%27 HTTP/1.1" 200 None
2026-03-29 18:33:26 [auto1.de] INFO: Scrape type for SD97689: 2
2026-03-29 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44843c13-7251-5281-b3f8-96ec5eb8a6fa with identifier: SD97689
2026-03-29 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44843c13-7251-5281-b3f8-96ec5eb8a6fa with scrape type 2
2026-03-29 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44843c13-7251-5281-b3f8-96ec5eb8a6fa with scrape type 2
2026-03-29 18:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44843c13-7251-5281-b3f8-96ec5eb8a6fa, identifier: SD97689
2026-03-29 18:33:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44843c13-7251-5281-b3f8-96ec5eb8a6fa with identifier: SD97689
2026-03-29 18:33:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44843c13-7251-5281-b3f8-96ec5eb8a6fa with identifier: SD97689
2026-03-29 18:33:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44843c13-7251-5281-b3f8-96ec5eb8a6fa with identifier: SD97689 to the API
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:20:46Z',
'fuel_type': 'petrol',
'id': '44843c13-7251-5281-b3f8-96ec5eb8a6fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD97689',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 62906,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-22',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2015}
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97689%27 HTTP/1.1" 200 None
2026-03-29 18:33:26 [auto1.de] INFO: Saving data for SD97689: {'auction_closing_time': 1774884046.0, 'created_time': 1773400448.859228, 'last_price_update_time': 1774809206.484398}
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD97689') HTTP/1.1" 204 0
2026-03-29 18:33:26 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-29 18:33:26 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-29 18:33:26 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA75258%27 HTTP/1.1" 200 None
2026-03-29 18:33:26 [auto1.de] INFO: Scrape type for GA75258: 2
2026-03-29 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 998148ad-7c7b-5486-a016-cfb485d2dfb2 with identifier: GA75258
2026-03-29 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 998148ad-7c7b-5486-a016-cfb485d2dfb2 with scrape type 2
2026-03-29 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 998148ad-7c7b-5486-a016-cfb485d2dfb2 with scrape type 2
2026-03-29 18:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 998148ad-7c7b-5486-a016-cfb485d2dfb2, identifier: GA75258
2026-03-29 18:33:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 998148ad-7c7b-5486-a016-cfb485d2dfb2 with identifier: GA75258
2026-03-29 18:33:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 998148ad-7c7b-5486-a016-cfb485d2dfb2 with identifier: GA75258
2026-03-29 18:33:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 998148ad-7c7b-5486-a016-cfb485d2dfb2 with identifier: GA75258 to the API
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:07:16Z',
'fuel_type': 'diesel',
'id': '998148ad-7c7b-5486-a016-cfb485d2dfb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA75258',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 197356,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-31',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA75258%27 HTTP/1.1" 200 None
2026-03-29 18:33:26 [auto1.de] INFO: Saving data for GA75258: {'auction_closing_time': 1774883236.0, 'created_time': 1773400145.309242, 'last_price_update_time': 1774809206.941904}
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA75258') HTTP/1.1" 204 0
2026-03-29 18:33:26 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ78917%27 HTTP/1.1" 200 None
2026-03-29 18:33:26 [auto1.de] INFO: Scrape type for ZJ78917: 0
2026-03-29 18:33:26 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP57699%27 HTTP/1.1" 200 None
2026-03-29 18:33:26 [auto1.de] INFO: Scrape type for JP57699: 0
2026-03-29 18:33:26 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28437%27 HTTP/1.1" 200 None
2026-03-29 18:33:27 [auto1.de] INFO: Scrape type for SG28437: 2
2026-03-29 18:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 748b6df4-fbcf-5793-af67-9dae2675bdf7 with identifier: SG28437
2026-03-29 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 748b6df4-fbcf-5793-af67-9dae2675bdf7 with scrape type 2
2026-03-29 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 748b6df4-fbcf-5793-af67-9dae2675bdf7 with scrape type 2
2026-03-29 18:33:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 748b6df4-fbcf-5793-af67-9dae2675bdf7, identifier: SG28437
2026-03-29 18:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 748b6df4-fbcf-5793-af67-9dae2675bdf7 with identifier: SG28437
2026-03-29 18:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 748b6df4-fbcf-5793-af67-9dae2675bdf7 with identifier: SG28437
2026-03-29 18:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 748b6df4-fbcf-5793-af67-9dae2675bdf7 with identifier: SG28437 to the API
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:53:08Z',
'fuel_type': 'petrol',
'id': '748b6df4-fbcf-5793-af67-9dae2675bdf7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG28437',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 164065,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-17',
'seller_name': None,
'title': 'Fiat Panda 1.2 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2011}
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28437%27 HTTP/1.1" 200 None
2026-03-29 18:33:27 [auto1.de] INFO: Saving data for SG28437: {'auction_closing_time': 1774885988.0, 'created_time': 1773427268.636839, 'last_price_update_time': 1774809207.423768}
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG28437') HTTP/1.1" 204 0
2026-03-29 18:33:27 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB22457%27 HTTP/1.1" 200 None
2026-03-29 18:33:27 [auto1.de] INFO: Scrape type for LB22457: 2
2026-03-29 18:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8896f62-3846-5f03-86a5-8c9a4ec8e05d with identifier: LB22457
2026-03-29 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8896f62-3846-5f03-86a5-8c9a4ec8e05d with scrape type 2
2026-03-29 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8896f62-3846-5f03-86a5-8c9a4ec8e05d with scrape type 2
2026-03-29 18:33:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8896f62-3846-5f03-86a5-8c9a4ec8e05d, identifier: LB22457
2026-03-29 18:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8896f62-3846-5f03-86a5-8c9a4ec8e05d with identifier: LB22457
2026-03-29 18:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8896f62-3846-5f03-86a5-8c9a4ec8e05d with identifier: LB22457
2026-03-29 18:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8896f62-3846-5f03-86a5-8c9a4ec8e05d with identifier: LB22457 to the API
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:17:48Z',
'fuel_type': 'diesel',
'id': 'd8896f62-3846-5f03-86a5-8c9a4ec8e05d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB22457',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 175198,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-26',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Nakama Intense AWD',
'transmission': 'automatic',
'trim': 'Nakama Intense AWD',
'year': 2016}
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB22457%27 HTTP/1.1" 200 None
2026-03-29 18:33:27 [auto1.de] INFO: Saving data for LB22457: {'auction_closing_time': 1774883868.0, 'created_time': 1773134852.845, 'last_price_update_time': 1774809207.953094}
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB22457') HTTP/1.1" 204 0
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51921%27 HTTP/1.1" 200 None
2026-03-29 18:33:28 [auto1.de] INFO: Scrape type for AA51921: 0
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE89273%27 HTTP/1.1" 200 None
2026-03-29 18:33:28 [auto1.de] INFO: Scrape type for TE89273: 0
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT62005%27 HTTP/1.1" 200 None
2026-03-29 18:33:28 [auto1.de] INFO: Scrape type for HT62005: 0
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT71502%27 HTTP/1.1" 200 None
2026-03-29 18:33:28 [auto1.de] INFO: Scrape type for ZT71502: 0
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB66964%27 HTTP/1.1" 200 None
2026-03-29 18:33:28 [auto1.de] INFO: Scrape type for HB66964: 0
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU00556%27 HTTP/1.1" 200 None
2026-03-29 18:33:28 [auto1.de] INFO: Scrape type for LU00556: 2
2026-03-29 18:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c72a94ab-7559-5825-80dc-ac144a55c6fb with identifier: LU00556
2026-03-29 18:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c72a94ab-7559-5825-80dc-ac144a55c6fb with scrape type 2
2026-03-29 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c72a94ab-7559-5825-80dc-ac144a55c6fb with scrape type 2
2026-03-29 18:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c72a94ab-7559-5825-80dc-ac144a55c6fb, identifier: LU00556
2026-03-29 18:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c72a94ab-7559-5825-80dc-ac144a55c6fb with identifier: LU00556
2026-03-29 18:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c72a94ab-7559-5825-80dc-ac144a55c6fb with identifier: LU00556
2026-03-29 18:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c72a94ab-7559-5825-80dc-ac144a55c6fb with identifier: LU00556 to the API
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:33:58Z',
'fuel_type': 'diesel',
'id': 'c72a94ab-7559-5825-80dc-ac144a55c6fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU00556',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 144636,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-28',
'seller_name': None,
'title': 'Peugeot Rifter 1.5 Blue-HDi Active L1',
'transmission': 'manual',
'trim': 'Active L1',
'year': 2020}
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU00556%27 HTTP/1.1" 200 None
2026-03-29 18:33:28 [auto1.de] INFO: Saving data for LU00556: {'auction_closing_time': 1774884838.0, 'created_time': 1773402613.122351, 'last_price_update_time': 1774809208.589257}
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU00556') HTTP/1.1" 204 0
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-29 18:33:28 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84530%27 HTTP/1.1" 200 None
2026-03-29 18:33:28 [auto1.de] INFO: Scrape type for NM84530: 2
2026-03-29 18:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with identifier: NM84530
2026-03-29 18:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with scrape type 2
2026-03-29 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with scrape type 2
2026-03-29 18:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10, identifier: NM84530
2026-03-29 18:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with identifier: NM84530
2026-03-29 18:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with identifier: NM84530
2026-03-29 18:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with identifier: NM84530 to the API
2026-03-29 18:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:42:27Z',
'fuel_type': 'diesel',
'id': '0d0d6a08-8052-5feb-9cec-bf4e6c5bae10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM84530',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 118782,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-29',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2019}
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84530%27 HTTP/1.1" 200 None
2026-03-29 18:33:29 [auto1.de] INFO: Saving data for NM84530: {'auction_closing_time': 1774885347.0, 'created_time': 1773468227.047045, 'last_price_update_time': 1774809209.161668}
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM84530') HTTP/1.1" 204 0
2026-03-29 18:33:29 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-29 18:33:29 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-29 18:33:29 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-29 18:33:29 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC68587%27 HTTP/1.1" 200 None
2026-03-29 18:33:29 [auto1.de] INFO: Scrape type for RC68587: 0
2026-03-29 18:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:33:29 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 6740 | hits on page: 40
2026-03-29 18:33:29 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX86319%27 HTTP/1.1" 200 None
2026-03-29 18:33:29 [auto1.de] INFO: Scrape type for NX86319: 2
2026-03-29 18:33:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7e19105-fb78-5151-8382-e43677eb0af6 with identifier: NX86319
2026-03-29 18:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7e19105-fb78-5151-8382-e43677eb0af6 with scrape type 2
2026-03-29 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7e19105-fb78-5151-8382-e43677eb0af6 with scrape type 2
2026-03-29 18:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7e19105-fb78-5151-8382-e43677eb0af6, identifier: NX86319
2026-03-29 18:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7e19105-fb78-5151-8382-e43677eb0af6 with identifier: NX86319
2026-03-29 18:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7e19105-fb78-5151-8382-e43677eb0af6 with identifier: NX86319
2026-03-29 18:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7e19105-fb78-5151-8382-e43677eb0af6 with identifier: NX86319 to the API
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:30:08Z',
'fuel_type': 'diesel',
'id': 'b7e19105-fb78-5151-8382-e43677eb0af6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX86319',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 178176,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-18',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI Trendline 4Motion',
'transmission': 'manual',
'trim': 'Trendline 4Motion',
'year': 2014}
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX86319%27 HTTP/1.1" 200 None
2026-03-29 18:33:29 [auto1.de] INFO: Saving data for NX86319: {'auction_closing_time': 1774884608.0, 'created_time': 1774118115.456932, 'last_price_update_time': 1774809209.742857}
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX86319') HTTP/1.1" 204 0
2026-03-29 18:33:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:33:29 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-29 18:33:29 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-29 18:33:29 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-29 18:33:29 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-29 18:33:29 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY27003%27 HTTP/1.1" 200 None
2026-03-29 18:33:29 [auto1.de] INFO: Scrape type for KY27003: 2
2026-03-29 18:33:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75cc02fd-91a4-5ebb-914f-199345f5f6be with identifier: KY27003
2026-03-29 18:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75cc02fd-91a4-5ebb-914f-199345f5f6be with scrape type 2
2026-03-29 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75cc02fd-91a4-5ebb-914f-199345f5f6be with scrape type 2
2026-03-29 18:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75cc02fd-91a4-5ebb-914f-199345f5f6be, identifier: KY27003
2026-03-29 18:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75cc02fd-91a4-5ebb-914f-199345f5f6be with identifier: KY27003
2026-03-29 18:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75cc02fd-91a4-5ebb-914f-199345f5f6be with identifier: KY27003
2026-03-29 18:33:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75cc02fd-91a4-5ebb-914f-199345f5f6be with identifier: KY27003 to the API
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:35:39Z',
'fuel_type': 'petrol',
'id': '75cc02fd-91a4-5ebb-914f-199345f5f6be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY27003',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 51587,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-28',
'seller_name': None,
'title': 'Fiat Panda 1.2 Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2016}
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY27003%27 HTTP/1.1" 200 None
2026-03-29 18:33:30 [auto1.de] INFO: Saving data for KY27003: {'auction_closing_time': 1774884939.0, 'created_time': 1774117918.573746, 'last_price_update_time': 1774809210.262757}
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY27003') HTTP/1.1" 204 0
2026-03-29 18:33:30 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ51755%27 HTTP/1.1" 200 None
2026-03-29 18:33:30 [auto1.de] INFO: Scrape type for WZ51755: 2
2026-03-29 18:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with identifier: WZ51755
2026-03-29 18:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with scrape type 2
2026-03-29 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with scrape type 2
2026-03-29 18:33:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e, identifier: WZ51755
2026-03-29 18:33:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with identifier: WZ51755
2026-03-29 18:33:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with identifier: WZ51755
2026-03-29 18:33:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with identifier: WZ51755 to the API
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:20:43Z',
'fuel_type': 'diesel',
'id': '9a1c756a-fc9e-5f31-b748-beab7ccd8e3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ51755',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 189755,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-06',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ51755%27 HTTP/1.1" 200 None
2026-03-29 18:33:30 [auto1.de] INFO: Saving data for WZ51755: {'auction_closing_time': 1774884043.0, 'created_time': 1774608303.301252, 'last_price_update_time': 1774809210.71737}
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ51755') HTTP/1.1" 204 0
2026-03-29 18:33:30 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV87595%27 HTTP/1.1" 200 None
2026-03-29 18:33:30 [auto1.de] INFO: Scrape type for XV87595: 0
2026-03-29 18:33:30 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU42295%27 HTTP/1.1" 200 None
2026-03-29 18:33:30 [auto1.de] INFO: Scrape type for TU42295: 0
2026-03-29 18:33:30 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX84007%27 HTTP/1.1" 200 None
2026-03-29 18:33:30 [auto1.de] INFO: Scrape type for ZX84007: 0
2026-03-29 18:33:30 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR20197%27 HTTP/1.1" 200 None
2026-03-29 18:33:30 [auto1.de] INFO: Scrape type for KR20197: 0
2026-03-29 18:33:30 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV50908%27 HTTP/1.1" 200 None
2026-03-29 18:33:30 [auto1.de] INFO: Scrape type for FV50908: 0
2026-03-29 18:33:30 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-29 18:33:30 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47170%27 HTTP/1.1" 200 None
2026-03-29 18:33:30 [auto1.de] INFO: Scrape type for NT47170: 0
2026-03-29 18:33:30 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC55438%27 HTTP/1.1" 200 None
2026-03-29 18:33:30 [auto1.de] INFO: Scrape type for CC55438: 0
2026-03-29 18:33:30 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-29 18:33:30 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC87676%27 HTTP/1.1" 200 None
2026-03-29 18:33:30 [auto1.de] INFO: Scrape type for SC87676: 2
2026-03-29 18:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69736e8f-f4f7-5fc2-baeb-3a534c20edf3 with identifier: SC87676
2026-03-29 18:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69736e8f-f4f7-5fc2-baeb-3a534c20edf3 with scrape type 2
2026-03-29 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69736e8f-f4f7-5fc2-baeb-3a534c20edf3 with scrape type 2
2026-03-29 18:33:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69736e8f-f4f7-5fc2-baeb-3a534c20edf3, identifier: SC87676
2026-03-29 18:33:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69736e8f-f4f7-5fc2-baeb-3a534c20edf3 with identifier: SC87676
2026-03-29 18:33:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69736e8f-f4f7-5fc2-baeb-3a534c20edf3 with identifier: SC87676
2026-03-29 18:33:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69736e8f-f4f7-5fc2-baeb-3a534c20edf3 with identifier: SC87676 to the API
2026-03-29 18:33:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:05:25Z',
'fuel_type': 'diesel',
'id': '69736e8f-f4f7-5fc2-baeb-3a534c20edf3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC87676',
'listing': 'auction',
'make': 'Fiat',
'model': 'Ducato',
'odometer': 136403,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-17',
'seller_name': None,
'title': 'Fiat Ducato 2.0 JTD 115',
'transmission': 'manual',
'trim': '115',
'year': 2013}
2026-03-29 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC87676%27 HTTP/1.1" 200 None
2026-03-29 18:33:31 [auto1.de] INFO: Saving data for SC87676: {'auction_closing_time': 1774883125.0, 'created_time': 1773467115.457249, 'last_price_update_time': 1774809211.530896}
2026-03-29 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC87676') HTTP/1.1" 204 0
2026-03-29 18:33:31 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-29 18:33:31 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-29 18:33:31 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-29 18:33:31 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-29 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN81514%27 HTTP/1.1" 200 None
2026-03-29 18:33:31 [auto1.de] INFO: Scrape type for RN81514: 2
2026-03-29 18:33:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7ffac15-6a06-5ea3-b4e6-895f3267f1e6 with identifier: RN81514
2026-03-29 18:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7ffac15-6a06-5ea3-b4e6-895f3267f1e6 with scrape type 2
2026-03-29 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7ffac15-6a06-5ea3-b4e6-895f3267f1e6 with scrape type 2
2026-03-29 18:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7ffac15-6a06-5ea3-b4e6-895f3267f1e6, identifier: RN81514
2026-03-29 18:33:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7ffac15-6a06-5ea3-b4e6-895f3267f1e6 with identifier: RN81514
2026-03-29 18:33:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7ffac15-6a06-5ea3-b4e6-895f3267f1e6 with identifier: RN81514
2026-03-29 18:33:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7ffac15-6a06-5ea3-b4e6-895f3267f1e6 with identifier: RN81514 to the API
2026-03-29 18:33:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:29:21Z',
'fuel_type': 'diesel',
'id': 'b7ffac15-6a06-5ea3-b4e6-895f3267f1e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN81514',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 151383,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-05',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2009}
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN81514%27 HTTP/1.1" 200 None
2026-03-29 18:33:32 [auto1.de] INFO: Saving data for RN81514: {'auction_closing_time': 1774884561.0, 'created_time': 1773916536.864025, 'last_price_update_time': 1774809212.03487}
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN81514') HTTP/1.1" 204 0
2026-03-29 18:33:32 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY96570%27 HTTP/1.1" 200 None
2026-03-29 18:33:32 [auto1.de] INFO: Scrape type for GY96570: 2
2026-03-29 18:33:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with identifier: GY96570
2026-03-29 18:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with scrape type 2
2026-03-29 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with scrape type 2
2026-03-29 18:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9b4a116-f55d-5e49-aa23-c6dbf61b2494, identifier: GY96570
2026-03-29 18:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with identifier: GY96570
2026-03-29 18:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with identifier: GY96570
2026-03-29 18:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with identifier: GY96570 to the API
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:06:50Z',
'fuel_type': 'diesel',
'id': 'a9b4a116-f55d-5e49-aa23-c6dbf61b2494',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY96570',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 82447,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-01',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
'transmission': 'automatic',
'trim': 'Highline 4Motion',
'year': 2019}
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY96570%27 HTTP/1.1" 200 None
2026-03-29 18:33:32 [auto1.de] INFO: Saving data for GY96570: {'auction_closing_time': 1774883210.0, 'created_time': 1773307460.528637, 'last_price_update_time': 1774809212.496683}
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY96570') HTTP/1.1" 204 0
2026-03-29 18:33:32 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-29 18:33:32 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-29 18:33:32 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-29 18:33:32 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC60552%27 HTTP/1.1" 200 None
2026-03-29 18:33:32 [auto1.de] INFO: Scrape type for UC60552: 0
2026-03-29 18:33:32 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-29 18:33:32 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX68266%27 HTTP/1.1" 200 None
2026-03-29 18:33:32 [auto1.de] INFO: Scrape type for DX68266: 2
2026-03-29 18:33:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd67f9c6-c7b9-5060-b0da-946d9bc75931 with identifier: DX68266
2026-03-29 18:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd67f9c6-c7b9-5060-b0da-946d9bc75931 with scrape type 2
2026-03-29 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd67f9c6-c7b9-5060-b0da-946d9bc75931 with scrape type 2
2026-03-29 18:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd67f9c6-c7b9-5060-b0da-946d9bc75931, identifier: DX68266
2026-03-29 18:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd67f9c6-c7b9-5060-b0da-946d9bc75931 with identifier: DX68266
2026-03-29 18:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd67f9c6-c7b9-5060-b0da-946d9bc75931 with identifier: DX68266
2026-03-29 18:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd67f9c6-c7b9-5060-b0da-946d9bc75931 with identifier: DX68266 to the API
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 121,
'expiration_date': '2026-03-30T15:58:25Z',
'fuel_type': 'diesel',
'id': 'bd67f9c6-c7b9-5060-b0da-946d9bc75931',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX68266',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 137524,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-07',
'seller_name': None,
'title': 'Renault Trafic 1.6 dCi L1H1 2,7t Expression',
'transmission': 'manual',
'trim': 'L1H1 2,7t Expression',
'year': 2019}
2026-03-29 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX68266%27 HTTP/1.1" 200 None
2026-03-29 18:33:33 [auto1.de] INFO: Saving data for DX68266: {'auction_closing_time': 1774886305.0, 'created_time': 1774292886.596666, 'last_price_update_time': 1774809213.007019}
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX68266') HTTP/1.1" 204 0
2026-03-29 18:33:33 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY99153%27 HTTP/1.1" 200 None
2026-03-29 18:33:33 [auto1.de] INFO: Scrape type for FY99153: 2
2026-03-29 18:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a3e8608-53b0-5d36-b2d4-3136604c0247 with identifier: FY99153
2026-03-29 18:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a3e8608-53b0-5d36-b2d4-3136604c0247 with scrape type 2
2026-03-29 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a3e8608-53b0-5d36-b2d4-3136604c0247 with scrape type 2
2026-03-29 18:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a3e8608-53b0-5d36-b2d4-3136604c0247, identifier: FY99153
2026-03-29 18:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a3e8608-53b0-5d36-b2d4-3136604c0247 with identifier: FY99153
2026-03-29 18:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a3e8608-53b0-5d36-b2d4-3136604c0247 with identifier: FY99153
2026-03-29 18:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a3e8608-53b0-5d36-b2d4-3136604c0247 with identifier: FY99153 to the API
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:50:41Z',
'fuel_type': 'petrol',
'id': '7a3e8608-53b0-5d36-b2d4-3136604c0247',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY99153',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 153976,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-13',
'seller_name': None,
'title': 'Seat Leon 1.8 TSI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2018}
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY99153%27 HTTP/1.1" 200 None
2026-03-29 18:33:33 [auto1.de] INFO: Saving data for FY99153: {'auction_closing_time': 1774885841.0, 'created_time': 1774521841.121547, 'last_price_update_time': 1774809213.524575}
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY99153') HTTP/1.1" 204 0
2026-03-29 18:33:33 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-29 18:33:33 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-29 18:33:33 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM43491%27 HTTP/1.1" 200 None
2026-03-29 18:33:33 [auto1.de] INFO: Scrape type for MM43491: 0
2026-03-29 18:33:33 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA10285%27 HTTP/1.1" 200 None
2026-03-29 18:33:33 [auto1.de] INFO: Scrape type for SA10285: 2
2026-03-29 18:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with identifier: SA10285
2026-03-29 18:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with scrape type 2
2026-03-29 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with scrape type 2
2026-03-29 18:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627, identifier: SA10285
2026-03-29 18:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with identifier: SA10285
2026-03-29 18:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with identifier: SA10285
2026-03-29 18:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with identifier: SA10285 to the API
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:30:48Z',
'fuel_type': 'diesel',
'id': '9f5075c7-b95d-56f6-a9c9-1e5a345a4627',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA10285',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 51703,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-07-23',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d Mild-Hybrid 4Matic Avantgarde',
'transmission': 'automatic',
'trim': '4Matic Avantgarde',
'year': 2024}
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA10285%27 HTTP/1.1" 200 None
2026-03-29 18:33:33 [auto1.de] INFO: Saving data for SA10285: {'auction_closing_time': 1774884648.0, 'created_time': 1774607690.565374, 'last_price_update_time': 1774809213.988311}
2026-03-29 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA10285') HTTP/1.1" 204 0
2026-03-29 18:33:34 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-29 18:33:34 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-29 18:33:34 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24864%27 HTTP/1.1" 200 None
2026-03-29 18:33:34 [auto1.de] INFO: Scrape type for PG24864: 2
2026-03-29 18:33:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17237763-604c-519f-93bb-46962e1d116c with identifier: PG24864
2026-03-29 18:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17237763-604c-519f-93bb-46962e1d116c with scrape type 2
2026-03-29 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17237763-604c-519f-93bb-46962e1d116c with scrape type 2
2026-03-29 18:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17237763-604c-519f-93bb-46962e1d116c, identifier: PG24864
2026-03-29 18:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17237763-604c-519f-93bb-46962e1d116c with identifier: PG24864
2026-03-29 18:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17237763-604c-519f-93bb-46962e1d116c with identifier: PG24864
2026-03-29 18:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17237763-604c-519f-93bb-46962e1d116c with identifier: PG24864 to the API
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:44:40Z',
'fuel_type': 'petrol',
'id': '17237763-604c-519f-93bb-46962e1d116c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG24864',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 53276,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-26',
'seller_name': None,
'title': 'Alfa Romeo Giulietta 1.4 Turbo Super',
'transmission': 'manual',
'trim': 'Super',
'year': 2012}
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24864%27 HTTP/1.1" 200 None
2026-03-29 18:33:34 [auto1.de] INFO: Saving data for PG24864: {'auction_closing_time': 1774885480.0, 'created_time': 1773308284.390759, 'last_price_update_time': 1774809214.479983}
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG24864') HTTP/1.1" 204 0
2026-03-29 18:33:34 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-29 18:33:34 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-29 18:33:34 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-29 18:33:34 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-29 18:33:34 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 6740 | hits on page: 40
2026-03-29 18:33:34 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN05463%27 HTTP/1.1" 200 None
2026-03-29 18:33:34 [auto1.de] INFO: Scrape type for BN05463: 0
2026-03-29 18:33:34 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ41763%27 HTTP/1.1" 200 None
2026-03-29 18:33:34 [auto1.de] INFO: Scrape type for VJ41763: 0
2026-03-29 18:33:34 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01132%27 HTTP/1.1" 200 None
2026-03-29 18:33:34 [auto1.de] INFO: Scrape type for KE01132: 0
2026-03-29 18:33:34 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN00007%27 HTTP/1.1" 200 None
2026-03-29 18:33:34 [auto1.de] INFO: Scrape type for FN00007: 0
2026-03-29 18:33:34 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-29 18:33:34 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-29 18:33:34 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU33020%27 HTTP/1.1" 200 None
2026-03-29 18:33:34 [auto1.de] INFO: Scrape type for KU33020: 0
2026-03-29 18:33:34 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY63644%27 HTTP/1.1" 200 None
2026-03-29 18:33:34 [auto1.de] INFO: Scrape type for LY63644: 2
2026-03-29 18:33:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a25f4c2d-a775-539c-9ddf-65c39cf229f2 with identifier: LY63644
2026-03-29 18:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a25f4c2d-a775-539c-9ddf-65c39cf229f2 with scrape type 2
2026-03-29 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a25f4c2d-a775-539c-9ddf-65c39cf229f2 with scrape type 2
2026-03-29 18:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a25f4c2d-a775-539c-9ddf-65c39cf229f2, identifier: LY63644
2026-03-29 18:33:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a25f4c2d-a775-539c-9ddf-65c39cf229f2 with identifier: LY63644
2026-03-29 18:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a25f4c2d-a775-539c-9ddf-65c39cf229f2 with identifier: LY63644
2026-03-29 18:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a25f4c2d-a775-539c-9ddf-65c39cf229f2 with identifier: LY63644 to the API
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:02:54Z',
'fuel_type': 'petrol',
'id': 'a25f4c2d-a775-539c-9ddf-65c39cf229f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY63644',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 21797,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-22',
'seller_name': None,
'title': 'Opel Mokka X 1.2 Turbo Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2022}
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY63644%27 HTTP/1.1" 200 None
2026-03-29 18:33:34 [auto1.de] INFO: Saving data for LY63644: {'auction_closing_time': 1774882974.0, 'created_time': 1774522281.733863, 'last_price_update_time': 1774809214.991833}
2026-03-29 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LY63644') HTTP/1.1" 204 0
2026-03-29 18:33:35 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES42650%27 HTTP/1.1" 200 None
2026-03-29 18:33:35 [auto1.de] INFO: Scrape type for ES42650: 2
2026-03-29 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73380efc-b2b9-51d6-a886-aa1de7481157 with identifier: ES42650
2026-03-29 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73380efc-b2b9-51d6-a886-aa1de7481157 with scrape type 2
2026-03-29 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73380efc-b2b9-51d6-a886-aa1de7481157 with scrape type 2
2026-03-29 18:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73380efc-b2b9-51d6-a886-aa1de7481157, identifier: ES42650
2026-03-29 18:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73380efc-b2b9-51d6-a886-aa1de7481157 with identifier: ES42650
2026-03-29 18:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73380efc-b2b9-51d6-a886-aa1de7481157 with identifier: ES42650
2026-03-29 18:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73380efc-b2b9-51d6-a886-aa1de7481157 with identifier: ES42650 to the API
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:33:34Z',
'fuel_type': 'petrol',
'id': '73380efc-b2b9-51d6-a886-aa1de7481157',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES42650',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 119463,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-23',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.4 TSI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2012}
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES42650%27 HTTP/1.1" 200 None
2026-03-29 18:33:35 [auto1.de] INFO: Saving data for ES42650: {'auction_closing_time': 1774884814.0, 'created_time': 1773830834.98912, 'last_price_update_time': 1774809215.546816}
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES42650') HTTP/1.1" 204 0
2026-03-29 18:33:35 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-29 18:33:35 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE61705%27 HTTP/1.1" 200 None
2026-03-29 18:33:35 [auto1.de] INFO: Scrape type for UE61705: 2
2026-03-29 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21 with identifier: UE61705
2026-03-29 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21 with scrape type 2
2026-03-29 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21 with scrape type 2
2026-03-29 18:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21, identifier: UE61705
2026-03-29 18:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21 with identifier: UE61705
2026-03-29 18:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21 with identifier: UE61705
2026-03-29 18:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21 with identifier: UE61705 to the API
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:01:43Z',
'fuel_type': 'diesel',
'id': '7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE61705',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 293905,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-12',
'seller_name': None,
'title': 'Volkswagen Golf VI 2.0 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2012}
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE61705%27 HTTP/1.1" 200 None
2026-03-29 18:33:35 [auto1.de] INFO: Saving data for UE61705: {'auction_closing_time': 1774882903.0, 'created_time': 1774521621.513815, 'last_price_update_time': 1774809215.946688}
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE61705') HTTP/1.1" 204 0
2026-03-29 18:33:35 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-29 18:33:35 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-29 18:33:35 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-29 18:33:35 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-29 18:33:35 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-29 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR74072%27 HTTP/1.1" 200 None
2026-03-29 18:33:36 [auto1.de] INFO: Scrape type for XR74072: 0
2026-03-29 18:33:36 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH20515%27 HTTP/1.1" 200 None
2026-03-29 18:33:36 [auto1.de] INFO: Scrape type for LH20515: 0
2026-03-29 18:33:36 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED89448%27 HTTP/1.1" 200 None
2026-03-29 18:33:36 [auto1.de] INFO: Scrape type for ED89448: 0
2026-03-29 18:33:36 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF00681%27 HTTP/1.1" 200 None
2026-03-29 18:33:36 [auto1.de] INFO: Scrape type for SF00681: 2
2026-03-29 18:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00 with identifier: SF00681
2026-03-29 18:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00 with scrape type 2
2026-03-29 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00 with scrape type 2
2026-03-29 18:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00, identifier: SF00681
2026-03-29 18:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00 with identifier: SF00681
2026-03-29 18:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00 with identifier: SF00681
2026-03-29 18:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00 with identifier: SF00681 to the API
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:25:38Z',
'fuel_type': 'petrol',
'id': '64e7b1c3-6c3a-570b-a4da-22ce7bbf3d00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF00681',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 120842,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-14',
'seller_name': None,
'title': 'Volkswagen Passat 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF00681%27 HTTP/1.1" 200 None
2026-03-29 18:33:36 [auto1.de] INFO: Saving data for SF00681: {'auction_closing_time': 1774884338.0, 'created_time': 1774510246.907236, 'last_price_update_time': 1774809216.462339}
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF00681') HTTP/1.1" 204 0
2026-03-29 18:33:36 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-29 18:33:36 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE41577%27 HTTP/1.1" 200 None
2026-03-29 18:33:36 [auto1.de] INFO: Scrape type for ZE41577: 2
2026-03-29 18:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with identifier: ZE41577
2026-03-29 18:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with scrape type 2
2026-03-29 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with scrape type 2
2026-03-29 18:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28e0b63b-a1f1-5434-b83d-e69deadc7fa3, identifier: ZE41577
2026-03-29 18:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with identifier: ZE41577
2026-03-29 18:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with identifier: ZE41577
2026-03-29 18:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with identifier: ZE41577 to the API
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:17:30Z',
'fuel_type': 'diesel',
'id': '28e0b63b-a1f1-5434-b83d-e69deadc7fa3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE41577',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 56337,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-19',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid 320 L1 Tourneo Titanium',
'transmission': 'manual',
'trim': '320 L1 Tourneo Titanium',
'year': 2022}
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE41577%27 HTTP/1.1" 200 None
2026-03-29 18:33:37 [auto1.de] INFO: Saving data for ZE41577: {'auction_closing_time': 1774883850.0, 'created_time': 1773513911.847413, 'last_price_update_time': 1774809217.038844}
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE41577') HTTP/1.1" 204 0
2026-03-29 18:33:37 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA81936%27 HTTP/1.1" 200 None
2026-03-29 18:33:37 [auto1.de] INFO: Scrape type for SA81936: 0
2026-03-29 18:33:37 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE00015%27 HTTP/1.1" 200 None
2026-03-29 18:33:37 [auto1.de] INFO: Scrape type for JE00015: 2
2026-03-29 18:33:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6176f648-b148-5cf4-b041-49aeb3343586 with identifier: JE00015
2026-03-29 18:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6176f648-b148-5cf4-b041-49aeb3343586 with scrape type 2
2026-03-29 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6176f648-b148-5cf4-b041-49aeb3343586 with scrape type 2
2026-03-29 18:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6176f648-b148-5cf4-b041-49aeb3343586, identifier: JE00015
2026-03-29 18:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6176f648-b148-5cf4-b041-49aeb3343586 with identifier: JE00015
2026-03-29 18:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6176f648-b148-5cf4-b041-49aeb3343586 with identifier: JE00015
2026-03-29 18:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6176f648-b148-5cf4-b041-49aeb3343586 with identifier: JE00015 to the API
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:13:08Z',
'fuel_type': 'diesel',
'id': '6176f648-b148-5cf4-b041-49aeb3343586',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE00015',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 131026,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-06',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE00015%27 HTTP/1.1" 200 None
2026-03-29 18:33:37 [auto1.de] INFO: Saving data for JE00015: {'auction_closing_time': 1774883588.0, 'created_time': 1773427063.737864, 'last_price_update_time': 1774809217.46504}
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE00015') HTTP/1.1" 204 0
2026-03-29 18:33:37 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-29 18:33:37 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM95943%27 HTTP/1.1" 200 None
2026-03-29 18:33:37 [auto1.de] INFO: Scrape type for UM95943: 2
2026-03-29 18:33:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f706def7-857d-5d05-82c1-9b0ada2e70be with identifier: UM95943
2026-03-29 18:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f706def7-857d-5d05-82c1-9b0ada2e70be with scrape type 2
2026-03-29 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f706def7-857d-5d05-82c1-9b0ada2e70be with scrape type 2
2026-03-29 18:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f706def7-857d-5d05-82c1-9b0ada2e70be, identifier: UM95943
2026-03-29 18:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f706def7-857d-5d05-82c1-9b0ada2e70be with identifier: UM95943
2026-03-29 18:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f706def7-857d-5d05-82c1-9b0ada2e70be with identifier: UM95943
2026-03-29 18:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f706def7-857d-5d05-82c1-9b0ada2e70be with identifier: UM95943 to the API
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:03:53Z',
'fuel_type': 'petrol',
'id': 'f706def7-857d-5d05-82c1-9b0ada2e70be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM95943',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 107240,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-04',
'seller_name': None,
'title': 'Seat Ibiza 1.2 TSI Connect',
'transmission': 'manual',
'trim': 'Connect',
'year': 2016}
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM95943%27 HTTP/1.1" 200 None
2026-03-29 18:33:37 [auto1.de] INFO: Saving data for UM95943: {'auction_closing_time': 1774883033.0, 'created_time': 1774290721.434664, 'last_price_update_time': 1774809217.944021}
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM95943') HTTP/1.1" 204 0
2026-03-29 18:33:37 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46633%27 HTTP/1.1" 200 None
2026-03-29 18:33:37 [auto1.de] INFO: Scrape type for ZS46633: 2
2026-03-29 18:33:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16a8ca54-f1c9-54af-8c63-909933dca976 with identifier: ZS46633
2026-03-29 18:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16a8ca54-f1c9-54af-8c63-909933dca976 with scrape type 2
2026-03-29 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16a8ca54-f1c9-54af-8c63-909933dca976 with scrape type 2
2026-03-29 18:33:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16a8ca54-f1c9-54af-8c63-909933dca976, identifier: ZS46633
2026-03-29 18:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16a8ca54-f1c9-54af-8c63-909933dca976 with identifier: ZS46633
2026-03-29 18:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16a8ca54-f1c9-54af-8c63-909933dca976 with identifier: ZS46633
2026-03-29 18:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16a8ca54-f1c9-54af-8c63-909933dca976 with identifier: ZS46633 to the API
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 195,
'expiration_date': '2026-03-30T15:00:57Z',
'fuel_type': 'diesel',
'id': '16a8ca54-f1c9-54af-8c63-909933dca976',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS46633',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 120588,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-14',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2018}
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46633%27 HTTP/1.1" 200 None
2026-03-29 18:33:38 [auto1.de] INFO: Saving data for ZS46633: {'auction_closing_time': 1774882857.0, 'created_time': 1774294707.804659, 'last_price_update_time': 1774809218.426936}
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS46633') HTTP/1.1" 204 0
2026-03-29 18:33:38 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64432%27 HTTP/1.1" 200 None
2026-03-29 18:33:38 [auto1.de] INFO: Scrape type for JS64432: 0
2026-03-29 18:33:38 [auto1.de] INFO: Found listing with ID: US49854
2026-03-29 18:33:38 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD14847%27 HTTP/1.1" 200 None
2026-03-29 18:33:38 [auto1.de] INFO: Scrape type for UD14847: 2
2026-03-29 18:33:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with identifier: UD14847
2026-03-29 18:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with scrape type 2
2026-03-29 18:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with scrape type 2
2026-03-29 18:33:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84f3d58e-c0bb-5e60-934b-ebe9742324a8, identifier: UD14847
2026-03-29 18:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with identifier: UD14847
2026-03-29 18:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with identifier: UD14847
2026-03-29 18:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with identifier: UD14847 to the API
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:35:41Z',
'fuel_type': 'petrol',
'id': '84f3d58e-c0bb-5e60-934b-ebe9742324a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD14847',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 81152,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-31',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD14847%27 HTTP/1.1" 200 None
2026-03-29 18:33:38 [auto1.de] INFO: Saving data for UD14847: {'auction_closing_time': 1774884941.0, 'created_time': 1773427501.291969, 'last_price_update_time': 1774809218.88072}
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD14847') HTTP/1.1" 204 0
2026-03-29 18:33:38 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-29 18:33:38 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32972%27 HTTP/1.1" 200 None
2026-03-29 18:33:38 [auto1.de] INFO: Scrape type for NZ32972: 2
2026-03-29 18:33:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d045e022-fae0-51ca-ac59-5b21aaa3acee with identifier: NZ32972
2026-03-29 18:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d045e022-fae0-51ca-ac59-5b21aaa3acee with scrape type 2
2026-03-29 18:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d045e022-fae0-51ca-ac59-5b21aaa3acee with scrape type 2
2026-03-29 18:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d045e022-fae0-51ca-ac59-5b21aaa3acee, identifier: NZ32972
2026-03-29 18:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d045e022-fae0-51ca-ac59-5b21aaa3acee with identifier: NZ32972
2026-03-29 18:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d045e022-fae0-51ca-ac59-5b21aaa3acee with identifier: NZ32972
2026-03-29 18:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d045e022-fae0-51ca-ac59-5b21aaa3acee with identifier: NZ32972 to the API
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:54:35Z',
'fuel_type': 'petrol',
'id': 'd045e022-fae0-51ca-ac59-5b21aaa3acee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ32972',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 17377,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-10',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 Mild-Hybrid Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2024}
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32972%27 HTTP/1.1" 200 None
2026-03-29 18:33:39 [auto1.de] INFO: Saving data for NZ32972: {'auction_closing_time': 1774886075.0, 'created_time': 1773136526.977073, 'last_price_update_time': 1774809219.367423}
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ32972') HTTP/1.1" 204 0
2026-03-29 18:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:33:39 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-29 18:33:39 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-29 18:33:39 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-29 18:33:39 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB74366%27 HTTP/1.1" 200 None
2026-03-29 18:33:39 [auto1.de] INFO: Scrape type for ZB74366: 0
2026-03-29 18:33:39 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39713%27 HTTP/1.1" 200 None
2026-03-29 18:33:39 [auto1.de] INFO: Scrape type for KF39713: 0
2026-03-29 18:33:39 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-29 18:33:39 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY11970%27 HTTP/1.1" 200 None
2026-03-29 18:33:39 [auto1.de] INFO: Scrape type for GY11970: 0
2026-03-29 18:33:39 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR26970%27 HTTP/1.1" 200 None
2026-03-29 18:33:39 [auto1.de] INFO: Scrape type for XR26970: 2
2026-03-29 18:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27715857-0716-53a3-b808-ec5d7e777291 with identifier: XR26970
2026-03-29 18:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27715857-0716-53a3-b808-ec5d7e777291 with scrape type 2
2026-03-29 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27715857-0716-53a3-b808-ec5d7e777291 with scrape type 2
2026-03-29 18:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27715857-0716-53a3-b808-ec5d7e777291, identifier: XR26970
2026-03-29 18:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27715857-0716-53a3-b808-ec5d7e777291 with identifier: XR26970
2026-03-29 18:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27715857-0716-53a3-b808-ec5d7e777291 with identifier: XR26970
2026-03-29 18:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27715857-0716-53a3-b808-ec5d7e777291 with identifier: XR26970 to the API
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:26:04Z',
'fuel_type': 'diesel',
'id': '27715857-0716-53a3-b808-ec5d7e777291',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR26970',
'listing': 'auction',
'make': 'Kia',
'model': 'Carens',
'odometer': 119055,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-26',
'seller_name': None,
'title': 'Kia Carens 1.7 CRDi FIFA World Cup Edition',
'transmission': 'manual',
'trim': 'FIFA World Cup Edition',
'year': 2015}
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR26970%27 HTTP/1.1" 200 None
2026-03-29 18:33:39 [auto1.de] INFO: Saving data for XR26970: {'auction_closing_time': 1774884364.0, 'created_time': 1773307846.300018, 'last_price_update_time': 1774809219.982265}
2026-03-29 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR26970') HTTP/1.1" 204 0
2026-03-29 18:33:40 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD66077%27 HTTP/1.1" 200 None
2026-03-29 18:33:40 [auto1.de] INFO: Scrape type for BD66077: 0
2026-03-29 18:33:40 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 6740 | hits on page: 40
2026-03-29 18:33:40 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-29 18:33:40 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG64287%27 HTTP/1.1" 200 None
2026-03-29 18:33:40 [auto1.de] INFO: Scrape type for AG64287: 0
2026-03-29 18:33:40 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48468%27 HTTP/1.1" 200 None
2026-03-29 18:33:40 [auto1.de] INFO: Scrape type for MY48468: 0
2026-03-29 18:33:40 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-29 18:33:40 [auto1.de] INFO: Found listing with ID: VU33733
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU33733%27 HTTP/1.1" 200 None
2026-03-29 18:33:40 [auto1.de] INFO: Scrape type for VU33733: 2
2026-03-29 18:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6e8f7d5-a5c0-5e88-88da-279c9a87f349 with identifier: VU33733
2026-03-29 18:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6e8f7d5-a5c0-5e88-88da-279c9a87f349 with scrape type 2
2026-03-29 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6e8f7d5-a5c0-5e88-88da-279c9a87f349 with scrape type 2
2026-03-29 18:33:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6e8f7d5-a5c0-5e88-88da-279c9a87f349, identifier: VU33733
2026-03-29 18:33:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:33:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6e8f7d5-a5c0-5e88-88da-279c9a87f349 with identifier: VU33733
2026-03-29 18:33:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6e8f7d5-a5c0-5e88-88da-279c9a87f349 with identifier: VU33733
2026-03-29 18:33:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6e8f7d5-a5c0-5e88-88da-279c9a87f349 with identifier: VU33733 to the API
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:18:05Z',
'fuel_type': 'petrol',
'id': 'a6e8f7d5-a5c0-5e88-88da-279c9a87f349',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU33733',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 187259,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-30',
'seller_name': None,
'title': 'Seat Ibiza 1.4 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2011}
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU33733%27 HTTP/1.1" 200 None
2026-03-29 18:33:40 [auto1.de] INFO: Saving data for VU33733: {'auction_closing_time': 1774883885.0, 'created_time': 1774349758.791307, 'last_price_update_time': 1774809220.462401}
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU33733') HTTP/1.1" 204 0
2026-03-29 18:33:40 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK95510%27 HTTP/1.1" 200 None
2026-03-29 18:33:40 [auto1.de] INFO: Scrape type for FK95510: 0
2026-03-29 18:33:40 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF75644%27 HTTP/1.1" 200 None
2026-03-29 18:33:40 [auto1.de] INFO: Scrape type for MF75644: 0
2026-03-29 18:33:40 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-29 18:33:40 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF57036%27 HTTP/1.1" 200 None
2026-03-29 18:33:40 [auto1.de] INFO: Scrape type for BF57036: 2
2026-03-29 18:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d358263b-4490-5d1a-9022-1a5e059723da with identifier: BF57036
2026-03-29 18:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d358263b-4490-5d1a-9022-1a5e059723da with scrape type 2
2026-03-29 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d358263b-4490-5d1a-9022-1a5e059723da with scrape type 2
2026-03-29 18:33:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d358263b-4490-5d1a-9022-1a5e059723da, identifier: BF57036
2026-03-29 18:33:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d358263b-4490-5d1a-9022-1a5e059723da with identifier: BF57036
2026-03-29 18:33:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d358263b-4490-5d1a-9022-1a5e059723da with identifier: BF57036
2026-03-29 18:33:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d358263b-4490-5d1a-9022-1a5e059723da with identifier: BF57036 to the API
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:32:05Z',
'fuel_type': 'petrol',
'id': 'd358263b-4490-5d1a-9022-1a5e059723da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF57036',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 78362,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-16',
'seller_name': None,
'title': 'Volkswagen Caddy 1.0 TSI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2019}
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF57036%27 HTTP/1.1" 200 None
2026-03-29 18:33:41 [auto1.de] INFO: Saving data for BF57036: {'auction_closing_time': 1774884725.0, 'created_time': 1773859593.650749, 'last_price_update_time': 1774809221.053595}
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF57036') HTTP/1.1" 204 0
2026-03-29 18:33:41 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-29 18:33:41 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-29 18:33:41 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-29 18:33:41 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS37801%27 HTTP/1.1" 200 None
2026-03-29 18:33:41 [auto1.de] INFO: Scrape type for BS37801: 0
2026-03-29 18:33:41 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-29 18:33:41 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-29 18:33:41 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-29 18:33:41 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-29 18:33:41 [auto1.de] INFO: Found listing with ID: TU08005
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU08005%27 HTTP/1.1" 200 None
2026-03-29 18:33:41 [auto1.de] INFO: Scrape type for TU08005: 2
2026-03-29 18:33:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a36c230-c7de-509b-8e4b-77ad15c3b528 with identifier: TU08005
2026-03-29 18:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a36c230-c7de-509b-8e4b-77ad15c3b528 with scrape type 2
2026-03-29 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a36c230-c7de-509b-8e4b-77ad15c3b528 with scrape type 2
2026-03-29 18:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a36c230-c7de-509b-8e4b-77ad15c3b528, identifier: TU08005
2026-03-29 18:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a36c230-c7de-509b-8e4b-77ad15c3b528 with identifier: TU08005
2026-03-29 18:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a36c230-c7de-509b-8e4b-77ad15c3b528 with identifier: TU08005
2026-03-29 18:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a36c230-c7de-509b-8e4b-77ad15c3b528 with identifier: TU08005 to the API
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 193,
'expiration_date': '2026-03-30T15:06:45Z',
'fuel_type': 'petrol',
'id': '3a36c230-c7de-509b-8e4b-77ad15c3b528',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU08005',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 202541,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-09-03',
'seller_name': None,
'title': 'Audi A6 2.8 V6',
'transmission': 'automatic',
'trim': '',
'year': 1998}
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU08005%27 HTTP/1.1" 200 None
2026-03-29 18:33:41 [auto1.de] INFO: Saving data for TU08005: {'auction_closing_time': 1774883205.0, 'created_time': 1774034452.587275, 'last_price_update_time': 1774809221.516237}
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU08005') HTTP/1.1" 204 0
2026-03-29 18:33:41 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-29 18:33:41 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG93130%27 HTTP/1.1" 200 None
2026-03-29 18:33:41 [auto1.de] INFO: Scrape type for GG93130: 0
2026-03-29 18:33:41 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC57196%27 HTTP/1.1" 200 None
2026-03-29 18:33:41 [auto1.de] INFO: Scrape type for UC57196: 0
2026-03-29 18:33:41 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35268%27 HTTP/1.1" 200 None
2026-03-29 18:33:41 [auto1.de] INFO: Scrape type for NR35268: 2
2026-03-29 18:33:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbde5c8b-caec-5be7-b8fc-33d8767b0773 with identifier: NR35268
2026-03-29 18:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbde5c8b-caec-5be7-b8fc-33d8767b0773 with scrape type 2
2026-03-29 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbde5c8b-caec-5be7-b8fc-33d8767b0773 with scrape type 2
2026-03-29 18:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbde5c8b-caec-5be7-b8fc-33d8767b0773, identifier: NR35268
2026-03-29 18:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbde5c8b-caec-5be7-b8fc-33d8767b0773 with identifier: NR35268
2026-03-29 18:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbde5c8b-caec-5be7-b8fc-33d8767b0773 with identifier: NR35268
2026-03-29 18:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbde5c8b-caec-5be7-b8fc-33d8767b0773 with identifier: NR35268 to the API
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:08:24Z',
'fuel_type': 'diesel',
'id': 'fbde5c8b-caec-5be7-b8fc-33d8767b0773',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR35268',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 197345,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-02',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2020}
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35268%27 HTTP/1.1" 200 None
2026-03-29 18:33:42 [auto1.de] INFO: Saving data for NR35268: {'auction_closing_time': 1774883304.0, 'created_time': 1774607746.049985, 'last_price_update_time': 1774809222.103017}
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR35268') HTTP/1.1" 204 0
2026-03-29 18:33:42 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC31654%27 HTTP/1.1" 200 None
2026-03-29 18:33:42 [auto1.de] INFO: Scrape type for UC31654: 0
2026-03-29 18:33:42 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-29 18:33:42 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-29 18:33:42 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML06015%27 HTTP/1.1" 200 None
2026-03-29 18:33:42 [auto1.de] INFO: Scrape type for ML06015: 2
2026-03-29 18:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de114ebc-818a-502f-a40f-d6997410382e with identifier: ML06015
2026-03-29 18:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de114ebc-818a-502f-a40f-d6997410382e with scrape type 2
2026-03-29 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de114ebc-818a-502f-a40f-d6997410382e with scrape type 2
2026-03-29 18:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de114ebc-818a-502f-a40f-d6997410382e, identifier: ML06015
2026-03-29 18:33:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de114ebc-818a-502f-a40f-d6997410382e with identifier: ML06015
2026-03-29 18:33:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de114ebc-818a-502f-a40f-d6997410382e with identifier: ML06015
2026-03-29 18:33:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de114ebc-818a-502f-a40f-d6997410382e with identifier: ML06015 to the API
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:14:02Z',
'fuel_type': 'petrol',
'id': 'de114ebc-818a-502f-a40f-d6997410382e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML06015',
'listing': 'auction',
'make': 'Toyota',
'model': 'Verso-S',
'odometer': 64641,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-17',
'seller_name': None,
'title': 'Toyota Verso-S 1.33 Dual VVT-i Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2011}
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML06015%27 HTTP/1.1" 200 None
2026-03-29 18:33:42 [auto1.de] INFO: Saving data for ML06015: {'auction_closing_time': 1774883642.0, 'created_time': 1773859275.036936, 'last_price_update_time': 1774809222.568865}
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML06015') HTTP/1.1" 204 0
2026-03-29 18:33:42 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-29 18:33:42 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-29 18:33:42 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-29 18:33:42 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD76809%27 HTTP/1.1" 200 None
2026-03-29 18:33:42 [auto1.de] INFO: Scrape type for CD76809: 0
2026-03-29 18:33:42 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-29 18:33:42 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18739%27 HTTP/1.1" 200 None
2026-03-29 18:33:42 [auto1.de] INFO: Scrape type for TV18739: 2
2026-03-29 18:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a346cde0-3651-5cfc-85a0-4438ac05b9c4 with identifier: TV18739
2026-03-29 18:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a346cde0-3651-5cfc-85a0-4438ac05b9c4 with scrape type 2
2026-03-29 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a346cde0-3651-5cfc-85a0-4438ac05b9c4 with scrape type 2
2026-03-29 18:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a346cde0-3651-5cfc-85a0-4438ac05b9c4, identifier: TV18739
2026-03-29 18:33:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a346cde0-3651-5cfc-85a0-4438ac05b9c4 with identifier: TV18739
2026-03-29 18:33:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a346cde0-3651-5cfc-85a0-4438ac05b9c4 with identifier: TV18739
2026-03-29 18:33:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a346cde0-3651-5cfc-85a0-4438ac05b9c4 with identifier: TV18739 to the API
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:58:21Z',
'fuel_type': 'petrol',
'id': 'a346cde0-3651-5cfc-85a0-4438ac05b9c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV18739',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 50535,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-11',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'year': 2017}
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18739%27 HTTP/1.1" 200 None
2026-03-29 18:33:43 [auto1.de] INFO: Saving data for TV18739: {'auction_closing_time': 1774886301.0, 'created_time': 1773514026.253043, 'last_price_update_time': 1774809223.08193}
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV18739') HTTP/1.1" 204 0
2026-03-29 18:33:43 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-29 18:33:43 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE77460%27 HTTP/1.1" 200 None
2026-03-29 18:33:43 [auto1.de] INFO: Scrape type for EE77460: 0
2026-03-29 18:33:43 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-29 18:33:43 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-29 18:33:43 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS26285%27 HTTP/1.1" 200 None
2026-03-29 18:33:43 [auto1.de] INFO: Scrape type for KS26285: 2
2026-03-29 18:33:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fe3bd58-ac24-5d19-984d-7a9f503563cb with identifier: KS26285
2026-03-29 18:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb with scrape type 2
2026-03-29 18:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb with scrape type 2
2026-03-29 18:33:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2fe3bd58-ac24-5d19-984d-7a9f503563cb, identifier: KS26285
2026-03-29 18:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2fe3bd58-ac24-5d19-984d-7a9f503563cb with identifier: KS26285
2026-03-29 18:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2fe3bd58-ac24-5d19-984d-7a9f503563cb with identifier: KS26285
2026-03-29 18:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2fe3bd58-ac24-5d19-984d-7a9f503563cb with identifier: KS26285 to the API
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:14:15Z',
'fuel_type': 'diesel',
'id': '2fe3bd58-ac24-5d19-984d-7a9f503563cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS26285',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 140947,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-17',
'seller_name': None,
'title': 'Volkswagen Passat 1.6 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2011}
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS26285%27 HTTP/1.1" 200 None
2026-03-29 18:33:43 [auto1.de] INFO: Saving data for KS26285: {'auction_closing_time': 1774883655.0, 'created_time': 1774607618.889081, 'last_price_update_time': 1774809223.614043}
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS26285') HTTP/1.1" 204 0
2026-03-29 18:33:43 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39650%27 HTTP/1.1" 200 None
2026-03-29 18:33:43 [auto1.de] INFO: Scrape type for EG39650: 2
2026-03-29 18:33:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with identifier: EG39650
2026-03-29 18:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with scrape type 2
2026-03-29 18:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with scrape type 2
2026-03-29 18:33:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eeafaff6-53e5-5f11-8bfc-7fca17bbadd7, identifier: EG39650
2026-03-29 18:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with identifier: EG39650
2026-03-29 18:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with identifier: EG39650
2026-03-29 18:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with identifier: EG39650 to the API
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:08:58Z',
'fuel_type': 'petrol',
'id': 'eeafaff6-53e5-5f11-8bfc-7fca17bbadd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG39650',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 23305,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-30',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.5 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2022}
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39650%27 HTTP/1.1" 200 None
2026-03-29 18:33:44 [auto1.de] INFO: Saving data for EG39650: {'auction_closing_time': 1774883338.0, 'created_time': 1773427446.950694, 'last_price_update_time': 1774809224.084693}
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG39650') HTTP/1.1" 204 0
2026-03-29 18:33:44 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42738%27 HTTP/1.1" 200 None
2026-03-29 18:33:44 [auto1.de] INFO: Scrape type for GJ42738: 0
2026-03-29 18:33:44 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF55006%27 HTTP/1.1" 200 None
2026-03-29 18:33:44 [auto1.de] INFO: Scrape type for XF55006: 2
2026-03-29 18:33:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca83185e-10e0-55c1-aafe-0031eff06766 with identifier: XF55006
2026-03-29 18:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca83185e-10e0-55c1-aafe-0031eff06766 with scrape type 2
2026-03-29 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca83185e-10e0-55c1-aafe-0031eff06766 with scrape type 2
2026-03-29 18:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca83185e-10e0-55c1-aafe-0031eff06766, identifier: XF55006
2026-03-29 18:33:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca83185e-10e0-55c1-aafe-0031eff06766 with identifier: XF55006
2026-03-29 18:33:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca83185e-10e0-55c1-aafe-0031eff06766 with identifier: XF55006
2026-03-29 18:33:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca83185e-10e0-55c1-aafe-0031eff06766 with identifier: XF55006 to the API
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:48:36Z',
'fuel_type': 'petrol',
'id': 'ca83185e-10e0-55c1-aafe-0031eff06766',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF55006',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 67714,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-19',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.5 TSI ACT Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2020}
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF55006%27 HTTP/1.1" 200 None
2026-03-29 18:33:44 [auto1.de] INFO: Saving data for XF55006: {'auction_closing_time': 1774885716.0, 'created_time': 1773133734.026963, 'last_price_update_time': 1774809224.560017}
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF55006') HTTP/1.1" 204 0
2026-03-29 18:33:44 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 6740 | hits on page: 40
2026-03-29 18:33:44 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH46132%27 HTTP/1.1" 200 None
2026-03-29 18:33:44 [auto1.de] INFO: Scrape type for KH46132: 2
2026-03-29 18:33:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aecf218-ebd9-5529-aea2-fe91ca5d706f with identifier: KH46132
2026-03-29 18:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aecf218-ebd9-5529-aea2-fe91ca5d706f with scrape type 2
2026-03-29 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aecf218-ebd9-5529-aea2-fe91ca5d706f with scrape type 2
2026-03-29 18:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9aecf218-ebd9-5529-aea2-fe91ca5d706f, identifier: KH46132
2026-03-29 18:33:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:33:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9aecf218-ebd9-5529-aea2-fe91ca5d706f with identifier: KH46132
2026-03-29 18:33:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9aecf218-ebd9-5529-aea2-fe91ca5d706f with identifier: KH46132
2026-03-29 18:33:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9aecf218-ebd9-5529-aea2-fe91ca5d706f with identifier: KH46132 to the API
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 145,
'expiration_date': '2026-03-30T15:34:20Z',
'fuel_type': 'petrol',
'id': '9aecf218-ebd9-5529-aea2-fe91ca5d706f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH46132',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 161139,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-10',
'seller_name': None,
'title': 'Audi A5 Sportback 1.8 TFSI',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH46132%27 HTTP/1.1" 200 None
2026-03-29 18:33:45 [auto1.de] INFO: Saving data for KH46132: {'auction_closing_time': 1774884860.0, 'created_time': 1773662246.605323, 'last_price_update_time': 1774809225.006118}
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH46132') HTTP/1.1" 204 0
2026-03-29 18:33:45 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF88464%27 HTTP/1.1" 200 None
2026-03-29 18:33:45 [auto1.de] INFO: Scrape type for AF88464: 0
2026-03-29 18:33:45 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89104%27 HTTP/1.1" 200 None
2026-03-29 18:33:45 [auto1.de] INFO: Scrape type for HA89104: 2
2026-03-29 18:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a1a4486-9c78-5465-9509-4c7b0fdabced with identifier: HA89104
2026-03-29 18:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a1a4486-9c78-5465-9509-4c7b0fdabced with scrape type 2
2026-03-29 18:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a1a4486-9c78-5465-9509-4c7b0fdabced with scrape type 2
2026-03-29 18:33:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a1a4486-9c78-5465-9509-4c7b0fdabced, identifier: HA89104
2026-03-29 18:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a1a4486-9c78-5465-9509-4c7b0fdabced with identifier: HA89104
2026-03-29 18:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a1a4486-9c78-5465-9509-4c7b0fdabced with identifier: HA89104
2026-03-29 18:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a1a4486-9c78-5465-9509-4c7b0fdabced with identifier: HA89104 to the API
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 98,
'expiration_date': '2026-03-30T15:16:32Z',
'fuel_type': 'petrol',
'id': '6a1a4486-9c78-5465-9509-4c7b0fdabced',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA89104',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 100824,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-29',
'seller_name': None,
'title': 'MINI Countryman One',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89104%27 HTTP/1.1" 200 None
2026-03-29 18:33:45 [auto1.de] INFO: Saving data for HA89104: {'auction_closing_time': 1774883792.0, 'created_time': 1774264672.881636, 'last_price_update_time': 1774809225.464668}
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA89104') HTTP/1.1" 204 0
2026-03-29 18:33:45 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-29 18:33:45 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-29 18:33:45 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27996%27 HTTP/1.1" 200 None
2026-03-29 18:33:45 [auto1.de] INFO: Scrape type for DM27996: 2
2026-03-29 18:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with identifier: DM27996
2026-03-29 18:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with scrape type 2
2026-03-29 18:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with scrape type 2
2026-03-29 18:33:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d, identifier: DM27996
2026-03-29 18:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with identifier: DM27996
2026-03-29 18:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with identifier: DM27996
2026-03-29 18:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with identifier: DM27996 to the API
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:56:32Z',
'fuel_type': 'diesel',
'id': '7bc00823-3ffb-544d-be7d-5f2e5ea06d2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM27996',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 111162,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-22',
'seller_name': None,
'title': 'BMW X1 xDrive 18d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2018}
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27996%27 HTTP/1.1" 200 None
2026-03-29 18:33:46 [auto1.de] INFO: Saving data for DM27996: {'auction_closing_time': 1774886192.0, 'created_time': 1773305985.666831, 'last_price_update_time': 1774809226.022187}
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM27996') HTTP/1.1" 204 0
2026-03-29 18:33:46 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-29 18:33:46 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-29 18:33:46 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-29 18:33:46 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA46272%27 HTTP/1.1" 200 None
2026-03-29 18:33:46 [auto1.de] INFO: Scrape type for AA46272: 2
2026-03-29 18:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 723feae3-4ae9-504d-a75a-1bfde2e289fc with identifier: AA46272
2026-03-29 18:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 723feae3-4ae9-504d-a75a-1bfde2e289fc with scrape type 2
2026-03-29 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 723feae3-4ae9-504d-a75a-1bfde2e289fc with scrape type 2
2026-03-29 18:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 723feae3-4ae9-504d-a75a-1bfde2e289fc, identifier: AA46272
2026-03-29 18:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 723feae3-4ae9-504d-a75a-1bfde2e289fc with identifier: AA46272
2026-03-29 18:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 723feae3-4ae9-504d-a75a-1bfde2e289fc with identifier: AA46272
2026-03-29 18:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 723feae3-4ae9-504d-a75a-1bfde2e289fc with identifier: AA46272 to the API
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:02:05Z',
'fuel_type': 'petrol',
'id': '723feae3-4ae9-504d-a75a-1bfde2e289fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA46272',
'listing': 'auction',
'make': 'MINI',
'model': 'Cabrio',
'odometer': 61934,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-18',
'seller_name': None,
'title': 'MINI Cabrio Cooper S',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA46272%27 HTTP/1.1" 200 None
2026-03-29 18:33:46 [auto1.de] INFO: Saving data for AA46272: {'auction_closing_time': 1774882925.0, 'created_time': 1774636256.127426, 'last_price_update_time': 1774809226.440645}
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA46272') HTTP/1.1" 204 0
2026-03-29 18:33:46 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-29 18:33:46 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-29 18:33:46 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT53548%27 HTTP/1.1" 200 None
2026-03-29 18:33:46 [auto1.de] INFO: Scrape type for ZT53548: 0
2026-03-29 18:33:46 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-29 18:33:46 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-29 18:33:46 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG77480%27 HTTP/1.1" 200 None
2026-03-29 18:33:46 [auto1.de] INFO: Scrape type for XG77480: 2
2026-03-29 18:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with identifier: XG77480
2026-03-29 18:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with scrape type 2
2026-03-29 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with scrape type 2
2026-03-29 18:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7cd9e71-a84d-59aa-9f21-4ac67d5a0338, identifier: XG77480
2026-03-29 18:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with identifier: XG77480
2026-03-29 18:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with identifier: XG77480
2026-03-29 18:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with identifier: XG77480 to the API
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:19:49Z',
'fuel_type': 'diesel',
'id': 'f7cd9e71-a84d-59aa-9f21-4ac67d5a0338',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG77480',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 222934,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-07',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2013}
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG77480%27 HTTP/1.1" 200 None
2026-03-29 18:33:46 [auto1.de] INFO: Saving data for XG77480: {'auction_closing_time': 1774883989.0, 'created_time': 1773659518.963642, 'last_price_update_time': 1774809226.929529}
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG77480') HTTP/1.1" 204 0
2026-03-29 18:33:47 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM78577%27 HTTP/1.1" 200 None
2026-03-29 18:33:47 [auto1.de] INFO: Scrape type for AM78577: 0
2026-03-29 18:33:47 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-29 18:33:47 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR92717%27 HTTP/1.1" 200 None
2026-03-29 18:33:47 [auto1.de] INFO: Scrape type for FR92717: 2
2026-03-29 18:33:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with identifier: FR92717
2026-03-29 18:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with scrape type 2
2026-03-29 18:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with scrape type 2
2026-03-29 18:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcf531ae-96c1-569c-a7c7-f12a6e59abd6, identifier: FR92717
2026-03-29 18:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with identifier: FR92717
2026-03-29 18:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with identifier: FR92717
2026-03-29 18:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with identifier: FR92717 to the API
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:01:56Z',
'fuel_type': 'diesel',
'id': 'fcf531ae-96c1-569c-a7c7-f12a6e59abd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR92717',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 195183,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-31',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2010}
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR92717%27 HTTP/1.1" 200 None
2026-03-29 18:33:47 [auto1.de] INFO: Saving data for FR92717: {'auction_closing_time': 1774882916.0, 'created_time': 1774607875.210748, 'last_price_update_time': 1774809227.486942}
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR92717') HTTP/1.1" 204 0
2026-03-29 18:33:47 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-29 18:33:47 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL19832%27 HTTP/1.1" 200 None
2026-03-29 18:33:47 [auto1.de] INFO: Scrape type for RL19832: 0
2026-03-29 18:33:47 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-29 18:33:47 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02841%27 HTTP/1.1" 200 None
2026-03-29 18:33:47 [auto1.de] INFO: Scrape type for FB02841: 0
2026-03-29 18:33:47 [auto1.de] INFO: Found listing with ID: PW12132
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12132%27 HTTP/1.1" 200 None
2026-03-29 18:33:47 [auto1.de] INFO: Scrape type for PW12132: 2
2026-03-29 18:33:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e801c8b0-4bce-5ff9-90dd-820987634a68 with identifier: PW12132
2026-03-29 18:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e801c8b0-4bce-5ff9-90dd-820987634a68 with scrape type 2
2026-03-29 18:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e801c8b0-4bce-5ff9-90dd-820987634a68 with scrape type 2
2026-03-29 18:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e801c8b0-4bce-5ff9-90dd-820987634a68, identifier: PW12132
2026-03-29 18:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e801c8b0-4bce-5ff9-90dd-820987634a68 with identifier: PW12132
2026-03-29 18:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e801c8b0-4bce-5ff9-90dd-820987634a68 with identifier: PW12132
2026-03-29 18:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e801c8b0-4bce-5ff9-90dd-820987634a68 with identifier: PW12132 to the API
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 194,
'expiration_date': '2026-03-30T15:34:32Z',
'fuel_type': 'diesel',
'id': 'e801c8b0-4bce-5ff9-90dd-820987634a68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW12132',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 97495,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-07',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2019}
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12132%27 HTTP/1.1" 200 None
2026-03-29 18:33:47 [auto1.de] INFO: Saving data for PW12132: {'auction_closing_time': 1774884872.0, 'created_time': 1774118553.342233, 'last_price_update_time': 1774809227.918851}
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW12132') HTTP/1.1" 204 0
2026-03-29 18:33:47 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-29 18:33:47 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-29 18:33:47 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT04254%27 HTTP/1.1" 200 None
2026-03-29 18:33:47 [auto1.de] INFO: Scrape type for NT04254: 2
2026-03-29 18:33:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba with identifier: NT04254
2026-03-29 18:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba with scrape type 2
2026-03-29 18:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba with scrape type 2
2026-03-29 18:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba, identifier: NT04254
2026-03-29 18:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba with identifier: NT04254
2026-03-29 18:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba with identifier: NT04254
2026-03-29 18:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba with identifier: NT04254 to the API
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:55:46Z',
'fuel_type': 'petrol',
'id': 'fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT04254',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 112135,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-27',
'seller_name': None,
'title': 'Fiat 500 1.2 S',
'transmission': 'manual',
'trim': 'S',
'year': 2013}
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT04254%27 HTTP/1.1" 200 None
2026-03-29 18:33:48 [auto1.de] INFO: Saving data for NT04254: {'auction_closing_time': 1774886146.0, 'created_time': 1774522465.74423, 'last_price_update_time': 1774809228.351899}
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT04254') HTTP/1.1" 204 0
2026-03-29 18:33:48 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-29 18:33:48 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-29 18:33:48 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-29 18:33:48 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL62984%27 HTTP/1.1" 200 None
2026-03-29 18:33:48 [auto1.de] INFO: Scrape type for CL62984: 0
2026-03-29 18:33:48 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91786%27 HTTP/1.1" 200 None
2026-03-29 18:33:48 [auto1.de] INFO: Scrape type for GV91786: 2
2026-03-29 18:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf668407-154f-5b4a-a50e-a5a0cf8951ce with identifier: GV91786
2026-03-29 18:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf668407-154f-5b4a-a50e-a5a0cf8951ce with scrape type 2
2026-03-29 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf668407-154f-5b4a-a50e-a5a0cf8951ce with scrape type 2
2026-03-29 18:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf668407-154f-5b4a-a50e-a5a0cf8951ce, identifier: GV91786
2026-03-29 18:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf668407-154f-5b4a-a50e-a5a0cf8951ce with identifier: GV91786
2026-03-29 18:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf668407-154f-5b4a-a50e-a5a0cf8951ce with identifier: GV91786
2026-03-29 18:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf668407-154f-5b4a-a50e-a5a0cf8951ce with identifier: GV91786 to the API
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 249,
'expiration_date': '2026-03-30T15:59:33Z',
'fuel_type': 'diesel',
'id': 'bf668407-154f-5b4a-a50e-a5a0cf8951ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV91786',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 192561,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-07',
'seller_name': None,
'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2019}
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91786%27 HTTP/1.1" 200 None
2026-03-29 18:33:48 [auto1.de] INFO: Saving data for GV91786: {'auction_closing_time': 1774886373.0, 'created_time': 1774251087.062071, 'last_price_update_time': 1774809228.917602}
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV91786') HTTP/1.1" 204 0
2026-03-29 18:33:48 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-29 18:33:48 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68921%27 HTTP/1.1" 200 None
2026-03-29 18:33:48 [auto1.de] INFO: Scrape type for JV68921: 2
2026-03-29 18:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with identifier: JV68921
2026-03-29 18:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with scrape type 2
2026-03-29 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with scrape type 2
2026-03-29 18:33:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 578483f7-106b-5d5c-aa13-65f7a53dd0d4, identifier: JV68921
2026-03-29 18:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with identifier: JV68921
2026-03-29 18:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with identifier: JV68921
2026-03-29 18:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with identifier: JV68921 to the API
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 188,
'expiration_date': '2026-03-30T15:35:41Z',
'fuel_type': 'hybrid',
'id': '578483f7-106b-5d5c-aa13-65f7a53dd0d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV68921',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Eclipse Cross',
'odometer': 44585,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-01',
'seller_name': None,
'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid Plus 4WD',
'transmission': 'automatic',
'trim': 'Plus 4WD',
'year': 2021}
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68921%27 HTTP/1.1" 200 None
2026-03-29 18:33:49 [auto1.de] INFO: Saving data for JV68921: {'auction_closing_time': 1774884941.0, 'created_time': 1774293915.315679, 'last_price_update_time': 1774809229.389571}
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV68921') HTTP/1.1" 204 0
2026-03-29 18:33:49 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 6740 | hits on page: 40
2026-03-29 18:33:49 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-29 18:33:49 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP33840%27 HTTP/1.1" 200 None
2026-03-29 18:33:49 [auto1.de] INFO: Scrape type for FP33840: 2
2026-03-29 18:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de138e96-183e-5b14-9d60-2a18e3525655 with identifier: FP33840
2026-03-29 18:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de138e96-183e-5b14-9d60-2a18e3525655 with scrape type 2
2026-03-29 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de138e96-183e-5b14-9d60-2a18e3525655 with scrape type 2
2026-03-29 18:33:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de138e96-183e-5b14-9d60-2a18e3525655, identifier: FP33840
2026-03-29 18:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de138e96-183e-5b14-9d60-2a18e3525655 with identifier: FP33840
2026-03-29 18:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de138e96-183e-5b14-9d60-2a18e3525655 with identifier: FP33840
2026-03-29 18:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de138e96-183e-5b14-9d60-2a18e3525655 with identifier: FP33840 to the API
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 147,
'expiration_date': '2026-03-30T15:10:13Z',
'fuel_type': 'petrol',
'id': 'de138e96-183e-5b14-9d60-2a18e3525655',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP33840',
'listing': 'auction',
'make': 'Toyota',
'model': 'Avensis',
'odometer': 139611,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-18',
'seller_name': None,
'title': 'Toyota Avensis 1.8 Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2012}
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP33840%27 HTTP/1.1" 200 None
2026-03-29 18:33:49 [auto1.de] INFO: Saving data for FP33840: {'auction_closing_time': 1774883413.0, 'created_time': 1774350164.941479, 'last_price_update_time': 1774809229.804636}
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP33840') HTTP/1.1" 204 0
2026-03-29 18:33:49 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM74095%27 HTTP/1.1" 200 None
2026-03-29 18:33:49 [auto1.de] INFO: Scrape type for CM74095: 0
2026-03-29 18:33:49 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40568%27 HTTP/1.1" 200 None
2026-03-29 18:33:49 [auto1.de] INFO: Scrape type for ZE40568: 2
2026-03-29 18:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with identifier: ZE40568
2026-03-29 18:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with scrape type 2
2026-03-29 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with scrape type 2
2026-03-29 18:33:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e, identifier: ZE40568
2026-03-29 18:33:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:33:49 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE12352%27 HTTP/1.1" 200 None
2026-03-29 18:33:49 [auto1.de] INFO: Scrape type for FE12352: 0
2026-03-29 18:33:49 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH02109%27 HTTP/1.1" 200 None
2026-03-29 18:33:49 [auto1.de] INFO: Scrape type for GH02109: 2
2026-03-29 18:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ec27e1a-c227-5dad-b824-0d399b539a74 with identifier: GH02109
2026-03-29 18:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ec27e1a-c227-5dad-b824-0d399b539a74 with scrape type 2
2026-03-29 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ec27e1a-c227-5dad-b824-0d399b539a74 with scrape type 2
2026-03-29 18:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ec27e1a-c227-5dad-b824-0d399b539a74, identifier: GH02109
2026-03-29 18:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with identifier: ZE40568
2026-03-29 18:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with identifier: ZE40568
2026-03-29 18:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with identifier: ZE40568 to the API
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:59:04Z',
'fuel_type': 'diesel',
'id': '018a3c7a-e421-5e8e-8bdb-bfa78fd0594e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE40568',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 189025,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-15',
'seller_name': None,
'title': 'BMW 3er 320d Luxury Line',
'transmission': 'automatic',
'trim': 'Luxury Line',
'year': 2017}
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40568%27 HTTP/1.1" 200 None
2026-03-29 18:33:50 [auto1.de] INFO: Saving data for ZE40568: {'auction_closing_time': 1774886344.0, 'created_time': 1773399998.814952, 'last_price_update_time': 1774809230.412807}
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE40568') HTTP/1.1" 204 0
2026-03-29 18:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ec27e1a-c227-5dad-b824-0d399b539a74 with identifier: GH02109
2026-03-29 18:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ec27e1a-c227-5dad-b824-0d399b539a74 with identifier: GH02109
2026-03-29 18:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ec27e1a-c227-5dad-b824-0d399b539a74 with identifier: GH02109 to the API
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:42:45Z',
'fuel_type': 'diesel',
'id': '2ec27e1a-c227-5dad-b824-0d399b539a74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH02109',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 153373,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-06',
'seller_name': None,
'title': 'BMW 3er 320d Mild-Hybrid Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2022}
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH02109%27 HTTP/1.1" 200 None
2026-03-29 18:33:50 [auto1.de] INFO: Saving data for GH02109: {'auction_closing_time': 1774885365.0, 'created_time': 1774607675.742035, 'last_price_update_time': 1774809230.839818}
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH02109') HTTP/1.1" 204 0
2026-03-29 18:33:50 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-29 18:33:50 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-29 18:33:50 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-29 18:33:50 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-29 18:33:50 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU50436%27 HTTP/1.1" 200 None
2026-03-29 18:33:50 [auto1.de] INFO: Scrape type for VU50436: 2
2026-03-29 18:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f3ba892-7db0-5ece-8e39-8c05d342956b with identifier: VU50436
2026-03-29 18:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f3ba892-7db0-5ece-8e39-8c05d342956b with scrape type 2
2026-03-29 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f3ba892-7db0-5ece-8e39-8c05d342956b with scrape type 2
2026-03-29 18:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f3ba892-7db0-5ece-8e39-8c05d342956b, identifier: VU50436
2026-03-29 18:33:50 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-29 18:33:50 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10122%27 HTTP/1.1" 200 None
2026-03-29 18:33:50 [auto1.de] INFO: Scrape type for LM10122: 2
2026-03-29 18:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc8ce052-d13c-5efe-98af-da2a20439cbe with identifier: LM10122
2026-03-29 18:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc8ce052-d13c-5efe-98af-da2a20439cbe with scrape type 2
2026-03-29 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc8ce052-d13c-5efe-98af-da2a20439cbe with scrape type 2
2026-03-29 18:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc8ce052-d13c-5efe-98af-da2a20439cbe, identifier: LM10122
2026-03-29 18:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f3ba892-7db0-5ece-8e39-8c05d342956b with identifier: VU50436
2026-03-29 18:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f3ba892-7db0-5ece-8e39-8c05d342956b with identifier: VU50436
2026-03-29 18:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f3ba892-7db0-5ece-8e39-8c05d342956b with identifier: VU50436 to the API
2026-03-29 18:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:29:56Z',
'fuel_type': 'diesel',
'id': '2f3ba892-7db0-5ece-8e39-8c05d342956b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU50436',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 25223,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-26',
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-29 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU50436%27 HTTP/1.1" 200 None
2026-03-29 18:33:51 [auto1.de] INFO: Saving data for VU50436: {'auction_closing_time': 1774884596.0, 'created_time': 1774521671.545626, 'last_price_update_time': 1774809231.349504}
2026-03-29 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU50436') HTTP/1.1" 204 0
2026-03-29 18:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc8ce052-d13c-5efe-98af-da2a20439cbe with identifier: LM10122
2026-03-29 18:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc8ce052-d13c-5efe-98af-da2a20439cbe with identifier: LM10122
2026-03-29 18:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc8ce052-d13c-5efe-98af-da2a20439cbe with identifier: LM10122 to the API
2026-03-29 18:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:24:38Z',
'fuel_type': 'diesel',
'id': 'fc8ce052-d13c-5efe-98af-da2a20439cbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM10122',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 206068,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-01',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
'transmission': 'automatic',
'trim': 'Platinum Edition 4WD',
'year': 2015}
2026-03-29 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10122%27 HTTP/1.1" 200 None
2026-03-29 18:33:51 [auto1.de] INFO: Saving data for LM10122: {'auction_closing_time': 1774884278.0, 'created_time': 1772728077.692988, 'last_price_update_time': 1774809231.665409}
2026-03-29 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM10122') HTTP/1.1" 204 0
2026-03-29 18:33:51 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-29 18:33:51 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-29 18:33:51 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-29 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG45518%27 HTTP/1.1" 200 None
2026-03-29 18:33:51 [auto1.de] INFO: Scrape type for HG45518: 2
2026-03-29 18:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with identifier: HG45518
2026-03-29 18:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with scrape type 2
2026-03-29 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with scrape type 2
2026-03-29 18:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ecdc16d-6221-593c-8b9b-82bfd63f53d5, identifier: HG45518
2026-03-29 18:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with identifier: HG45518
2026-03-29 18:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with identifier: HG45518
2026-03-29 18:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with identifier: HG45518 to the API
2026-03-29 18:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:03:49Z',
'fuel_type': 'petrol',
'id': '2ecdc16d-6221-593c-8b9b-82bfd63f53d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG45518',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 75207,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-20',
'seller_name': None,
'title': 'Seat Leon 1.4 TGI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2018}
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG45518%27 HTTP/1.1" 200 None
2026-03-29 18:33:52 [auto1.de] INFO: Saving data for HG45518: {'auction_closing_time': 1774883029.0, 'created_time': 1773772232.947375, 'last_price_update_time': 1774809232.123676}
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG45518') HTTP/1.1" 204 0
2026-03-29 18:33:52 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC83292%27 HTTP/1.1" 200 None
2026-03-29 18:33:52 [auto1.de] INFO: Scrape type for FC83292: 0
2026-03-29 18:33:52 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-29 18:33:52 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN89832%27 HTTP/1.1" 200 None
2026-03-29 18:33:52 [auto1.de] INFO: Scrape type for GN89832: 0
2026-03-29 18:33:52 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP66494%27 HTTP/1.1" 200 None
2026-03-29 18:33:52 [auto1.de] INFO: Scrape type for UP66494: 0
2026-03-29 18:33:52 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-29 18:33:52 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB62696%27 HTTP/1.1" 200 None
2026-03-29 18:33:52 [auto1.de] INFO: Scrape type for HB62696: 2
2026-03-29 18:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66152524-5a4b-5c42-8de7-d380e16c5d62 with identifier: HB62696
2026-03-29 18:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66152524-5a4b-5c42-8de7-d380e16c5d62 with scrape type 2
2026-03-29 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66152524-5a4b-5c42-8de7-d380e16c5d62 with scrape type 2
2026-03-29 18:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66152524-5a4b-5c42-8de7-d380e16c5d62, identifier: HB62696
2026-03-29 18:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66152524-5a4b-5c42-8de7-d380e16c5d62 with identifier: HB62696
2026-03-29 18:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66152524-5a4b-5c42-8de7-d380e16c5d62 with identifier: HB62696
2026-03-29 18:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66152524-5a4b-5c42-8de7-d380e16c5d62 with identifier: HB62696 to the API
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:11:53Z',
'fuel_type': 'diesel',
'id': '66152524-5a4b-5c42-8de7-d380e16c5d62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB62696',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 296249,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-13',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB62696%27 HTTP/1.1" 200 None
2026-03-29 18:33:52 [auto1.de] INFO: Saving data for HB62696: {'auction_closing_time': 1774883513.0, 'created_time': 1773468131.369097, 'last_price_update_time': 1774809232.602893}
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB62696') HTTP/1.1" 204 0
2026-03-29 18:33:52 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17232%27 HTTP/1.1" 200 None
2026-03-29 18:33:52 [auto1.de] INFO: Scrape type for RE17232: 2
2026-03-29 18:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23e455b8-884b-5ad9-9451-660113979c82 with identifier: RE17232
2026-03-29 18:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23e455b8-884b-5ad9-9451-660113979c82 with scrape type 2
2026-03-29 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23e455b8-884b-5ad9-9451-660113979c82 with scrape type 2
2026-03-29 18:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23e455b8-884b-5ad9-9451-660113979c82, identifier: RE17232
2026-03-29 18:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23e455b8-884b-5ad9-9451-660113979c82 with identifier: RE17232
2026-03-29 18:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23e455b8-884b-5ad9-9451-660113979c82 with identifier: RE17232
2026-03-29 18:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23e455b8-884b-5ad9-9451-660113979c82 with identifier: RE17232 to the API
2026-03-29 18:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 457,
'expiration_date': '2026-03-30T15:09:07Z',
'fuel_type': 'petrol',
'id': '23e455b8-884b-5ad9-9451-660113979c82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE17232',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 98693,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-19',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 53 AMG Mild-Hybrid T 4Matic+',
'transmission': 'automatic',
'trim': 'T 4Matic+',
'year': 2018}
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17232%27 HTTP/1.1" 200 None
2026-03-29 18:33:53 [auto1.de] INFO: Saving data for RE17232: {'auction_closing_time': 1774883347.0, 'created_time': 1774349950.366438, 'last_price_update_time': 1774809233.176279}
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE17232') HTTP/1.1" 204 0
2026-03-29 18:33:53 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82118%27 HTTP/1.1" 200 None
2026-03-29 18:33:53 [auto1.de] INFO: Scrape type for GJ82118: 0
2026-03-29 18:33:53 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-29 18:33:53 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF27156%27 HTTP/1.1" 200 None
2026-03-29 18:33:53 [auto1.de] INFO: Scrape type for BF27156: 0
2026-03-29 18:33:53 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE52706%27 HTTP/1.1" 200 None
2026-03-29 18:33:53 [auto1.de] INFO: Scrape type for KE52706: 0
2026-03-29 18:33:53 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-29 18:33:53 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87284%27 HTTP/1.1" 200 None
2026-03-29 18:33:53 [auto1.de] INFO: Scrape type for FK87284: 2
2026-03-29 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbdc3010-4710-5e62-b105-bfacf1c7d836 with identifier: FK87284
2026-03-29 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbdc3010-4710-5e62-b105-bfacf1c7d836 with scrape type 2
2026-03-29 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbdc3010-4710-5e62-b105-bfacf1c7d836 with scrape type 2
2026-03-29 18:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbdc3010-4710-5e62-b105-bfacf1c7d836, identifier: FK87284
2026-03-29 18:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbdc3010-4710-5e62-b105-bfacf1c7d836 with identifier: FK87284
2026-03-29 18:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbdc3010-4710-5e62-b105-bfacf1c7d836 with identifier: FK87284
2026-03-29 18:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbdc3010-4710-5e62-b105-bfacf1c7d836 with identifier: FK87284 to the API
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:37:27Z',
'fuel_type': 'diesel',
'id': 'dbdc3010-4710-5e62-b105-bfacf1c7d836',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK87284',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 140458,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-06',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87284%27 HTTP/1.1" 200 None
2026-03-29 18:33:53 [auto1.de] INFO: Saving data for FK87284: {'auction_closing_time': 1774885047.0, 'created_time': 1774291966.938551, 'last_price_update_time': 1774809233.674814}
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK87284') HTTP/1.1" 204 0
2026-03-29 18:33:53 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-29 18:33:53 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR38241%27 HTTP/1.1" 200 None
2026-03-29 18:33:53 [auto1.de] INFO: Scrape type for DR38241: 0
2026-03-29 18:33:53 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX13516%27 HTTP/1.1" 200 None
2026-03-29 18:33:53 [auto1.de] INFO: Scrape type for VX13516: 2
2026-03-29 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with identifier: VX13516
2026-03-29 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with scrape type 2
2026-03-29 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with scrape type 2
2026-03-29 18:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d, identifier: VX13516
2026-03-29 18:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with identifier: VX13516
2026-03-29 18:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with identifier: VX13516
2026-03-29 18:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with identifier: VX13516 to the API
2026-03-29 18:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:23:29Z',
'fuel_type': 'diesel',
'id': '0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX13516',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 276282,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-05',
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX13516%27 HTTP/1.1" 200 None
2026-03-29 18:33:54 [auto1.de] INFO: Saving data for VX13516: {'auction_closing_time': 1774884209.0, 'created_time': 1773399936.200992, 'last_price_update_time': 1774809234.156161}
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX13516') HTTP/1.1" 204 0
2026-03-29 18:33:54 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP61369%27 HTTP/1.1" 200 None
2026-03-29 18:33:54 [auto1.de] INFO: Scrape type for YP61369: 0
2026-03-29 18:33:54 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP78735%27 HTTP/1.1" 200 None
2026-03-29 18:33:54 [auto1.de] INFO: Scrape type for BP78735: 0
2026-03-29 18:33:54 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-29 18:33:54 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34969%27 HTTP/1.1" 200 None
2026-03-29 18:33:54 [auto1.de] INFO: Scrape type for JN34969: 0
2026-03-29 18:33:54 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ94866%27 HTTP/1.1" 200 None
2026-03-29 18:33:54 [auto1.de] INFO: Scrape type for XZ94866: 0
2026-03-29 18:33:54 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK19800%27 HTTP/1.1" 200 None
2026-03-29 18:33:54 [auto1.de] INFO: Scrape type for KK19800: 0
2026-03-29 18:33:54 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-29 18:33:54 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV91076%27 HTTP/1.1" 200 None
2026-03-29 18:33:54 [auto1.de] INFO: Scrape type for DV91076: 2
2026-03-29 18:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with identifier: DV91076
2026-03-29 18:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with scrape type 2
2026-03-29 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with scrape type 2
2026-03-29 18:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88cfcf40-1c29-5e06-8e86-0f4abc0fed72, identifier: DV91076
2026-03-29 18:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with identifier: DV91076
2026-03-29 18:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with identifier: DV91076
2026-03-29 18:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with identifier: DV91076 to the API
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 113,
'expiration_date': '2026-03-30T15:24:22Z',
'fuel_type': 'diesel',
'id': '88cfcf40-1c29-5e06-8e86-0f4abc0fed72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV91076',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 297655,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-07-31',
'seller_name': None,
'title': 'Kia Sportage 2.0 Turbodiesel EX 4WD',
'transmission': 'automatic',
'trim': 'EX 4WD',
'year': 2005}
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV91076%27 HTTP/1.1" 200 None
2026-03-29 18:33:54 [auto1.de] INFO: Saving data for DV91076: {'auction_closing_time': 1774884262.0, 'created_time': 1773468474.634517, 'last_price_update_time': 1774809234.739912}
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV91076') HTTP/1.1" 204 0
2026-03-29 18:33:54 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC36065%27 HTTP/1.1" 200 None
2026-03-29 18:33:54 [auto1.de] INFO: Scrape type for NC36065: 0
2026-03-29 18:33:54 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET79003%27 HTTP/1.1" 200 None
2026-03-29 18:33:54 [auto1.de] INFO: Scrape type for ET79003: 0
2026-03-29 18:33:54 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW47494%27 HTTP/1.1" 200 None
2026-03-29 18:33:54 [auto1.de] INFO: Scrape type for EW47494: 0
2026-03-29 18:33:54 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY09596%27 HTTP/1.1" 200 None
2026-03-29 18:33:54 [auto1.de] INFO: Scrape type for WY09596: 0
2026-03-29 18:33:54 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-29 18:33:54 [auto1.de] INFO: Scrape type for VL85665: 2
2026-03-29 18:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e577adca-0663-5fe8-a520-8be939a414b4 with identifier: VL85665
2026-03-29 18:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e577adca-0663-5fe8-a520-8be939a414b4 with scrape type 2
2026-03-29 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e577adca-0663-5fe8-a520-8be939a414b4 with scrape type 2
2026-03-29 18:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e577adca-0663-5fe8-a520-8be939a414b4, identifier: VL85665
2026-03-29 18:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e577adca-0663-5fe8-a520-8be939a414b4 with identifier: VL85665
2026-03-29 18:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e577adca-0663-5fe8-a520-8be939a414b4 with identifier: VL85665
2026-03-29 18:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e577adca-0663-5fe8-a520-8be939a414b4 with identifier: VL85665 to the API
2026-03-29 18:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:18:01Z',
'fuel_type': 'petrol',
'id': 'e577adca-0663-5fe8-a520-8be939a414b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL85665',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 76325,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-04',
'seller_name': None,
'title': 'Kia Sportage 1.6 GDI Dream Team 2WD',
'transmission': 'manual',
'trim': 'Dream Team 2WD',
'year': 2013}
2026-03-29 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-29 18:33:55 [auto1.de] INFO: Saving data for VL85665: {'auction_closing_time': 1774883881.0, 'created_time': 1774292314.418907, 'last_price_update_time': 1774809235.333747}
2026-03-29 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL85665') HTTP/1.1" 204 0
2026-03-29 18:33:55 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-29 18:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:33:55 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 6740 | hits on page: 40
2026-03-29 18:33:55 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-29 18:33:55 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-29 18:33:55 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-29 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85706%27 HTTP/1.1" 200 None
2026-03-29 18:33:55 [auto1.de] INFO: Scrape type for LM85706: 0
2026-03-29 18:33:55 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-29 18:33:55 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-29 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA05422%27 HTTP/1.1" 200 None
2026-03-29 18:33:55 [auto1.de] INFO: Scrape type for LA05422: 2
2026-03-29 18:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with identifier: LA05422
2026-03-29 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with scrape type 2
2026-03-29 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with scrape type 2
2026-03-29 18:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40789099-ae02-54ba-adc5-b5b6a8b6bb4b, identifier: LA05422
2026-03-29 18:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with identifier: LA05422
2026-03-29 18:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with identifier: LA05422
2026-03-29 18:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with identifier: LA05422 to the API
2026-03-29 18:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:21:19Z',
'fuel_type': 'diesel',
'id': '40789099-ae02-54ba-adc5-b5b6a8b6bb4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA05422',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 210612,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-10',
'seller_name': None,
'title': 'BMW 5er 530d Luxury Line',
'transmission': 'automatic',
'trim': 'Luxury Line',
'year': 2018}
2026-03-29 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA05422%27 HTTP/1.1" 200 None
2026-03-29 18:33:56 [auto1.de] INFO: Saving data for LA05422: {'auction_closing_time': 1774884079.0, 'created_time': 1773307435.14539, 'last_price_update_time': 1774809236.526541}
2026-03-29 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA05422') HTTP/1.1" 204 0
2026-03-29 18:33:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:33:56 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-29 18:33:56 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-29 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF79085%27 HTTP/1.1" 200 None
2026-03-29 18:33:56 [auto1.de] INFO: Scrape type for RF79085: 0
2026-03-29 18:33:56 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-29 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN80130%27 HTTP/1.1" 200 None
2026-03-29 18:33:56 [auto1.de] INFO: Scrape type for KN80130: 2
2026-03-29 18:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14d5bc4c-8e3f-57fc-86ac-017d2959955e with identifier: KN80130
2026-03-29 18:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14d5bc4c-8e3f-57fc-86ac-017d2959955e with scrape type 2
2026-03-29 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14d5bc4c-8e3f-57fc-86ac-017d2959955e with scrape type 2
2026-03-29 18:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14d5bc4c-8e3f-57fc-86ac-017d2959955e, identifier: KN80130
2026-03-29 18:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14d5bc4c-8e3f-57fc-86ac-017d2959955e with identifier: KN80130
2026-03-29 18:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14d5bc4c-8e3f-57fc-86ac-017d2959955e with identifier: KN80130
2026-03-29 18:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14d5bc4c-8e3f-57fc-86ac-017d2959955e with identifier: KN80130 to the API
2026-03-29 18:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:04:54Z',
'fuel_type': 'diesel',
'id': '14d5bc4c-8e3f-57fc-86ac-017d2959955e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN80130',
'listing': 'auction',
'make': 'Opel',
'model': 'Movano',
'odometer': 69871,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-16',
'seller_name': None,
'title': 'Opel Movano 2.3 CDTI Ka L1H1 3,5t',
'transmission': 'manual',
'trim': 'Ka L1H1 3,5t',
'year': 2012}
2026-03-29 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN80130%27 HTTP/1.1" 200 None
2026-03-29 18:33:57 [auto1.de] INFO: Saving data for KN80130: {'auction_closing_time': 1774883094.0, 'created_time': 1774522093.224323, 'last_price_update_time': 1774809237.02663}
2026-03-29 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN80130') HTTP/1.1" 204 0
2026-03-29 18:33:57 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-29 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM50493%27 HTTP/1.1" 200 None
2026-03-29 18:33:57 [auto1.de] INFO: Scrape type for NM50493: 0
2026-03-29 18:33:57 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-29 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50860%27 HTTP/1.1" 200 None
2026-03-29 18:33:57 [auto1.de] INFO: Scrape type for KX50860: 0
2026-03-29 18:33:57 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-29 18:33:57 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-29 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE25239%27 HTTP/1.1" 200 None
2026-03-29 18:33:57 [auto1.de] INFO: Scrape type for BE25239: 2
2026-03-29 18:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1e4a606-ed58-50e2-98b1-5cd386f24c2e with identifier: BE25239
2026-03-29 18:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1e4a606-ed58-50e2-98b1-5cd386f24c2e with scrape type 2
2026-03-29 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1e4a606-ed58-50e2-98b1-5cd386f24c2e with scrape type 2
2026-03-29 18:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1e4a606-ed58-50e2-98b1-5cd386f24c2e, identifier: BE25239
2026-03-29 18:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1e4a606-ed58-50e2-98b1-5cd386f24c2e with identifier: BE25239
2026-03-29 18:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:33:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-29 18:33:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1e4a606-ed58-50e2-98b1-5cd386f24c2e with identifier: BE25239
2026-03-29 18:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1e4a606-ed58-50e2-98b1-5cd386f24c2e with identifier: BE25239 to the API
2026-03-29 18:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:09:41Z',
'fuel_type': 'gas',
'id': 'a1e4a606-ed58-50e2-98b1-5cd386f24c2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE25239',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 158666,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-02',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 Kasten EcoFuel',
'transmission': 'manual',
'trim': 'Kasten EcoFuel',
'year': 2009}
2026-03-29 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE25239%27 HTTP/1.1" 200 None
2026-03-29 18:33:58 [auto1.de] INFO: Saving data for BE25239: {'auction_closing_time': 1774883381.0, 'created_time': 1774349139.776538, 'last_price_update_time': 1774809238.545794}
2026-03-29 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE25239') HTTP/1.1" 204 0
2026-03-29 18:33:58 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-29 18:33:58 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-29 18:33:58 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-29 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12001%27 HTTP/1.1" 200 None
2026-03-29 18:33:58 [auto1.de] INFO: Scrape type for LK12001: 2
2026-03-29 18:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with identifier: LK12001
2026-03-29 18:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with scrape type 2
2026-03-29 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with scrape type 2
2026-03-29 18:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4aa64b42-65e4-5664-abfa-80a51e1d7c72, identifier: LK12001
2026-03-29 18:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with identifier: LK12001
2026-03-29 18:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with identifier: LK12001
2026-03-29 18:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with identifier: LK12001 to the API
2026-03-29 18:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:26:24Z',
'fuel_type': 'petrol',
'id': '4aa64b42-65e4-5664-abfa-80a51e1d7c72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK12001',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 127275,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-22',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2016}
2026-03-29 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12001%27 HTTP/1.1" 200 None
2026-03-29 18:33:59 [auto1.de] INFO: Saving data for LK12001: {'auction_closing_time': 1774884384.0, 'created_time': 1773775653.956429, 'last_price_update_time': 1774809239.009117}
2026-03-29 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK12001') HTTP/1.1" 204 0
2026-03-29 18:33:59 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-29 18:33:59 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-29 18:33:59 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-29 18:33:59 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-29 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH47357%27 HTTP/1.1" 200 None
2026-03-29 18:33:59 [auto1.de] INFO: Scrape type for GH47357: 2
2026-03-29 18:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f140020-f7fe-5db7-9562-be06624fa3c6 with identifier: GH47357
2026-03-29 18:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f140020-f7fe-5db7-9562-be06624fa3c6 with scrape type 2
2026-03-29 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f140020-f7fe-5db7-9562-be06624fa3c6 with scrape type 2
2026-03-29 18:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f140020-f7fe-5db7-9562-be06624fa3c6, identifier: GH47357
2026-03-29 18:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f140020-f7fe-5db7-9562-be06624fa3c6 with identifier: GH47357
2026-03-29 18:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f140020-f7fe-5db7-9562-be06624fa3c6 with identifier: GH47357
2026-03-29 18:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f140020-f7fe-5db7-9562-be06624fa3c6 with identifier: GH47357 to the API
2026-03-29 18:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:40:20Z',
'fuel_type': 'petrol',
'id': '9f140020-f7fe-5db7-9562-be06624fa3c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH47357',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 63401,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-01',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2021}
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH47357%27 HTTP/1.1" 200 None
2026-03-29 18:34:00 [auto1.de] INFO: Saving data for GH47357: {'auction_closing_time': 1774885220.0, 'created_time': 1774294279.005732, 'last_price_update_time': 1774809240.093614}
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH47357') HTTP/1.1" 204 0
2026-03-29 18:34:00 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-29 18:34:00 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-29 18:34:00 [auto1.de] INFO: Found listing with ID: RU25678
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU25678%27 HTTP/1.1" 200 None
2026-03-29 18:34:00 [auto1.de] INFO: Scrape type for RU25678: 2
2026-03-29 18:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccd56610-2cf6-5fce-8962-751341da996f with identifier: RU25678
2026-03-29 18:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccd56610-2cf6-5fce-8962-751341da996f with scrape type 2
2026-03-29 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccd56610-2cf6-5fce-8962-751341da996f with scrape type 2
2026-03-29 18:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccd56610-2cf6-5fce-8962-751341da996f, identifier: RU25678
2026-03-29 18:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccd56610-2cf6-5fce-8962-751341da996f with identifier: RU25678
2026-03-29 18:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccd56610-2cf6-5fce-8962-751341da996f with identifier: RU25678
2026-03-29 18:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccd56610-2cf6-5fce-8962-751341da996f with identifier: RU25678 to the API
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:33:33Z',
'fuel_type': 'petrol',
'id': 'ccd56610-2cf6-5fce-8962-751341da996f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU25678',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 236775,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-28',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2009}
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU25678%27 HTTP/1.1" 200 None
2026-03-29 18:34:00 [auto1.de] INFO: Saving data for RU25678: {'auction_closing_time': 1774884813.0, 'created_time': 1774722726.219926, 'last_price_update_time': 1774809240.577806}
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU25678') HTTP/1.1" 204 0
2026-03-29 18:34:00 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-29 18:34:00 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-29 18:34:00 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09290%27 HTTP/1.1" 200 None
2026-03-29 18:34:00 [auto1.de] INFO: Scrape type for GV09290: 0
2026-03-29 18:34:00 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88762%27 HTTP/1.1" 200 None
2026-03-29 18:34:00 [auto1.de] INFO: Scrape type for ZM88762: 0
2026-03-29 18:34:00 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-29 18:34:00 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-29 18:34:00 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-29 18:34:00 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-29 18:34:00 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS02767%27 HTTP/1.1" 200 None
2026-03-29 18:34:00 [auto1.de] INFO: Scrape type for YS02767: 2
2026-03-29 18:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3f901f8-16cb-541a-a250-310ff383476d with identifier: YS02767
2026-03-29 18:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3f901f8-16cb-541a-a250-310ff383476d with scrape type 2
2026-03-29 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3f901f8-16cb-541a-a250-310ff383476d with scrape type 2
2026-03-29 18:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3f901f8-16cb-541a-a250-310ff383476d, identifier: YS02767
2026-03-29 18:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3f901f8-16cb-541a-a250-310ff383476d with identifier: YS02767
2026-03-29 18:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3f901f8-16cb-541a-a250-310ff383476d with identifier: YS02767
2026-03-29 18:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3f901f8-16cb-541a-a250-310ff383476d with identifier: YS02767 to the API
2026-03-29 18:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:32:31Z',
'fuel_type': 'petrol',
'id': 'e3f901f8-16cb-541a-a250-310ff383476d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS02767',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Limousine',
'odometer': 116445,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-07',
'seller_name': None,
'title': 'Audi A3 Limousine 35 TFSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS02767%27 HTTP/1.1" 200 None
2026-03-29 18:34:02 [auto1.de] INFO: Saving data for YS02767: {'auction_closing_time': 1774884751.0, 'created_time': 1773946069.825738, 'last_price_update_time': 1774809242.034277}
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS02767') HTTP/1.1" 204 0
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL90594%27 HTTP/1.1" 200 None
2026-03-29 18:34:02 [auto1.de] INFO: Scrape type for KL90594: 0
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ68133%27 HTTP/1.1" 200 None
2026-03-29 18:34:02 [auto1.de] INFO: Scrape type for JZ68133: 0
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW15548%27 HTTP/1.1" 200 None
2026-03-29 18:34:02 [auto1.de] INFO: Scrape type for YW15548: 0
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW12270%27 HTTP/1.1" 200 None
2026-03-29 18:34:02 [auto1.de] INFO: Scrape type for KW12270: 0
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-29 18:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:34:02 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 6740 | hits on page: 40
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01657%27 HTTP/1.1" 200 None
2026-03-29 18:34:02 [auto1.de] INFO: Scrape type for DX01657: 0
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP43977%27 HTTP/1.1" 200 None
2026-03-29 18:34:02 [auto1.de] INFO: Scrape type for CP43977: 0
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT77440%27 HTTP/1.1" 200 None
2026-03-29 18:34:02 [auto1.de] INFO: Scrape type for DT77440: 2
2026-03-29 18:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67d27934-8b71-5f6b-948e-7576c2c7bac3 with identifier: DT77440
2026-03-29 18:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d27934-8b71-5f6b-948e-7576c2c7bac3 with scrape type 2
2026-03-29 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67d27934-8b71-5f6b-948e-7576c2c7bac3 with scrape type 2
2026-03-29 18:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67d27934-8b71-5f6b-948e-7576c2c7bac3, identifier: DT77440
2026-03-29 18:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67d27934-8b71-5f6b-948e-7576c2c7bac3 with identifier: DT77440
2026-03-29 18:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67d27934-8b71-5f6b-948e-7576c2c7bac3 with identifier: DT77440
2026-03-29 18:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67d27934-8b71-5f6b-948e-7576c2c7bac3 with identifier: DT77440 to the API
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:09:48Z',
'fuel_type': 'gas',
'id': '67d27934-8b71-5f6b-948e-7576c2c7bac3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT77440',
'listing': 'auction',
'make': 'Dacia',
'model': 'Logan MCV',
'odometer': 40167,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-03',
'seller_name': None,
'title': 'Dacia Logan MCV 1.0 TCe LPG Stepway',
'transmission': 'manual',
'trim': 'Stepway',
'year': 2020}
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT77440%27 HTTP/1.1" 200 None
2026-03-29 18:34:02 [auto1.de] INFO: Saving data for DT77440: {'auction_closing_time': 1774883388.0, 'created_time': 1773426996.23229, 'last_price_update_time': 1774809242.824751}
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT77440') HTTP/1.1" 204 0
2026-03-29 18:34:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90284%27 HTTP/1.1" 200 None
2026-03-29 18:34:02 [auto1.de] INFO: Scrape type for DP90284: 0
2026-03-29 18:34:02 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM87247%27 HTTP/1.1" 200 None
2026-03-29 18:34:02 [auto1.de] INFO: Scrape type for KM87247: 2
2026-03-29 18:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15aa9a06-e694-58a4-a7c0-309cbe26e86f with identifier: KM87247
2026-03-29 18:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15aa9a06-e694-58a4-a7c0-309cbe26e86f with scrape type 2
2026-03-29 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15aa9a06-e694-58a4-a7c0-309cbe26e86f with scrape type 2
2026-03-29 18:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15aa9a06-e694-58a4-a7c0-309cbe26e86f, identifier: KM87247
2026-03-29 18:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15aa9a06-e694-58a4-a7c0-309cbe26e86f with identifier: KM87247
2026-03-29 18:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15aa9a06-e694-58a4-a7c0-309cbe26e86f with identifier: KM87247
2026-03-29 18:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15aa9a06-e694-58a4-a7c0-309cbe26e86f with identifier: KM87247 to the API
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:37:01Z',
'fuel_type': 'diesel',
'id': '15aa9a06-e694-58a4-a7c0-309cbe26e86f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM87247',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 85106,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-15',
'seller_name': None,
'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2018}
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM87247%27 HTTP/1.1" 200 None
2026-03-29 18:34:03 [auto1.de] INFO: Saving data for KM87247: {'auction_closing_time': 1774885021.0, 'created_time': 1774330259.104166, 'last_price_update_time': 1774809243.413247}
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM87247') HTTP/1.1" 204 0
2026-03-29 18:34:03 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-29 18:34:03 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME45713%27 HTTP/1.1" 200 None
2026-03-29 18:34:03 [auto1.de] INFO: Scrape type for ME45713: 0
2026-03-29 18:34:03 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-29 18:34:03 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-29 18:34:03 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-29 18:34:03 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-29 18:34:03 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-29 18:34:03 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90391%27 HTTP/1.1" 200 None
2026-03-29 18:34:03 [auto1.de] INFO: Scrape type for UZ90391: 0
2026-03-29 18:34:03 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR04535%27 HTTP/1.1" 200 None
2026-03-29 18:34:03 [auto1.de] INFO: Scrape type for KR04535: 2
2026-03-29 18:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5189051-2f00-574e-8578-3a2ccbf9f416 with identifier: KR04535
2026-03-29 18:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5189051-2f00-574e-8578-3a2ccbf9f416 with scrape type 2
2026-03-29 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5189051-2f00-574e-8578-3a2ccbf9f416 with scrape type 2
2026-03-29 18:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5189051-2f00-574e-8578-3a2ccbf9f416, identifier: KR04535
2026-03-29 18:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5189051-2f00-574e-8578-3a2ccbf9f416 with identifier: KR04535
2026-03-29 18:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5189051-2f00-574e-8578-3a2ccbf9f416 with identifier: KR04535
2026-03-29 18:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5189051-2f00-574e-8578-3a2ccbf9f416 with identifier: KR04535 to the API
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:17:22Z',
'fuel_type': 'petrol',
'id': 'b5189051-2f00-574e-8578-3a2ccbf9f416',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR04535',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 174737,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-05',
'seller_name': None,
'title': 'Nissan Qashqai 2.0 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2011}
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR04535%27 HTTP/1.1" 200 None
2026-03-29 18:34:03 [auto1.de] INFO: Saving data for KR04535: {'auction_closing_time': 1774883842.0, 'created_time': 1773427325.088636, 'last_price_update_time': 1774809243.927438}
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR04535') HTTP/1.1" 204 0
2026-03-29 18:34:04 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN10477%27 HTTP/1.1" 200 None
2026-03-29 18:34:04 [auto1.de] INFO: Scrape type for YN10477: 2
2026-03-29 18:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 767874dd-8854-5495-b26e-2ed022d09474 with identifier: YN10477
2026-03-29 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 767874dd-8854-5495-b26e-2ed022d09474 with scrape type 2
2026-03-29 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 767874dd-8854-5495-b26e-2ed022d09474 with scrape type 2
2026-03-29 18:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 767874dd-8854-5495-b26e-2ed022d09474, identifier: YN10477
2026-03-29 18:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 767874dd-8854-5495-b26e-2ed022d09474 with identifier: YN10477
2026-03-29 18:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 767874dd-8854-5495-b26e-2ed022d09474 with identifier: YN10477
2026-03-29 18:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 767874dd-8854-5495-b26e-2ed022d09474 with identifier: YN10477 to the API
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 235,
'expiration_date': '2026-03-30T15:43:13Z',
'fuel_type': 'diesel',
'id': '767874dd-8854-5495-b26e-2ed022d09474',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN10477',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 202455,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-29',
'seller_name': None,
'title': 'Volvo XC90 2.0 D5 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2016}
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN10477%27 HTTP/1.1" 200 None
2026-03-29 18:34:04 [auto1.de] INFO: Saving data for YN10477: {'auction_closing_time': 1774885393.0, 'created_time': 1774262580.263548, 'last_price_update_time': 1774809244.498991}
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN10477') HTTP/1.1" 204 0
2026-03-29 18:34:04 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT10354%27 HTTP/1.1" 200 None
2026-03-29 18:34:04 [auto1.de] INFO: Scrape type for RT10354: 0
2026-03-29 18:34:04 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20301%27 HTTP/1.1" 200 None
2026-03-29 18:34:04 [auto1.de] INFO: Scrape type for ZN20301: 0
2026-03-29 18:34:04 [auto1.de] INFO: Found listing with ID: KV78740
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV78740%27 HTTP/1.1" 200 None
2026-03-29 18:34:04 [auto1.de] INFO: Scrape type for KV78740: 2
2026-03-29 18:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89593bb7-81d9-5f50-8c54-4603b80d6dad with identifier: KV78740
2026-03-29 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89593bb7-81d9-5f50-8c54-4603b80d6dad with scrape type 2
2026-03-29 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89593bb7-81d9-5f50-8c54-4603b80d6dad with scrape type 2
2026-03-29 18:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89593bb7-81d9-5f50-8c54-4603b80d6dad, identifier: KV78740
2026-03-29 18:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89593bb7-81d9-5f50-8c54-4603b80d6dad with identifier: KV78740
2026-03-29 18:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89593bb7-81d9-5f50-8c54-4603b80d6dad with identifier: KV78740
2026-03-29 18:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89593bb7-81d9-5f50-8c54-4603b80d6dad with identifier: KV78740 to the API
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:44:46Z',
'fuel_type': 'petrol',
'id': '89593bb7-81d9-5f50-8c54-4603b80d6dad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV78740',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'CC',
'odometer': 159314,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-23',
'seller_name': None,
'title': 'Volkswagen CC 2.0 TSI',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV78740%27 HTTP/1.1" 200 None
2026-03-29 18:34:04 [auto1.de] INFO: Saving data for KV78740: {'auction_closing_time': 1774885486.0, 'created_time': 1774722726.846903, 'last_price_update_time': 1774809244.947427}
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV78740') HTTP/1.1" 204 0
2026-03-29 18:34:04 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-29 18:34:04 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-29 18:34:04 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP28886%27 HTTP/1.1" 200 None
2026-03-29 18:34:04 [auto1.de] INFO: Scrape type for WP28886: 0
2026-03-29 18:34:04 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB87355%27 HTTP/1.1" 200 None
2026-03-29 18:34:04 [auto1.de] INFO: Scrape type for AB87355: 2
2026-03-29 18:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with identifier: AB87355
2026-03-29 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with scrape type 2
2026-03-29 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with scrape type 2
2026-03-29 18:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 682cc8fc-7570-5a7c-80e9-f8a66b55e40c, identifier: AB87355
2026-03-29 18:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with identifier: AB87355
2026-03-29 18:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with identifier: AB87355
2026-03-29 18:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with identifier: AB87355 to the API
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:02:36Z',
'fuel_type': 'diesel',
'id': '682cc8fc-7570-5a7c-80e9-f8a66b55e40c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB87355',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 135653,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-31',
'seller_name': None,
'title': 'Nissan Qashqai 1.7 dCi Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2020}
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB87355%27 HTTP/1.1" 200 None
2026-03-29 18:34:05 [auto1.de] INFO: Saving data for AB87355: {'auction_closing_time': 1774882956.0, 'created_time': 1773135611.397026, 'last_price_update_time': 1774809245.431585}
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB87355') HTTP/1.1" 204 0
2026-03-29 18:34:05 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-29 18:34:05 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC78476%27 HTTP/1.1" 200 None
2026-03-29 18:34:05 [auto1.de] INFO: Scrape type for EC78476: 0
2026-03-29 18:34:05 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-29 18:34:05 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-29 18:34:05 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28576%27 HTTP/1.1" 200 None
2026-03-29 18:34:05 [auto1.de] INFO: Scrape type for ZD28576: 2
2026-03-29 18:34:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 643c22f9-9c40-5d40-9c79-b4aaf666f822 with identifier: ZD28576
2026-03-29 18:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 643c22f9-9c40-5d40-9c79-b4aaf666f822 with scrape type 2
2026-03-29 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 643c22f9-9c40-5d40-9c79-b4aaf666f822 with scrape type 2
2026-03-29 18:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 643c22f9-9c40-5d40-9c79-b4aaf666f822, identifier: ZD28576
2026-03-29 18:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 643c22f9-9c40-5d40-9c79-b4aaf666f822 with identifier: ZD28576
2026-03-29 18:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 643c22f9-9c40-5d40-9c79-b4aaf666f822 with identifier: ZD28576
2026-03-29 18:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 643c22f9-9c40-5d40-9c79-b4aaf666f822 with identifier: ZD28576 to the API
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:26:22Z',
'fuel_type': 'diesel',
'id': '643c22f9-9c40-5d40-9c79-b4aaf666f822',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD28576',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 198583,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-14',
'seller_name': None,
'title': 'Seat Leon 1.6 TDI Style Ecomotive',
'transmission': 'manual',
'trim': 'Style Ecomotive',
'year': 2015}
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28576%27 HTTP/1.1" 200 None
2026-03-29 18:34:05 [auto1.de] INFO: Saving data for ZD28576: {'auction_closing_time': 1774884382.0, 'created_time': 1774608337.256713, 'last_price_update_time': 1774809245.926681}
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD28576') HTTP/1.1" 204 0
2026-03-29 18:34:06 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-29 18:34:06 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA95413%27 HTTP/1.1" 200 None
2026-03-29 18:34:06 [auto1.de] INFO: Scrape type for BA95413: 2
2026-03-29 18:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 209680f7-879f-5628-8420-7e000da37405 with identifier: BA95413
2026-03-29 18:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209680f7-879f-5628-8420-7e000da37405 with scrape type 2
2026-03-29 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 209680f7-879f-5628-8420-7e000da37405 with scrape type 2
2026-03-29 18:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 209680f7-879f-5628-8420-7e000da37405, identifier: BA95413
2026-03-29 18:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 209680f7-879f-5628-8420-7e000da37405 with identifier: BA95413
2026-03-29 18:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 209680f7-879f-5628-8420-7e000da37405 with identifier: BA95413
2026-03-29 18:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 209680f7-879f-5628-8420-7e000da37405 with identifier: BA95413 to the API
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:45:44Z',
'fuel_type': 'petrol',
'id': '209680f7-879f-5628-8420-7e000da37405',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA95413',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 181854,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-16',
'seller_name': None,
'title': 'Opel Astra 1.6 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2008}
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA95413%27 HTTP/1.1" 200 None
2026-03-29 18:34:06 [auto1.de] INFO: Saving data for BA95413: {'auction_closing_time': 1774885544.0, 'created_time': 1774522033.34082, 'last_price_update_time': 1774809246.436286}
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA95413') HTTP/1.1" 204 0
2026-03-29 18:34:06 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB31140%27 HTTP/1.1" 200 None
2026-03-29 18:34:06 [auto1.de] INFO: Scrape type for FB31140: 2
2026-03-29 18:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 647943a7-4e95-5bb2-8f5c-9489c90a4963 with identifier: FB31140
2026-03-29 18:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 647943a7-4e95-5bb2-8f5c-9489c90a4963 with scrape type 2
2026-03-29 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 647943a7-4e95-5bb2-8f5c-9489c90a4963 with scrape type 2
2026-03-29 18:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 647943a7-4e95-5bb2-8f5c-9489c90a4963, identifier: FB31140
2026-03-29 18:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 647943a7-4e95-5bb2-8f5c-9489c90a4963 with identifier: FB31140
2026-03-29 18:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 647943a7-4e95-5bb2-8f5c-9489c90a4963 with identifier: FB31140
2026-03-29 18:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 647943a7-4e95-5bb2-8f5c-9489c90a4963 with identifier: FB31140 to the API
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:09:00Z',
'fuel_type': 'petrol',
'id': '647943a7-4e95-5bb2-8f5c-9489c90a4963',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB31140',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 266965,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-06',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency',
'transmission': 'manual',
'trim': 'BlueEfficiency',
'year': 2012}
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB31140%27 HTTP/1.1" 200 None
2026-03-29 18:34:06 [auto1.de] INFO: Saving data for FB31140: {'auction_closing_time': 1774883340.0, 'created_time': 1773860710.128866, 'last_price_update_time': 1774809246.865976}
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB31140') HTTP/1.1" 204 0
2026-03-29 18:34:06 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL62342%27 HTTP/1.1" 200 None
2026-03-29 18:34:06 [auto1.de] INFO: Scrape type for XL62342: 2
2026-03-29 18:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f1918c4-2534-5147-91cd-34cec44efe9c with identifier: XL62342
2026-03-29 18:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f1918c4-2534-5147-91cd-34cec44efe9c with scrape type 2
2026-03-29 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f1918c4-2534-5147-91cd-34cec44efe9c with scrape type 2
2026-03-29 18:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f1918c4-2534-5147-91cd-34cec44efe9c, identifier: XL62342
2026-03-29 18:34:06 [scrapy.extensions.logstats] INFO: Crawled 54 pages (at 12 pages/min), scraped 270 items (at 105 items/min)
2026-03-29 18:34:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f1918c4-2534-5147-91cd-34cec44efe9c with identifier: XL62342
2026-03-29 18:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f1918c4-2534-5147-91cd-34cec44efe9c with identifier: XL62342
2026-03-29 18:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f1918c4-2534-5147-91cd-34cec44efe9c with identifier: XL62342 to the API
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-30T15:36:18Z',
'fuel_type': 'diesel',
'id': '0f1918c4-2534-5147-91cd-34cec44efe9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL62342',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 195504,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-15',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 e-HDi Selection',
'transmission': 'automatic',
'trim': 'Selection',
'year': 2012}
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL62342%27 HTTP/1.1" 200 None
2026-03-29 18:34:07 [auto1.de] INFO: Saving data for XL62342: {'auction_closing_time': 1774884978.0, 'created_time': 1773776268.888814, 'last_price_update_time': 1774809247.311185}
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL62342') HTTP/1.1" 204 0
2026-03-29 18:34:07 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE63795%27 HTTP/1.1" 200 None
2026-03-29 18:34:07 [auto1.de] INFO: Scrape type for RE63795: 0
2026-03-29 18:34:07 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-29 18:34:07 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-29 18:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:34:07 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 6740 | hits on page: 40
2026-03-29 18:34:07 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV94095%27 HTTP/1.1" 200 None
2026-03-29 18:34:07 [auto1.de] INFO: Scrape type for WV94095: 2
2026-03-29 18:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with identifier: WV94095
2026-03-29 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with scrape type 2
2026-03-29 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with scrape type 2
2026-03-29 18:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db2cbad4-ee18-5f98-a0d5-7517cdb3eaab, identifier: WV94095
2026-03-29 18:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with identifier: WV94095
2026-03-29 18:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with identifier: WV94095
2026-03-29 18:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with identifier: WV94095 to the API
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:43:07Z',
'fuel_type': 'petrol',
'id': 'db2cbad4-ee18-5f98-a0d5-7517cdb3eaab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV94095',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 142113,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-18',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.4 Turbo Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2017}
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV94095%27 HTTP/1.1" 200 None
2026-03-29 18:34:07 [auto1.de] INFO: Saving data for WV94095: {'auction_closing_time': 1774885387.0, 'created_time': 1773741463.06113, 'last_price_update_time': 1774809247.892796}
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV94095') HTTP/1.1" 204 0
2026-03-29 18:34:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:34:07 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU57590%27 HTTP/1.1" 200 None
2026-03-29 18:34:07 [auto1.de] INFO: Scrape type for HU57590: 0
2026-03-29 18:34:07 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72792%27 HTTP/1.1" 200 None
2026-03-29 18:34:07 [auto1.de] INFO: Scrape type for MZ72792: 2
2026-03-29 18:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d010d4d-9a59-5c69-a014-5c837822749c with identifier: MZ72792
2026-03-29 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d010d4d-9a59-5c69-a014-5c837822749c with scrape type 2
2026-03-29 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d010d4d-9a59-5c69-a014-5c837822749c with scrape type 2
2026-03-29 18:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d010d4d-9a59-5c69-a014-5c837822749c, identifier: MZ72792
2026-03-29 18:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d010d4d-9a59-5c69-a014-5c837822749c with identifier: MZ72792
2026-03-29 18:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d010d4d-9a59-5c69-a014-5c837822749c with identifier: MZ72792
2026-03-29 18:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d010d4d-9a59-5c69-a014-5c837822749c with identifier: MZ72792 to the API
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:39:10Z',
'fuel_type': 'petrol',
'id': '2d010d4d-9a59-5c69-a014-5c837822749c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ72792',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 68453,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-29',
'seller_name': None,
'title': 'Fiat 500X 1.6 Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2015}
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72792%27 HTTP/1.1" 200 None
2026-03-29 18:34:08 [auto1.de] INFO: Saving data for MZ72792: {'auction_closing_time': 1774885150.0, 'created_time': 1774294843.294277, 'last_price_update_time': 1774809248.377465}
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ72792') HTTP/1.1" 204 0
2026-03-29 18:34:08 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB06049%27 HTTP/1.1" 200 None
2026-03-29 18:34:08 [auto1.de] INFO: Scrape type for HB06049: 2
2026-03-29 18:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbae2502-4fc3-5fff-aa2d-081a69e05020 with identifier: HB06049
2026-03-29 18:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbae2502-4fc3-5fff-aa2d-081a69e05020 with scrape type 2
2026-03-29 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbae2502-4fc3-5fff-aa2d-081a69e05020 with scrape type 2
2026-03-29 18:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbae2502-4fc3-5fff-aa2d-081a69e05020, identifier: HB06049
2026-03-29 18:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbae2502-4fc3-5fff-aa2d-081a69e05020 with identifier: HB06049
2026-03-29 18:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbae2502-4fc3-5fff-aa2d-081a69e05020 with identifier: HB06049
2026-03-29 18:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbae2502-4fc3-5fff-aa2d-081a69e05020 with identifier: HB06049 to the API
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:24:47Z',
'fuel_type': 'diesel',
'id': 'bbae2502-4fc3-5fff-aa2d-081a69e05020',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB06049',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 113533,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-06',
'seller_name': None,
'title': 'Peugeot 3008 2.0 Blue-HDi GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2018}
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB06049%27 HTTP/1.1" 200 None
2026-03-29 18:34:08 [auto1.de] INFO: Saving data for HB06049: {'auction_closing_time': 1774884287.0, 'created_time': 1774522557.06571, 'last_price_update_time': 1774809248.777311}
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB06049') HTTP/1.1" 204 0
2026-03-29 18:34:08 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00543%27 HTTP/1.1" 200 None
2026-03-29 18:34:08 [auto1.de] INFO: Scrape type for PD00543: 2
2026-03-29 18:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 600af1cc-4f9a-5a0f-bfa5-1114933aa7b0 with identifier: PD00543
2026-03-29 18:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 600af1cc-4f9a-5a0f-bfa5-1114933aa7b0 with scrape type 2
2026-03-29 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 600af1cc-4f9a-5a0f-bfa5-1114933aa7b0 with scrape type 2
2026-03-29 18:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 600af1cc-4f9a-5a0f-bfa5-1114933aa7b0, identifier: PD00543
2026-03-29 18:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 600af1cc-4f9a-5a0f-bfa5-1114933aa7b0 with identifier: PD00543
2026-03-29 18:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 600af1cc-4f9a-5a0f-bfa5-1114933aa7b0 with identifier: PD00543
2026-03-29 18:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 600af1cc-4f9a-5a0f-bfa5-1114933aa7b0 with identifier: PD00543 to the API
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:12:52Z',
'fuel_type': 'petrol',
'id': '600af1cc-4f9a-5a0f-bfa5-1114933aa7b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD00543',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 167249,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-08-24',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 280',
'transmission': 'automatic',
'trim': '',
'year': 2008}
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00543%27 HTTP/1.1" 200 None
2026-03-29 18:34:09 [auto1.de] INFO: Saving data for PD00543: {'auction_closing_time': 1774883572.0, 'created_time': 1774636289.494853, 'last_price_update_time': 1774809249.27117}
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD00543') HTTP/1.1" 204 0
2026-03-29 18:34:09 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ60837%27 HTTP/1.1" 200 None
2026-03-29 18:34:09 [auto1.de] INFO: Scrape type for BJ60837: 2
2026-03-29 18:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with identifier: BJ60837
2026-03-29 18:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with scrape type 2
2026-03-29 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with scrape type 2
2026-03-29 18:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0, identifier: BJ60837
2026-03-29 18:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with identifier: BJ60837
2026-03-29 18:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with identifier: BJ60837
2026-03-29 18:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with identifier: BJ60837 to the API
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:35:58Z',
'fuel_type': 'diesel',
'id': '5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ60837',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 62875,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-15',
'seller_name': None,
'title': 'Audi Q2 35 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2020}
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ60837%27 HTTP/1.1" 200 None
2026-03-29 18:34:09 [auto1.de] INFO: Saving data for BJ60837: {'auction_closing_time': 1774884958.0, 'created_time': 1774293694.471829, 'last_price_update_time': 1774809249.744373}
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ60837') HTTP/1.1" 204 0
2026-03-29 18:34:09 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06718%27 HTTP/1.1" 200 None
2026-03-29 18:34:09 [auto1.de] INFO: Scrape type for VL06718: 2
2026-03-29 18:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c21ef52-7a31-5346-8491-018a7e2fabe6 with identifier: VL06718
2026-03-29 18:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c21ef52-7a31-5346-8491-018a7e2fabe6 with scrape type 2
2026-03-29 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c21ef52-7a31-5346-8491-018a7e2fabe6 with scrape type 2
2026-03-29 18:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c21ef52-7a31-5346-8491-018a7e2fabe6, identifier: VL06718
2026-03-29 18:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c21ef52-7a31-5346-8491-018a7e2fabe6 with identifier: VL06718
2026-03-29 18:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c21ef52-7a31-5346-8491-018a7e2fabe6 with identifier: VL06718
2026-03-29 18:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c21ef52-7a31-5346-8491-018a7e2fabe6 with identifier: VL06718 to the API
2026-03-29 18:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:21:21Z',
'fuel_type': 'petrol',
'id': '3c21ef52-7a31-5346-8491-018a7e2fabe6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL06718',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 149571,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-31',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2017}
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06718%27 HTTP/1.1" 200 None
2026-03-29 18:34:10 [auto1.de] INFO: Saving data for VL06718: {'auction_closing_time': 1774884081.0, 'created_time': 1773946276.228327, 'last_price_update_time': 1774809250.165181}
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL06718') HTTP/1.1" 204 0
2026-03-29 18:34:10 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU27539%27 HTTP/1.1" 200 None
2026-03-29 18:34:10 [auto1.de] INFO: Scrape type for DU27539: 2
2026-03-29 18:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4869be33-a847-5ca2-b107-350924eb03cf with identifier: DU27539
2026-03-29 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4869be33-a847-5ca2-b107-350924eb03cf with scrape type 2
2026-03-29 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4869be33-a847-5ca2-b107-350924eb03cf with scrape type 2
2026-03-29 18:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4869be33-a847-5ca2-b107-350924eb03cf, identifier: DU27539
2026-03-29 18:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4869be33-a847-5ca2-b107-350924eb03cf with identifier: DU27539
2026-03-29 18:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4869be33-a847-5ca2-b107-350924eb03cf with identifier: DU27539
2026-03-29 18:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4869be33-a847-5ca2-b107-350924eb03cf with identifier: DU27539 to the API
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 272,
'expiration_date': '2026-03-30T15:53:06Z',
'fuel_type': 'petrol',
'id': '4869be33-a847-5ca2-b107-350924eb03cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU27539',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 143512,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-01',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU27539%27 HTTP/1.1" 200 None
2026-03-29 18:34:10 [auto1.de] INFO: Saving data for DU27539: {'auction_closing_time': 1774885986.0, 'created_time': 1773860070.767056, 'last_price_update_time': 1774809250.643125}
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU27539') HTTP/1.1" 204 0
2026-03-29 18:34:10 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-29 18:34:10 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-29 18:34:10 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ93781%27 HTTP/1.1" 200 None
2026-03-29 18:34:10 [auto1.de] INFO: Scrape type for LJ93781: 2
2026-03-29 18:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9168d46b-094a-5615-8785-1f1e6fe0e980 with identifier: LJ93781
2026-03-29 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9168d46b-094a-5615-8785-1f1e6fe0e980 with scrape type 2
2026-03-29 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9168d46b-094a-5615-8785-1f1e6fe0e980 with scrape type 2
2026-03-29 18:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9168d46b-094a-5615-8785-1f1e6fe0e980, identifier: LJ93781
2026-03-29 18:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9168d46b-094a-5615-8785-1f1e6fe0e980 with identifier: LJ93781
2026-03-29 18:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9168d46b-094a-5615-8785-1f1e6fe0e980 with identifier: LJ93781
2026-03-29 18:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9168d46b-094a-5615-8785-1f1e6fe0e980 with identifier: LJ93781 to the API
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:42:26Z',
'fuel_type': 'petrol',
'id': '9168d46b-094a-5615-8785-1f1e6fe0e980',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ93781',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 85348,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-11',
'seller_name': None,
'title': 'Seat Ibiza 1.2 TSI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2014}
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ93781%27 HTTP/1.1" 200 None
2026-03-29 18:34:11 [auto1.de] INFO: Saving data for LJ93781: {'auction_closing_time': 1774885346.0, 'created_time': 1774117856.319088, 'last_price_update_time': 1774809251.047274}
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ93781') HTTP/1.1" 204 0
2026-03-29 18:34:11 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-29 18:34:11 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-29 18:34:11 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN03307%27 HTTP/1.1" 200 None
2026-03-29 18:34:11 [auto1.de] INFO: Scrape type for RN03307: 2
2026-03-29 18:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e6c496e-90ed-5916-932d-74697b3d5865 with identifier: RN03307
2026-03-29 18:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e6c496e-90ed-5916-932d-74697b3d5865 with scrape type 2
2026-03-29 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e6c496e-90ed-5916-932d-74697b3d5865 with scrape type 2
2026-03-29 18:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e6c496e-90ed-5916-932d-74697b3d5865, identifier: RN03307
2026-03-29 18:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e6c496e-90ed-5916-932d-74697b3d5865 with identifier: RN03307
2026-03-29 18:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e6c496e-90ed-5916-932d-74697b3d5865 with identifier: RN03307
2026-03-29 18:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e6c496e-90ed-5916-932d-74697b3d5865 with identifier: RN03307 to the API
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 389,
'expiration_date': '2026-03-30T15:42:12Z',
'fuel_type': 'petrol',
'id': '9e6c496e-90ed-5916-932d-74697b3d5865',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN03307',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 64737,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-22',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 450 Mild-Hybrid 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN03307%27 HTTP/1.1" 200 None
2026-03-29 18:34:11 [auto1.de] INFO: Saving data for RN03307: {'auction_closing_time': 1774885332.0, 'created_time': 1774264913.648804, 'last_price_update_time': 1774809251.528521}
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN03307') HTTP/1.1" 204 0
2026-03-29 18:34:11 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77035%27 HTTP/1.1" 200 None
2026-03-29 18:34:11 [auto1.de] INFO: Scrape type for UR77035: 0
2026-03-29 18:34:11 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-29 18:34:11 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-29 18:34:11 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-29 18:34:11 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-29 18:34:11 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-29 18:34:11 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-29 18:34:11 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66597%27 HTTP/1.1" 200 None
2026-03-29 18:34:11 [auto1.de] INFO: Scrape type for NN66597: 2
2026-03-29 18:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with identifier: NN66597
2026-03-29 18:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with scrape type 2
2026-03-29 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with scrape type 2
2026-03-29 18:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ab90b43-623e-5bc7-bea2-47c2de6cccc9, identifier: NN66597
2026-03-29 18:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with identifier: NN66597
2026-03-29 18:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with identifier: NN66597
2026-03-29 18:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with identifier: NN66597 to the API
2026-03-29 18:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:05:00Z',
'fuel_type': 'hybrid',
'id': '5ab90b43-623e-5bc7-bea2-47c2de6cccc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN66597',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 106388,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-16',
'seller_name': None,
'title': 'Toyota RAV 4 2.5 Hybrid 4x4',
'transmission': 'automatic',
'trim': '4x4',
'year': 2021}
2026-03-29 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66597%27 HTTP/1.1" 200 None
2026-03-29 18:34:12 [auto1.de] INFO: Saving data for NN66597: {'auction_closing_time': 1774883100.0, 'created_time': 1774264441.724794, 'last_price_update_time': 1774809252.985723}
2026-03-29 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN66597') HTTP/1.1" 204 0
2026-03-29 18:34:13 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-29 18:34:13 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN95759%27 HTTP/1.1" 200 None
2026-03-29 18:34:13 [auto1.de] INFO: Scrape type for YN95759: 0
2026-03-29 18:34:13 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17780%27 HTTP/1.1" 200 None
2026-03-29 18:34:13 [auto1.de] INFO: Scrape type for JR17780: 0
2026-03-29 18:34:13 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54008%27 HTTP/1.1" 200 None
2026-03-29 18:34:13 [auto1.de] INFO: Scrape type for WY54008: 2
2026-03-29 18:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eefa11ee-9875-5b77-958f-dd4205007831 with identifier: WY54008
2026-03-29 18:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eefa11ee-9875-5b77-958f-dd4205007831 with scrape type 2
2026-03-29 18:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eefa11ee-9875-5b77-958f-dd4205007831 with scrape type 2
2026-03-29 18:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eefa11ee-9875-5b77-958f-dd4205007831, identifier: WY54008
2026-03-29 18:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eefa11ee-9875-5b77-958f-dd4205007831 with identifier: WY54008
2026-03-29 18:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eefa11ee-9875-5b77-958f-dd4205007831 with identifier: WY54008
2026-03-29 18:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eefa11ee-9875-5b77-958f-dd4205007831 with identifier: WY54008 to the API
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:05:01Z',
'fuel_type': 'petrol',
'id': 'eefa11ee-9875-5b77-958f-dd4205007831',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY54008',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 137484,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-28',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2016}
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54008%27 HTTP/1.1" 200 None
2026-03-29 18:34:13 [auto1.de] INFO: Saving data for WY54008: {'auction_closing_time': 1774883101.0, 'created_time': 1774607612.336476, 'last_price_update_time': 1774809253.529073}
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY54008') HTTP/1.1" 204 0
2026-03-29 18:34:13 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-29 18:34:13 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-29 18:34:13 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-29 18:34:13 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-29 18:34:13 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG14564%27 HTTP/1.1" 200 None
2026-03-29 18:34:13 [auto1.de] INFO: Scrape type for VG14564: 0
2026-03-29 18:34:13 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB13325%27 HTTP/1.1" 200 None
2026-03-29 18:34:13 [auto1.de] INFO: Scrape type for HB13325: 0
2026-03-29 18:34:13 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-29 18:34:13 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU04810%27 HTTP/1.1" 200 None
2026-03-29 18:34:13 [auto1.de] INFO: Scrape type for FU04810: 0
2026-03-29 18:34:13 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-29 18:34:13 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91046%27 HTTP/1.1" 200 None
2026-03-29 18:34:13 [auto1.de] INFO: Scrape type for GV91046: 2
2026-03-29 18:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with identifier: GV91046
2026-03-29 18:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with scrape type 2
2026-03-29 18:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with scrape type 2
2026-03-29 18:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ba1abf2-d22f-5f6b-9b6d-ee032405443d, identifier: GV91046
2026-03-29 18:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with identifier: GV91046
2026-03-29 18:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with identifier: GV91046
2026-03-29 18:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with identifier: GV91046 to the API
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:34:32Z',
'fuel_type': 'diesel',
'id': '4ba1abf2-d22f-5f6b-9b6d-ee032405443d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV91046',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 342414,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-02',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2014}
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91046%27 HTTP/1.1" 200 None
2026-03-29 18:34:14 [auto1.de] INFO: Saving data for GV91046: {'auction_closing_time': 1774884872.0, 'created_time': 1773308234.094236, 'last_price_update_time': 1774809254.085434}
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV91046') HTTP/1.1" 204 0
2026-03-29 18:34:14 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED00109%27 HTTP/1.1" 200 None
2026-03-29 18:34:14 [auto1.de] INFO: Scrape type for ED00109: 2
2026-03-29 18:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with identifier: ED00109
2026-03-29 18:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with scrape type 2
2026-03-29 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with scrape type 2
2026-03-29 18:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc, identifier: ED00109
2026-03-29 18:34:14 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 6740 | hits on page: 40
2026-03-29 18:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with identifier: ED00109
2026-03-29 18:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with identifier: ED00109
2026-03-29 18:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with identifier: ED00109 to the API
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:15:20Z',
'fuel_type': 'petrol',
'id': '14a4dcb9-cff4-59c3-8989-a8c9b3a007fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED00109',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 192858,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-31',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.4 Turbo Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2016}
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED00109%27 HTTP/1.1" 200 None
2026-03-29 18:34:14 [auto1.de] INFO: Saving data for ED00109: {'auction_closing_time': 1774883720.0, 'created_time': 1774290787.179871, 'last_price_update_time': 1774809254.632736}
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED00109') HTTP/1.1" 204 0
2026-03-29 18:34:14 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-29 18:34:14 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ48384%27 HTTP/1.1" 200 None
2026-03-29 18:34:14 [auto1.de] INFO: Scrape type for RZ48384: 2
2026-03-29 18:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f559f79e-fffe-5004-bbe2-db2ea64f0b58 with identifier: RZ48384
2026-03-29 18:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f559f79e-fffe-5004-bbe2-db2ea64f0b58 with scrape type 2
2026-03-29 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f559f79e-fffe-5004-bbe2-db2ea64f0b58 with scrape type 2
2026-03-29 18:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f559f79e-fffe-5004-bbe2-db2ea64f0b58, identifier: RZ48384
2026-03-29 18:34:14 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG07323%27 HTTP/1.1" 200 None
2026-03-29 18:34:14 [auto1.de] INFO: Scrape type for FG07323: 0
2026-03-29 18:34:14 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA42145%27 HTTP/1.1" 200 None
2026-03-29 18:34:14 [auto1.de] INFO: Scrape type for GA42145: 0
2026-03-29 18:34:14 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-29 18:34:14 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32015%27 HTTP/1.1" 200 None
2026-03-29 18:34:14 [auto1.de] INFO: Scrape type for TN32015: 2
2026-03-29 18:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2620f64c-c64f-53fa-a1ac-a35734abd41e with identifier: TN32015
2026-03-29 18:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2620f64c-c64f-53fa-a1ac-a35734abd41e with scrape type 2
2026-03-29 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2620f64c-c64f-53fa-a1ac-a35734abd41e with scrape type 2
2026-03-29 18:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2620f64c-c64f-53fa-a1ac-a35734abd41e, identifier: TN32015
2026-03-29 18:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f559f79e-fffe-5004-bbe2-db2ea64f0b58 with identifier: RZ48384
2026-03-29 18:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f559f79e-fffe-5004-bbe2-db2ea64f0b58 with identifier: RZ48384
2026-03-29 18:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f559f79e-fffe-5004-bbe2-db2ea64f0b58 with identifier: RZ48384 to the API
2026-03-29 18:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:16:25Z',
'fuel_type': 'diesel',
'id': 'f559f79e-fffe-5004-bbe2-db2ea64f0b58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ48384',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 100011,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-07',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 310 L1 Tourneo Titanium',
'transmission': 'automatic',
'trim': '310 L1 Tourneo Titanium',
'year': 2018}
2026-03-29 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ48384%27 HTTP/1.1" 200 None
2026-03-29 18:34:15 [auto1.de] INFO: Saving data for RZ48384: {'auction_closing_time': 1774883785.0, 'created_time': 1774522204.826056, 'last_price_update_time': 1774809255.231679}
2026-03-29 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ48384') HTTP/1.1" 204 0
2026-03-29 18:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2620f64c-c64f-53fa-a1ac-a35734abd41e with identifier: TN32015
2026-03-29 18:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2620f64c-c64f-53fa-a1ac-a35734abd41e with identifier: TN32015
2026-03-29 18:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2620f64c-c64f-53fa-a1ac-a35734abd41e with identifier: TN32015 to the API
2026-03-29 18:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:27:45Z',
'fuel_type': 'petrol',
'id': '2620f64c-c64f-53fa-a1ac-a35734abd41e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN32015',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 142511,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-04',
'seller_name': None,
'title': 'Seat Ibiza 1.4 Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2008}
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32015%27 HTTP/1.1" 200 None
2026-03-29 18:34:16 [auto1.de] INFO: Saving data for TN32015: {'auction_closing_time': 1774884465.0, 'created_time': 1774521394.494748, 'last_price_update_time': 1774809256.01153}
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN32015') HTTP/1.1" 204 0
2026-03-29 18:34:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:34:16 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB60272%27 HTTP/1.1" 200 None
2026-03-29 18:34:16 [auto1.de] INFO: Scrape type for SB60272: 2
2026-03-29 18:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a54ebecf-f303-520e-bb68-6165f57ad412 with identifier: SB60272
2026-03-29 18:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54ebecf-f303-520e-bb68-6165f57ad412 with scrape type 2
2026-03-29 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a54ebecf-f303-520e-bb68-6165f57ad412 with scrape type 2
2026-03-29 18:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a54ebecf-f303-520e-bb68-6165f57ad412, identifier: SB60272
2026-03-29 18:34:16 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY68410%27 HTTP/1.1" 200 None
2026-03-29 18:34:16 [auto1.de] INFO: Scrape type for XY68410: 2
2026-03-29 18:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02e48f5d-fbf0-519e-a51e-30bb3a5e6461 with identifier: XY68410
2026-03-29 18:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02e48f5d-fbf0-519e-a51e-30bb3a5e6461 with scrape type 2
2026-03-29 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02e48f5d-fbf0-519e-a51e-30bb3a5e6461 with scrape type 2
2026-03-29 18:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02e48f5d-fbf0-519e-a51e-30bb3a5e6461, identifier: XY68410
2026-03-29 18:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a54ebecf-f303-520e-bb68-6165f57ad412 with identifier: SB60272
2026-03-29 18:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a54ebecf-f303-520e-bb68-6165f57ad412 with identifier: SB60272
2026-03-29 18:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a54ebecf-f303-520e-bb68-6165f57ad412 with identifier: SB60272 to the API
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:19:29Z',
'fuel_type': 'diesel',
'id': 'a54ebecf-f303-520e-bb68-6165f57ad412',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB60272',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 231736,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-05-18',
'seller_name': None,
'title': 'BMW X3 3.0d',
'transmission': 'manual',
'trim': '',
'year': 2004}
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB60272%27 HTTP/1.1" 200 None
2026-03-29 18:34:16 [auto1.de] INFO: Saving data for SB60272: {'auction_closing_time': 1774883969.0, 'created_time': 1773227303.319269, 'last_price_update_time': 1774809256.513492}
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB60272') HTTP/1.1" 204 0
2026-03-29 18:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02e48f5d-fbf0-519e-a51e-30bb3a5e6461 with identifier: XY68410
2026-03-29 18:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02e48f5d-fbf0-519e-a51e-30bb3a5e6461 with identifier: XY68410
2026-03-29 18:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02e48f5d-fbf0-519e-a51e-30bb3a5e6461 with identifier: XY68410 to the API
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:36:23Z',
'fuel_type': 'diesel',
'id': '02e48f5d-fbf0-519e-a51e-30bb3a5e6461',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY68410',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 259815,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-07',
'seller_name': None,
'title': 'BMW 3er 318d GT',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY68410%27 HTTP/1.1" 200 None
2026-03-29 18:34:16 [auto1.de] INFO: Saving data for XY68410: {'auction_closing_time': 1774884983.0, 'created_time': 1774521342.185913, 'last_price_update_time': 1774809256.821053}
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY68410') HTTP/1.1" 204 0
2026-03-29 18:34:16 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-29 18:34:16 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-29 18:34:16 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-29 18:34:16 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-29 18:34:16 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-29 18:34:16 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA23811%27 HTTP/1.1" 200 None
2026-03-29 18:34:16 [auto1.de] INFO: Scrape type for DA23811: 2
2026-03-29 18:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bbad03c-e6a7-571a-930b-d0fbb30fa75d with identifier: DA23811
2026-03-29 18:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bbad03c-e6a7-571a-930b-d0fbb30fa75d with scrape type 2
2026-03-29 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bbad03c-e6a7-571a-930b-d0fbb30fa75d with scrape type 2
2026-03-29 18:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bbad03c-e6a7-571a-930b-d0fbb30fa75d, identifier: DA23811
2026-03-29 18:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bbad03c-e6a7-571a-930b-d0fbb30fa75d with identifier: DA23811
2026-03-29 18:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bbad03c-e6a7-571a-930b-d0fbb30fa75d with identifier: DA23811
2026-03-29 18:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bbad03c-e6a7-571a-930b-d0fbb30fa75d with identifier: DA23811 to the API
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:00:34Z',
'fuel_type': 'diesel',
'id': '0bbad03c-e6a7-571a-930b-d0fbb30fa75d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA23811',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 51987,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-20',
'seller_name': None,
'title': 'Audi Q3 2.0 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2015}
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA23811%27 HTTP/1.1" 200 None
2026-03-29 18:34:17 [auto1.de] INFO: Saving data for DA23811: {'auction_closing_time': 1774882834.0, 'created_time': 1774521353.196711, 'last_price_update_time': 1774809257.240766}
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA23811') HTTP/1.1" 204 0
2026-03-29 18:34:17 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ79939%27 HTTP/1.1" 200 None
2026-03-29 18:34:17 [auto1.de] INFO: Scrape type for DZ79939: 2
2026-03-29 18:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52deb2f5-a259-59b9-bb91-865725f0cc4a with identifier: DZ79939
2026-03-29 18:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52deb2f5-a259-59b9-bb91-865725f0cc4a with scrape type 2
2026-03-29 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52deb2f5-a259-59b9-bb91-865725f0cc4a with scrape type 2
2026-03-29 18:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52deb2f5-a259-59b9-bb91-865725f0cc4a, identifier: DZ79939
2026-03-29 18:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52deb2f5-a259-59b9-bb91-865725f0cc4a with identifier: DZ79939
2026-03-29 18:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52deb2f5-a259-59b9-bb91-865725f0cc4a with identifier: DZ79939
2026-03-29 18:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52deb2f5-a259-59b9-bb91-865725f0cc4a with identifier: DZ79939 to the API
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:21:02Z',
'fuel_type': 'diesel',
'id': '52deb2f5-a259-59b9-bb91-865725f0cc4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ79939',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 232234,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-29',
'seller_name': None,
'title': 'Audi A5 Sportback 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ79939%27 HTTP/1.1" 200 None
2026-03-29 18:34:17 [auto1.de] INFO: Saving data for DZ79939: {'auction_closing_time': 1774884062.0, 'created_time': 1773134525.548942, 'last_price_update_time': 1774809257.784983}
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ79939') HTTP/1.1" 204 0
2026-03-29 18:34:17 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD17986%27 HTTP/1.1" 200 None
2026-03-29 18:34:17 [auto1.de] INFO: Scrape type for TD17986: 2
2026-03-29 18:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2711f656-96eb-5ccd-907e-1719e67a9b84 with identifier: TD17986
2026-03-29 18:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2711f656-96eb-5ccd-907e-1719e67a9b84 with scrape type 2
2026-03-29 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2711f656-96eb-5ccd-907e-1719e67a9b84 with scrape type 2
2026-03-29 18:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2711f656-96eb-5ccd-907e-1719e67a9b84, identifier: TD17986
2026-03-29 18:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2711f656-96eb-5ccd-907e-1719e67a9b84 with identifier: TD17986
2026-03-29 18:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2711f656-96eb-5ccd-907e-1719e67a9b84 with identifier: TD17986
2026-03-29 18:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2711f656-96eb-5ccd-907e-1719e67a9b84 with identifier: TD17986 to the API
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:40:05Z',
'fuel_type': 'diesel',
'id': '2711f656-96eb-5ccd-907e-1719e67a9b84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD17986',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 227011,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-26',
'seller_name': None,
'title': 'BMW 5er 530d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2016}
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD17986%27 HTTP/1.1" 200 None
2026-03-29 18:34:18 [auto1.de] INFO: Saving data for TD17986: {'auction_closing_time': 1774885205.0, 'created_time': 1773917363.141979, 'last_price_update_time': 1774809258.207141}
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD17986') HTTP/1.1" 204 0
2026-03-29 18:34:18 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-29 18:34:18 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS21942%27 HTTP/1.1" 200 None
2026-03-29 18:34:18 [auto1.de] INFO: Scrape type for AS21942: 2
2026-03-29 18:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6090e202-fd22-588b-a67a-0c1db55df362 with identifier: AS21942
2026-03-29 18:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6090e202-fd22-588b-a67a-0c1db55df362 with scrape type 2
2026-03-29 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6090e202-fd22-588b-a67a-0c1db55df362 with scrape type 2
2026-03-29 18:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6090e202-fd22-588b-a67a-0c1db55df362, identifier: AS21942
2026-03-29 18:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6090e202-fd22-588b-a67a-0c1db55df362 with identifier: AS21942
2026-03-29 18:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6090e202-fd22-588b-a67a-0c1db55df362 with identifier: AS21942
2026-03-29 18:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6090e202-fd22-588b-a67a-0c1db55df362 with identifier: AS21942 to the API
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:34:45Z',
'fuel_type': 'petrol',
'id': '6090e202-fd22-588b-a67a-0c1db55df362',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS21942',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 115739,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-15',
'seller_name': None,
'title': 'Audi A1 1.2 TFSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2014}
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS21942%27 HTTP/1.1" 200 None
2026-03-29 18:34:18 [auto1.de] INFO: Saving data for AS21942: {'auction_closing_time': 1774884885.0, 'created_time': 1773303444.607229, 'last_price_update_time': 1774809258.643286}
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS21942') HTTP/1.1" 204 0
2026-03-29 18:34:18 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-29 18:34:18 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS38036%27 HTTP/1.1" 200 None
2026-03-29 18:34:18 [auto1.de] INFO: Scrape type for XS38036: 2
2026-03-29 18:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08eadfe0-9686-585b-a307-a4e531045765 with identifier: XS38036
2026-03-29 18:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08eadfe0-9686-585b-a307-a4e531045765 with scrape type 2
2026-03-29 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08eadfe0-9686-585b-a307-a4e531045765 with scrape type 2
2026-03-29 18:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08eadfe0-9686-585b-a307-a4e531045765, identifier: XS38036
2026-03-29 18:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08eadfe0-9686-585b-a307-a4e531045765 with identifier: XS38036
2026-03-29 18:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08eadfe0-9686-585b-a307-a4e531045765 with identifier: XS38036
2026-03-29 18:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08eadfe0-9686-585b-a307-a4e531045765 with identifier: XS38036 to the API
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:49:11Z',
'fuel_type': 'petrol',
'id': '08eadfe0-9686-585b-a307-a4e531045765',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS38036',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 228189,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-21',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 CGI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2011}
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS38036%27 HTTP/1.1" 200 None
2026-03-29 18:34:19 [auto1.de] INFO: Saving data for XS38036: {'auction_closing_time': 1774885751.0, 'created_time': 1774636260.873739, 'last_price_update_time': 1774809259.052237}
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS38036') HTTP/1.1" 204 0
2026-03-29 18:34:19 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-29 18:34:19 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV99753%27 HTTP/1.1" 200 None
2026-03-29 18:34:19 [auto1.de] INFO: Scrape type for RV99753: 2
2026-03-29 18:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with identifier: RV99753
2026-03-29 18:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with scrape type 2
2026-03-29 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with scrape type 2
2026-03-29 18:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe, identifier: RV99753
2026-03-29 18:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with identifier: RV99753
2026-03-29 18:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with identifier: RV99753
2026-03-29 18:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with identifier: RV99753 to the API
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:29:45Z',
'fuel_type': 'petrol',
'id': 'fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV99753',
'listing': 'auction',
'make': 'Infiniti',
'model': 'QX70',
'odometer': 164895,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-17',
'seller_name': None,
'title': 'Infiniti QX70 3.7 V6 S Design',
'transmission': 'automatic',
'trim': 'S Design',
'year': 2017}
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV99753%27 HTTP/1.1" 200 None
2026-03-29 18:34:19 [auto1.de] INFO: Saving data for RV99753: {'auction_closing_time': 1774884585.0, 'created_time': 1774294730.078686, 'last_price_update_time': 1774809259.535094}
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV99753') HTTP/1.1" 204 0
2026-03-29 18:34:19 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-29 18:34:19 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-29 18:34:19 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB94614%27 HTTP/1.1" 200 None
2026-03-29 18:34:19 [auto1.de] INFO: Scrape type for MB94614: 2
2026-03-29 18:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da1032f9-30d9-5536-8bf8-dd10bd336f3e with identifier: MB94614
2026-03-29 18:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da1032f9-30d9-5536-8bf8-dd10bd336f3e with scrape type 2
2026-03-29 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da1032f9-30d9-5536-8bf8-dd10bd336f3e with scrape type 2
2026-03-29 18:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da1032f9-30d9-5536-8bf8-dd10bd336f3e, identifier: MB94614
2026-03-29 18:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da1032f9-30d9-5536-8bf8-dd10bd336f3e with identifier: MB94614
2026-03-29 18:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da1032f9-30d9-5536-8bf8-dd10bd336f3e with identifier: MB94614
2026-03-29 18:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da1032f9-30d9-5536-8bf8-dd10bd336f3e with identifier: MB94614 to the API
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:14:09Z',
'fuel_type': 'petrol',
'id': 'da1032f9-30d9-5536-8bf8-dd10bd336f3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB94614',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 173801,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-26',
'seller_name': None,
'title': "Kia cee'd 1.4 Edition 7 Emotion",
'transmission': 'manual',
'trim': 'Edition 7 Emotion',
'year': 2018}
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB94614%27 HTTP/1.1" 200 None
2026-03-29 18:34:19 [auto1.de] INFO: Saving data for MB94614: {'auction_closing_time': 1774883649.0, 'created_time': 1774607883.928163, 'last_price_update_time': 1774809259.967126}
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB94614') HTTP/1.1" 204 0
2026-03-29 18:34:20 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-29 18:34:20 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-29 18:34:20 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00101%27 HTTP/1.1" 200 None
2026-03-29 18:34:20 [auto1.de] INFO: Scrape type for DT00101: 2
2026-03-29 18:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e298936f-6237-5bd3-a868-667fc475401e with identifier: DT00101
2026-03-29 18:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e298936f-6237-5bd3-a868-667fc475401e with scrape type 2
2026-03-29 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e298936f-6237-5bd3-a868-667fc475401e with scrape type 2
2026-03-29 18:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e298936f-6237-5bd3-a868-667fc475401e, identifier: DT00101
2026-03-29 18:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e298936f-6237-5bd3-a868-667fc475401e with identifier: DT00101
2026-03-29 18:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e298936f-6237-5bd3-a868-667fc475401e with identifier: DT00101
2026-03-29 18:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e298936f-6237-5bd3-a868-667fc475401e with identifier: DT00101 to the API
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:21:54Z',
'fuel_type': 'diesel',
'id': 'e298936f-6237-5bd3-a868-667fc475401e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT00101',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 305343,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-07',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.6 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2009}
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00101%27 HTTP/1.1" 200 None
2026-03-29 18:34:20 [auto1.de] INFO: Saving data for DT00101: {'auction_closing_time': 1774884114.0, 'created_time': 1774522463.452967, 'last_price_update_time': 1774809260.464754}
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT00101') HTTP/1.1" 204 0
2026-03-29 18:34:20 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-29 18:34:20 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-29 18:34:20 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55483%27 HTTP/1.1" 200 None
2026-03-29 18:34:20 [auto1.de] INFO: Scrape type for HS55483: 2
2026-03-29 18:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27e2b035-b70f-558c-9af8-265d21cb9619 with identifier: HS55483
2026-03-29 18:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27e2b035-b70f-558c-9af8-265d21cb9619 with scrape type 2
2026-03-29 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27e2b035-b70f-558c-9af8-265d21cb9619 with scrape type 2
2026-03-29 18:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27e2b035-b70f-558c-9af8-265d21cb9619, identifier: HS55483
2026-03-29 18:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27e2b035-b70f-558c-9af8-265d21cb9619 with identifier: HS55483
2026-03-29 18:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27e2b035-b70f-558c-9af8-265d21cb9619 with identifier: HS55483
2026-03-29 18:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27e2b035-b70f-558c-9af8-265d21cb9619 with identifier: HS55483 to the API
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:55:26Z',
'fuel_type': 'petrol',
'id': '27e2b035-b70f-558c-9af8-265d21cb9619',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS55483',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 68336,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-30',
'seller_name': None,
'title': 'Opel Mokka X 1.4 Turbo Active Start/Stop 4x4',
'transmission': 'manual',
'trim': 'Active Start/Stop 4x4',
'year': 2017}
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55483%27 HTTP/1.1" 200 None
2026-03-29 18:34:20 [auto1.de] INFO: Saving data for HS55483: {'auction_closing_time': 1774886126.0, 'created_time': 1773137666.962019, 'last_price_update_time': 1774809260.933404}
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS55483') HTTP/1.1" 204 0
2026-03-29 18:34:20 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-29 18:34:20 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-29 18:34:20 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP02166%27 HTTP/1.1" 200 None
2026-03-29 18:34:20 [auto1.de] INFO: Scrape type for VP02166: 0
2026-03-29 18:34:20 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26855%27 HTTP/1.1" 200 None
2026-03-29 18:34:20 [auto1.de] INFO: Scrape type for CR26855: 0
2026-03-29 18:34:20 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-29 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02307%27 HTTP/1.1" 200 None
2026-03-29 18:34:21 [auto1.de] INFO: Scrape type for BR02307: 0
2026-03-29 18:34:21 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-29 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF30572%27 HTTP/1.1" 200 None
2026-03-29 18:34:21 [auto1.de] INFO: Scrape type for DF30572: 2
2026-03-29 18:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dd48c03-6923-57f2-a307-4afd38fb7625 with identifier: DF30572
2026-03-29 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dd48c03-6923-57f2-a307-4afd38fb7625 with scrape type 2
2026-03-29 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dd48c03-6923-57f2-a307-4afd38fb7625 with scrape type 2
2026-03-29 18:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7dd48c03-6923-57f2-a307-4afd38fb7625, identifier: DF30572
2026-03-29 18:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:34:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7dd48c03-6923-57f2-a307-4afd38fb7625 with identifier: DF30572
2026-03-29 18:34:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7dd48c03-6923-57f2-a307-4afd38fb7625 with identifier: DF30572
2026-03-29 18:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7dd48c03-6923-57f2-a307-4afd38fb7625 with identifier: DF30572 to the API
2026-03-29 18:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:13:32Z',
'fuel_type': 'petrol',
'id': '7dd48c03-6923-57f2-a307-4afd38fb7625',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF30572',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 79824,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-11',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Lounge BlueMotion Tech',
'transmission': 'manual',
'trim': 'Lounge BlueMotion Tech',
'year': 2016}
2026-03-29 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF30572%27 HTTP/1.1" 200 None
2026-03-29 18:34:21 [auto1.de] INFO: Saving data for DF30572: {'auction_closing_time': 1774883612.0, 'created_time': 1774607819.527943, 'last_price_update_time': 1774809261.463663}
2026-03-29 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF30572') HTTP/1.1" 204 0
2026-03-29 18:34:21 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-29 18:34:21 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-29 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ17742%27 HTTP/1.1" 200 None
2026-03-29 18:34:21 [auto1.de] INFO: Scrape type for PJ17742: 0
2026-03-29 18:34:21 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-29 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK97856%27 HTTP/1.1" 200 None
2026-03-29 18:34:21 [auto1.de] INFO: Scrape type for FK97856: 2
2026-03-29 18:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d6e9f46-25bd-5649-84d0-89374332d38e with identifier: FK97856
2026-03-29 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d6e9f46-25bd-5649-84d0-89374332d38e with scrape type 2
2026-03-29 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d6e9f46-25bd-5649-84d0-89374332d38e with scrape type 2
2026-03-29 18:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d6e9f46-25bd-5649-84d0-89374332d38e, identifier: FK97856
2026-03-29 18:34:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d6e9f46-25bd-5649-84d0-89374332d38e with identifier: FK97856
2026-03-29 18:34:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d6e9f46-25bd-5649-84d0-89374332d38e with identifier: FK97856
2026-03-29 18:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d6e9f46-25bd-5649-84d0-89374332d38e with identifier: FK97856 to the API
2026-03-29 18:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:35:49Z',
'fuel_type': 'petrol',
'id': '4d6e9f46-25bd-5649-84d0-89374332d38e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK97856',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 102102,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-23',
'seller_name': None,
'title': 'Hyundai i10 1.2 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2008}
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK97856%27 HTTP/1.1" 200 None
2026-03-29 18:34:22 [auto1.de] INFO: Saving data for FK97856: {'auction_closing_time': 1774884949.0, 'created_time': 1773772242.563258, 'last_price_update_time': 1774809262.039705}
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK97856') HTTP/1.1" 204 0
2026-03-29 18:34:22 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS09713%27 HTTP/1.1" 200 None
2026-03-29 18:34:22 [auto1.de] INFO: Scrape type for RS09713: 2
2026-03-29 18:34:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b663b392-0663-54b6-8251-3d2b61c84cf3 with identifier: RS09713
2026-03-29 18:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b663b392-0663-54b6-8251-3d2b61c84cf3 with scrape type 2
2026-03-29 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b663b392-0663-54b6-8251-3d2b61c84cf3 with scrape type 2
2026-03-29 18:34:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b663b392-0663-54b6-8251-3d2b61c84cf3, identifier: RS09713
2026-03-29 18:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b663b392-0663-54b6-8251-3d2b61c84cf3 with identifier: RS09713
2026-03-29 18:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b663b392-0663-54b6-8251-3d2b61c84cf3 with identifier: RS09713
2026-03-29 18:34:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b663b392-0663-54b6-8251-3d2b61c84cf3 with identifier: RS09713 to the API
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 158,
'expiration_date': '2026-03-30T15:54:11Z',
'fuel_type': 'petrol',
'id': 'b663b392-0663-54b6-8251-3d2b61c84cf3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS09713',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 125133,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-24',
'seller_name': None,
'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid N-Connecta',
'transmission': 'automatic',
'trim': 'N-Connecta',
'year': 2023}
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS09713%27 HTTP/1.1" 200 None
2026-03-29 18:34:22 [auto1.de] INFO: Saving data for RS09713: {'auction_closing_time': 1774886051.0, 'created_time': 1773467346.031209, 'last_price_update_time': 1774809262.447841}
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS09713') HTTP/1.1" 204 0
2026-03-29 18:34:22 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 6740 | hits on page: 40
2026-03-29 18:34:22 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB89503%27 HTTP/1.1" 200 None
2026-03-29 18:34:22 [auto1.de] INFO: Scrape type for RB89503: 0
2026-03-29 18:34:22 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-29 18:34:22 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-29 18:34:22 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN99222%27 HTTP/1.1" 200 None
2026-03-29 18:34:22 [auto1.de] INFO: Scrape type for JN99222: 0
2026-03-29 18:34:22 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE35464%27 HTTP/1.1" 200 None
2026-03-29 18:34:22 [auto1.de] INFO: Scrape type for HE35464: 0
2026-03-29 18:34:22 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH93549%27 HTTP/1.1" 200 None
2026-03-29 18:34:22 [auto1.de] INFO: Scrape type for GH93549: 2
2026-03-29 18:34:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a with identifier: GH93549
2026-03-29 18:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a with scrape type 2
2026-03-29 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a with scrape type 2
2026-03-29 18:34:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a, identifier: GH93549
2026-03-29 18:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a with identifier: GH93549
2026-03-29 18:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a with identifier: GH93549
2026-03-29 18:34:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a with identifier: GH93549 to the API
2026-03-29 18:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:52:27Z',
'fuel_type': 'petrol',
'id': 'b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH93549',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 106907,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-08',
'seller_name': None,
'title': 'Opel Astra 1.4 SIDI Turbo Dynamic Start/Stop',
'transmission': 'manual',
'trim': 'Dynamic Start/Stop',
'year': 2017}
2026-03-29 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH93549%27 HTTP/1.1" 200 None
2026-03-29 18:34:23 [auto1.de] INFO: Saving data for GH93549: {'auction_closing_time': 1774885947.0, 'created_time': 1774636280.722115, 'last_price_update_time': 1774809263.513589}
2026-03-29 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH93549') HTTP/1.1" 204 0
2026-03-29 18:34:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:34:23 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-29 18:34:23 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-29 18:34:23 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-29 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF02739%27 HTTP/1.1" 200 None
2026-03-29 18:34:23 [auto1.de] INFO: Scrape type for DF02739: 2
2026-03-29 18:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03e7aab2-1b46-5b00-be64-a7c586119507 with identifier: DF02739
2026-03-29 18:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03e7aab2-1b46-5b00-be64-a7c586119507 with scrape type 2
2026-03-29 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03e7aab2-1b46-5b00-be64-a7c586119507 with scrape type 2
2026-03-29 18:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03e7aab2-1b46-5b00-be64-a7c586119507, identifier: DF02739
2026-03-29 18:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03e7aab2-1b46-5b00-be64-a7c586119507 with identifier: DF02739
2026-03-29 18:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03e7aab2-1b46-5b00-be64-a7c586119507 with identifier: DF02739
2026-03-29 18:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03e7aab2-1b46-5b00-be64-a7c586119507 with identifier: DF02739 to the API
2026-03-29 18:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:16:53Z',
'fuel_type': 'petrol',
'id': '03e7aab2-1b46-5b00-be64-a7c586119507',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF02739',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 123565,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-04-23',
'seller_name': None,
'title': 'Audi A4 2.0 TFSI',
'transmission': 'automatic',
'trim': '',
'year': 2007}
2026-03-29 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF02739%27 HTTP/1.1" 200 None
2026-03-29 18:34:23 [auto1.de] INFO: Saving data for DF02739: {'auction_closing_time': 1774883813.0, 'created_time': 1774608236.569037, 'last_price_update_time': 1774809263.963697}
2026-03-29 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF02739') HTTP/1.1" 204 0
2026-03-29 18:34:24 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-29 18:34:24 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL06528%27 HTTP/1.1" 200 None
2026-03-29 18:34:24 [auto1.de] INFO: Scrape type for CL06528: 0
2026-03-29 18:34:24 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-29 18:34:24 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK94352%27 HTTP/1.1" 200 None
2026-03-29 18:34:24 [auto1.de] INFO: Scrape type for VK94352: 2
2026-03-29 18:34:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e055a0-8411-5982-bca5-5beda9459b16 with identifier: VK94352
2026-03-29 18:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e055a0-8411-5982-bca5-5beda9459b16 with scrape type 2
2026-03-29 18:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4e055a0-8411-5982-bca5-5beda9459b16 with scrape type 2
2026-03-29 18:34:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4e055a0-8411-5982-bca5-5beda9459b16, identifier: VK94352
2026-03-29 18:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4e055a0-8411-5982-bca5-5beda9459b16 with identifier: VK94352
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-29 18:34:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4e055a0-8411-5982-bca5-5beda9459b16 with identifier: VK94352
2026-03-29 18:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4e055a0-8411-5982-bca5-5beda9459b16 with identifier: VK94352 to the API
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:58:39Z',
'fuel_type': 'petrol',
'id': 'b4e055a0-8411-5982-bca5-5beda9459b16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK94352',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 175315,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-06',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Advance BlueMotion Tech',
'transmission': 'manual',
'trim': 'Advance BlueMotion Tech',
'year': 2018}
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK94352%27 HTTP/1.1" 200 None
2026-03-29 18:34:24 [auto1.de] INFO: Saving data for VK94352: {'auction_closing_time': 1774886319.0, 'created_time': 1774521670.370403, 'last_price_update_time': 1774809264.69005}
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK94352') HTTP/1.1" 204 0
2026-03-29 18:34:24 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-29 18:34:24 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-29 18:34:24 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81277%27 HTTP/1.1" 200 None
2026-03-29 18:34:24 [auto1.de] INFO: Scrape type for YS81277: 0
2026-03-29 18:34:24 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-29 18:34:24 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-29 18:34:24 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-29 18:34:24 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-29 18:34:24 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC38867%27 HTTP/1.1" 200 None
2026-03-29 18:34:24 [auto1.de] INFO: Scrape type for UC38867: 0
2026-03-29 18:34:24 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-29 18:34:24 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61225%27 HTTP/1.1" 200 None
2026-03-29 18:34:24 [auto1.de] INFO: Scrape type for HH61225: 2
2026-03-29 18:34:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with identifier: HH61225
2026-03-29 18:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with scrape type 2
2026-03-29 18:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with scrape type 2
2026-03-29 18:34:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23ab9583-c06e-5ff2-a854-fb39b6a05c87, identifier: HH61225
2026-03-29 18:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with identifier: HH61225
2026-03-29 18:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with identifier: HH61225
2026-03-29 18:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with identifier: HH61225 to the API
2026-03-29 18:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:42Z',
'fuel_type': 'petrol',
'id': '23ab9583-c06e-5ff2-a854-fb39b6a05c87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH61225',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 70204,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-12-11',
'seller_name': None,
'title': 'Toyota RAV 4 2.0 Special 4x4',
'transmission': 'manual',
'trim': 'Special 4x4',
'year': 2002}
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61225%27 HTTP/1.1" 200 None
2026-03-29 18:34:26 [auto1.de] INFO: Saving data for HH61225: {'auction_closing_time': 1774883022.0, 'created_time': 1773305128.605758, 'last_price_update_time': 1774809266.029202}
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH61225') HTTP/1.1" 204 0
2026-03-29 18:34:26 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-29 18:34:26 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF83806%27 HTTP/1.1" 200 None
2026-03-29 18:34:26 [auto1.de] INFO: Scrape type for VF83806: 2
2026-03-29 18:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe0ab5d1-9d66-5491-a417-b1c4ee15209c with identifier: VF83806
2026-03-29 18:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0ab5d1-9d66-5491-a417-b1c4ee15209c with scrape type 2
2026-03-29 18:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe0ab5d1-9d66-5491-a417-b1c4ee15209c with scrape type 2
2026-03-29 18:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe0ab5d1-9d66-5491-a417-b1c4ee15209c, identifier: VF83806
2026-03-29 18:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe0ab5d1-9d66-5491-a417-b1c4ee15209c with identifier: VF83806
2026-03-29 18:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe0ab5d1-9d66-5491-a417-b1c4ee15209c with identifier: VF83806
2026-03-29 18:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe0ab5d1-9d66-5491-a417-b1c4ee15209c with identifier: VF83806 to the API
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:34:18Z',
'fuel_type': 'diesel',
'id': 'fe0ab5d1-9d66-5491-a417-b1c4ee15209c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF83806',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 178140,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-10',
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 TDI Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2011}
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF83806%27 HTTP/1.1" 200 None
2026-03-29 18:34:26 [auto1.de] INFO: Saving data for VF83806: {'auction_closing_time': 1774884858.0, 'created_time': 1774607765.447724, 'last_price_update_time': 1774809266.557999}
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF83806') HTTP/1.1" 204 0
2026-03-29 18:34:26 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-29 18:34:26 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-29 18:34:26 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-29 18:34:26 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG33672%27 HTTP/1.1" 200 None
2026-03-29 18:34:26 [auto1.de] INFO: Scrape type for TG33672: 0
2026-03-29 18:34:26 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR64586%27 HTTP/1.1" 200 None
2026-03-29 18:34:26 [auto1.de] INFO: Scrape type for NR64586: 2
2026-03-29 18:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with identifier: NR64586
2026-03-29 18:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with scrape type 2
2026-03-29 18:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with scrape type 2
2026-03-29 18:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9, identifier: NR64586
2026-03-29 18:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with identifier: NR64586
2026-03-29 18:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with identifier: NR64586
2026-03-29 18:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with identifier: NR64586 to the API
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 239,
'expiration_date': '2026-03-30T15:01:14Z',
'fuel_type': 'diesel',
'id': '56f36d76-2d8c-5eb9-96ca-6e0a9656daf9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR64586',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 104861,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-26',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 BiTDI RS 4x4',
'transmission': 'automatic',
'trim': 'RS 4x4',
'year': 2019}
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR64586%27 HTTP/1.1" 200 None
2026-03-29 18:34:27 [auto1.de] INFO: Saving data for NR64586: {'auction_closing_time': 1774882874.0, 'created_time': 1773340269.764206, 'last_price_update_time': 1774809267.026942}
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR64586') HTTP/1.1" 204 0
2026-03-29 18:34:27 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-29 18:34:27 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-29 18:34:27 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW30112%27 HTTP/1.1" 200 None
2026-03-29 18:34:27 [auto1.de] INFO: Scrape type for FW30112: 0
2026-03-29 18:34:27 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11605%27 HTTP/1.1" 200 None
2026-03-29 18:34:27 [auto1.de] INFO: Scrape type for GC11605: 2
2026-03-29 18:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac8f110e-2aeb-5776-b8ef-84644a035c1d with identifier: GC11605
2026-03-29 18:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac8f110e-2aeb-5776-b8ef-84644a035c1d with scrape type 2
2026-03-29 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac8f110e-2aeb-5776-b8ef-84644a035c1d with scrape type 2
2026-03-29 18:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac8f110e-2aeb-5776-b8ef-84644a035c1d, identifier: GC11605
2026-03-29 18:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac8f110e-2aeb-5776-b8ef-84644a035c1d with identifier: GC11605
2026-03-29 18:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac8f110e-2aeb-5776-b8ef-84644a035c1d with identifier: GC11605
2026-03-29 18:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac8f110e-2aeb-5776-b8ef-84644a035c1d with identifier: GC11605 to the API
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:17:22Z',
'fuel_type': 'petrol',
'id': 'ac8f110e-2aeb-5776-b8ef-84644a035c1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC11605',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 123599,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-01',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 T AMG Line',
'transmission': 'automatic',
'trim': 'T AMG Line',
'year': 2017}
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11605%27 HTTP/1.1" 200 None
2026-03-29 18:34:27 [auto1.de] INFO: Saving data for GC11605: {'auction_closing_time': 1774883842.0, 'created_time': 1773399283.621278, 'last_price_update_time': 1774809267.46324}
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC11605') HTTP/1.1" 204 0
2026-03-29 18:34:27 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-29 18:34:27 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM53272%27 HTTP/1.1" 200 None
2026-03-29 18:34:27 [auto1.de] INFO: Scrape type for FM53272: 0
2026-03-29 18:34:27 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL70410%27 HTTP/1.1" 200 None
2026-03-29 18:34:27 [auto1.de] INFO: Scrape type for UL70410: 2
2026-03-29 18:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8108484-dca2-5f28-a753-328ff9449450 with identifier: UL70410
2026-03-29 18:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8108484-dca2-5f28-a753-328ff9449450 with scrape type 2
2026-03-29 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8108484-dca2-5f28-a753-328ff9449450 with scrape type 2
2026-03-29 18:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8108484-dca2-5f28-a753-328ff9449450, identifier: UL70410
2026-03-29 18:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8108484-dca2-5f28-a753-328ff9449450 with identifier: UL70410
2026-03-29 18:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8108484-dca2-5f28-a753-328ff9449450 with identifier: UL70410
2026-03-29 18:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8108484-dca2-5f28-a753-328ff9449450 with identifier: UL70410 to the API
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:45Z',
'fuel_type': 'petrol',
'id': 'd8108484-dca2-5f28-a753-328ff9449450',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL70410',
'listing': 'auction',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 37200,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-03',
'seller_name': None,
'title': 'Seat Tarraco 1.5 TSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2023}
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL70410%27 HTTP/1.1" 200 None
2026-03-29 18:34:28 [auto1.de] INFO: Saving data for UL70410: {'auction_closing_time': 1774885605.0, 'created_time': 1773661899.48174, 'last_price_update_time': 1774809268.0732}
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL70410') HTTP/1.1" 204 0
2026-03-29 18:34:28 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-29 18:34:28 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-29 18:34:28 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-29 18:34:28 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB72145%27 HTTP/1.1" 200 None
2026-03-29 18:34:28 [auto1.de] INFO: Scrape type for HB72145: 0
2026-03-29 18:34:28 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-29 18:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:34:28 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 6740 | hits on page: 40
2026-03-29 18:34:28 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-29 18:34:28 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-29 18:34:28 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL41666%27 HTTP/1.1" 200 None
2026-03-29 18:34:28 [auto1.de] INFO: Scrape type for UL41666: 0
2026-03-29 18:34:28 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-29 18:34:28 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB33579%27 HTTP/1.1" 200 None
2026-03-29 18:34:28 [auto1.de] INFO: Scrape type for EB33579: 2
2026-03-29 18:34:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 192ff80f-f22b-5e01-a34f-c6f43f215114 with identifier: EB33579
2026-03-29 18:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 192ff80f-f22b-5e01-a34f-c6f43f215114 with scrape type 2
2026-03-29 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 192ff80f-f22b-5e01-a34f-c6f43f215114 with scrape type 2
2026-03-29 18:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 192ff80f-f22b-5e01-a34f-c6f43f215114, identifier: EB33579
2026-03-29 18:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 192ff80f-f22b-5e01-a34f-c6f43f215114 with identifier: EB33579
2026-03-29 18:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 192ff80f-f22b-5e01-a34f-c6f43f215114 with identifier: EB33579
2026-03-29 18:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 192ff80f-f22b-5e01-a34f-c6f43f215114 with identifier: EB33579 to the API
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:29:56Z',
'fuel_type': 'diesel',
'id': '192ff80f-f22b-5e01-a34f-c6f43f215114',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB33579',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 California',
'odometer': 93778,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-24',
'seller_name': None,
'title': 'Volkswagen T6 California 2.0 TDI Ocean FWD',
'transmission': 'automatic',
'trim': 'Ocean FWD',
'year': 2021}
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB33579%27 HTTP/1.1" 200 None
2026-03-29 18:34:28 [auto1.de] INFO: Saving data for EB33579: {'auction_closing_time': 1774884596.0, 'created_time': 1773340378.96919, 'last_price_update_time': 1774809268.691774}
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB33579') HTTP/1.1" 204 0
2026-03-29 18:34:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:34:28 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL23601%27 HTTP/1.1" 200 None
2026-03-29 18:34:28 [auto1.de] INFO: Scrape type for RL23601: 0
2026-03-29 18:34:28 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ81937%27 HTTP/1.1" 200 None
2026-03-29 18:34:28 [auto1.de] INFO: Scrape type for UZ81937: 0
2026-03-29 18:34:28 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ05535%27 HTTP/1.1" 200 None
2026-03-29 18:34:28 [auto1.de] INFO: Scrape type for AZ05535: 0
2026-03-29 18:34:28 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW36097%27 HTTP/1.1" 200 None
2026-03-29 18:34:28 [auto1.de] INFO: Scrape type for DW36097: 2
2026-03-29 18:34:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a281040-da86-50a7-815d-0e5fff86f0fb with identifier: DW36097
2026-03-29 18:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a281040-da86-50a7-815d-0e5fff86f0fb with scrape type 2
2026-03-29 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a281040-da86-50a7-815d-0e5fff86f0fb with scrape type 2
2026-03-29 18:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a281040-da86-50a7-815d-0e5fff86f0fb, identifier: DW36097
2026-03-29 18:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a281040-da86-50a7-815d-0e5fff86f0fb with identifier: DW36097
2026-03-29 18:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a281040-da86-50a7-815d-0e5fff86f0fb with identifier: DW36097
2026-03-29 18:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a281040-da86-50a7-815d-0e5fff86f0fb with identifier: DW36097 to the API
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:14:01Z',
'fuel_type': 'petrol',
'id': '5a281040-da86-50a7-815d-0e5fff86f0fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW36097',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 101639,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-06',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Brabus style',
'transmission': 'automatic',
'trim': 'Brabus style',
'year': 2019}
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW36097%27 HTTP/1.1" 200 None
2026-03-29 18:34:29 [auto1.de] INFO: Saving data for DW36097: {'auction_closing_time': 1774883641.0, 'created_time': 1774349500.350283, 'last_price_update_time': 1774809269.254}
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW36097') HTTP/1.1" 204 0
2026-03-29 18:34:29 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-29 18:34:29 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-29 18:34:29 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-29 18:34:29 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC22222%27 HTTP/1.1" 200 None
2026-03-29 18:34:29 [auto1.de] INFO: Scrape type for MC22222: 2
2026-03-29 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdfd7a21-c40a-50cb-a4a4-af9de3993814 with identifier: MC22222
2026-03-29 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdfd7a21-c40a-50cb-a4a4-af9de3993814 with scrape type 2
2026-03-29 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdfd7a21-c40a-50cb-a4a4-af9de3993814 with scrape type 2
2026-03-29 18:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdfd7a21-c40a-50cb-a4a4-af9de3993814, identifier: MC22222
2026-03-29 18:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdfd7a21-c40a-50cb-a4a4-af9de3993814 with identifier: MC22222
2026-03-29 18:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdfd7a21-c40a-50cb-a4a4-af9de3993814 with identifier: MC22222
2026-03-29 18:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdfd7a21-c40a-50cb-a4a4-af9de3993814 with identifier: MC22222 to the API
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:07:09Z',
'fuel_type': 'petrol',
'id': 'bdfd7a21-c40a-50cb-a4a4-af9de3993814',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC22222',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 118272,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-06-29',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 170 Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2005}
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC22222%27 HTTP/1.1" 200 None
2026-03-29 18:34:29 [auto1.de] INFO: Saving data for MC22222: {'auction_closing_time': 1774883229.0, 'created_time': 1773830931.305584, 'last_price_update_time': 1774809269.748449}
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC22222') HTTP/1.1" 204 0
2026-03-29 18:34:29 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-29 18:34:29 [auto1.de] INFO: Found listing with ID: UB34830
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB34830%27 HTTP/1.1" 200 None
2026-03-29 18:34:29 [auto1.de] INFO: Scrape type for UB34830: 2
2026-03-29 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc5625e-acc6-58d6-a85c-f70607b7c495 with identifier: UB34830
2026-03-29 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc5625e-acc6-58d6-a85c-f70607b7c495 with scrape type 2
2026-03-29 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bc5625e-acc6-58d6-a85c-f70607b7c495 with scrape type 2
2026-03-29 18:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bc5625e-acc6-58d6-a85c-f70607b7c495, identifier: UB34830
2026-03-29 18:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bc5625e-acc6-58d6-a85c-f70607b7c495 with identifier: UB34830
2026-03-29 18:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bc5625e-acc6-58d6-a85c-f70607b7c495 with identifier: UB34830
2026-03-29 18:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bc5625e-acc6-58d6-a85c-f70607b7c495 with identifier: UB34830 to the API
2026-03-29 18:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 305,
'expiration_date': '2026-03-30T15:52:40Z',
'fuel_type': 'diesel',
'id': '2bc5625e-acc6-58d6-a85c-f70607b7c495',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB34830',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 254765,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-08',
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 420 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2006}
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB34830%27 HTTP/1.1" 200 None
2026-03-29 18:34:30 [auto1.de] INFO: Saving data for UB34830: {'auction_closing_time': 1774885960.0, 'created_time': 1773467361.926633, 'last_price_update_time': 1774809270.167714}
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB34830') HTTP/1.1" 204 0
2026-03-29 18:34:30 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF48046%27 HTTP/1.1" 200 None
2026-03-29 18:34:30 [auto1.de] INFO: Scrape type for YF48046: 0
2026-03-29 18:34:30 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-29 18:34:30 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-29 18:34:30 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH94786%27 HTTP/1.1" 200 None
2026-03-29 18:34:30 [auto1.de] INFO: Scrape type for FH94786: 0
2026-03-29 18:34:30 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH13363%27 HTTP/1.1" 200 None
2026-03-29 18:34:30 [auto1.de] INFO: Scrape type for DH13363: 2
2026-03-29 18:34:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f6be045-35c8-5181-bff7-9484fde1cc59 with identifier: DH13363
2026-03-29 18:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f6be045-35c8-5181-bff7-9484fde1cc59 with scrape type 2
2026-03-29 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f6be045-35c8-5181-bff7-9484fde1cc59 with scrape type 2
2026-03-29 18:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f6be045-35c8-5181-bff7-9484fde1cc59, identifier: DH13363
2026-03-29 18:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f6be045-35c8-5181-bff7-9484fde1cc59 with identifier: DH13363
2026-03-29 18:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f6be045-35c8-5181-bff7-9484fde1cc59 with identifier: DH13363
2026-03-29 18:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f6be045-35c8-5181-bff7-9484fde1cc59 with identifier: DH13363 to the API
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 394,
'expiration_date': '2026-03-30T15:13:31Z',
'fuel_type': 'hybrid',
'id': '9f6be045-35c8-5181-bff7-9484fde1cc59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH13363',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 86712,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-07',
'seller_name': None,
'title': 'BMW 5er 545e xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2020}
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH13363%27 HTTP/1.1" 200 None
2026-03-29 18:34:30 [auto1.de] INFO: Saving data for DH13363: {'auction_closing_time': 1774883611.0, 'created_time': 1772541914.691906, 'last_price_update_time': 1774809270.675898}
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH13363') HTTP/1.1" 204 0
2026-03-29 18:34:30 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-29 18:34:30 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX26949%27 HTTP/1.1" 200 None
2026-03-29 18:34:30 [auto1.de] INFO: Scrape type for KX26949: 0
2026-03-29 18:34:30 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN18911%27 HTTP/1.1" 200 None
2026-03-29 18:34:30 [auto1.de] INFO: Scrape type for RN18911: 2
2026-03-29 18:34:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with identifier: RN18911
2026-03-29 18:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with scrape type 2
2026-03-29 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with scrape type 2
2026-03-29 18:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae062b62-3809-5d5f-af3d-9fdbc9a3fa07, identifier: RN18911
2026-03-29 18:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with identifier: RN18911
2026-03-29 18:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with identifier: RN18911
2026-03-29 18:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with identifier: RN18911 to the API
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:25:18Z',
'fuel_type': 'petrol',
'id': 'ae062b62-3809-5d5f-af3d-9fdbc9a3fa07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN18911',
'listing': 'auction',
'make': 'Honda',
'model': 'CR-V',
'odometer': 187175,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-25',
'seller_name': None,
'title': 'Honda CR-V 2.0 VTEC Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2009}
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN18911%27 HTTP/1.1" 200 None
2026-03-29 18:34:31 [auto1.de] INFO: Saving data for RN18911: {'auction_closing_time': 1774884318.0, 'created_time': 1774607769.543703, 'last_price_update_time': 1774809271.425341}
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN18911') HTTP/1.1" 204 0
2026-03-29 18:34:31 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-29 18:34:31 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-29 18:34:31 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-29 18:34:31 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW82123%27 HTTP/1.1" 200 None
2026-03-29 18:34:31 [auto1.de] INFO: Scrape type for VW82123: 2
2026-03-29 18:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed0903ec-f813-5d44-879b-644bcd7995e1 with identifier: VW82123
2026-03-29 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed0903ec-f813-5d44-879b-644bcd7995e1 with scrape type 2
2026-03-29 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed0903ec-f813-5d44-879b-644bcd7995e1 with scrape type 2
2026-03-29 18:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed0903ec-f813-5d44-879b-644bcd7995e1, identifier: VW82123
2026-03-29 18:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed0903ec-f813-5d44-879b-644bcd7995e1 with identifier: VW82123
2026-03-29 18:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed0903ec-f813-5d44-879b-644bcd7995e1 with identifier: VW82123
2026-03-29 18:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed0903ec-f813-5d44-879b-644bcd7995e1 with identifier: VW82123 to the API
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:01:47Z',
'fuel_type': 'diesel',
'id': 'ed0903ec-f813-5d44-879b-644bcd7995e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW82123',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 117396,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-29',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 CDI Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2015}
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW82123%27 HTTP/1.1" 200 None
2026-03-29 18:34:31 [auto1.de] INFO: Saving data for VW82123: {'auction_closing_time': 1774882907.0, 'created_time': 1773830887.628403, 'last_price_update_time': 1774809271.920572}
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW82123') HTTP/1.1" 204 0
2026-03-29 18:34:31 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-29 18:34:31 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-29 18:34:31 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-29 18:34:31 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ95706%27 HTTP/1.1" 200 None
2026-03-29 18:34:31 [auto1.de] INFO: Scrape type for JJ95706: 2
2026-03-29 18:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 792a383f-5ada-5cad-aff3-20fca48a9ef3 with identifier: JJ95706
2026-03-29 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 792a383f-5ada-5cad-aff3-20fca48a9ef3 with scrape type 2
2026-03-29 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 792a383f-5ada-5cad-aff3-20fca48a9ef3 with scrape type 2
2026-03-29 18:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 792a383f-5ada-5cad-aff3-20fca48a9ef3, identifier: JJ95706
2026-03-29 18:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 792a383f-5ada-5cad-aff3-20fca48a9ef3 with identifier: JJ95706
2026-03-29 18:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 792a383f-5ada-5cad-aff3-20fca48a9ef3 with identifier: JJ95706
2026-03-29 18:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 792a383f-5ada-5cad-aff3-20fca48a9ef3 with identifier: JJ95706 to the API
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:30:10Z',
'fuel_type': 'petrol',
'id': '792a383f-5ada-5cad-aff3-20fca48a9ef3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ95706',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 134490,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-28',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI ACT FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2016}
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ95706%27 HTTP/1.1" 200 None
2026-03-29 18:34:32 [auto1.de] INFO: Saving data for JJ95706: {'auction_closing_time': 1774884610.0, 'created_time': 1773306242.316934, 'last_price_update_time': 1774809272.403322}
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ95706') HTTP/1.1" 204 0
2026-03-29 18:34:32 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD89889%27 HTTP/1.1" 200 None
2026-03-29 18:34:32 [auto1.de] INFO: Scrape type for DD89889: 2
2026-03-29 18:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ed6afe-0712-5583-a823-4a52200bdc65 with identifier: DD89889
2026-03-29 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ed6afe-0712-5583-a823-4a52200bdc65 with scrape type 2
2026-03-29 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08ed6afe-0712-5583-a823-4a52200bdc65 with scrape type 2
2026-03-29 18:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08ed6afe-0712-5583-a823-4a52200bdc65, identifier: DD89889
2026-03-29 18:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08ed6afe-0712-5583-a823-4a52200bdc65 with identifier: DD89889
2026-03-29 18:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08ed6afe-0712-5583-a823-4a52200bdc65 with identifier: DD89889
2026-03-29 18:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08ed6afe-0712-5583-a823-4a52200bdc65 with identifier: DD89889 to the API
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:32:53Z',
'fuel_type': 'diesel',
'id': '08ed6afe-0712-5583-a823-4a52200bdc65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD89889',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 130421,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-04',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 250 d lang BlueTEC Edition',
'transmission': 'automatic',
'trim': 'lang BlueTEC Edition',
'year': 2018}
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD89889%27 HTTP/1.1" 200 None
2026-03-29 18:34:32 [auto1.de] INFO: Saving data for DD89889: {'auction_closing_time': 1774884773.0, 'created_time': 1773428106.334032, 'last_price_update_time': 1774809272.959252}
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD89889') HTTP/1.1" 204 0
2026-03-29 18:34:32 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT74985%27 HTTP/1.1" 200 None
2026-03-29 18:34:32 [auto1.de] INFO: Scrape type for CT74985: 0
2026-03-29 18:34:32 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-29 18:34:32 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-29 18:34:32 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-29 18:34:32 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-29 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA36533%27 HTTP/1.1" 200 None
2026-03-29 18:34:33 [auto1.de] INFO: Scrape type for UA36533: 2
2026-03-29 18:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 262afb25-414d-5fd8-999f-a8f3c67e93a3 with identifier: UA36533
2026-03-29 18:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 262afb25-414d-5fd8-999f-a8f3c67e93a3 with scrape type 2
2026-03-29 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 262afb25-414d-5fd8-999f-a8f3c67e93a3 with scrape type 2
2026-03-29 18:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 262afb25-414d-5fd8-999f-a8f3c67e93a3, identifier: UA36533
2026-03-29 18:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 262afb25-414d-5fd8-999f-a8f3c67e93a3 with identifier: UA36533
2026-03-29 18:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 262afb25-414d-5fd8-999f-a8f3c67e93a3 with identifier: UA36533
2026-03-29 18:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 262afb25-414d-5fd8-999f-a8f3c67e93a3 with identifier: UA36533 to the API
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:07:20Z',
'fuel_type': 'diesel',
'id': '262afb25-414d-5fd8-999f-a8f3c67e93a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA36533',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 155935,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-29',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Laurin & Klement 4x4',
'transmission': 'automatic',
'trim': 'Laurin & Klement 4x4',
'year': 2015}
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA36533%27 HTTP/1.1" 200 None
2026-03-29 18:34:33 [auto1.de] INFO: Saving data for UA36533: {'auction_closing_time': 1774883240.0, 'created_time': 1774522610.008199, 'last_price_update_time': 1774809273.377347}
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA36533') HTTP/1.1" 204 0
2026-03-29 18:34:33 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX51342%27 HTTP/1.1" 200 None
2026-03-29 18:34:33 [auto1.de] INFO: Scrape type for AX51342: 2
2026-03-29 18:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05173537-eda3-5b76-9666-74ea991d2f44 with identifier: AX51342
2026-03-29 18:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05173537-eda3-5b76-9666-74ea991d2f44 with scrape type 2
2026-03-29 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05173537-eda3-5b76-9666-74ea991d2f44 with scrape type 2
2026-03-29 18:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05173537-eda3-5b76-9666-74ea991d2f44, identifier: AX51342
2026-03-29 18:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05173537-eda3-5b76-9666-74ea991d2f44 with identifier: AX51342
2026-03-29 18:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05173537-eda3-5b76-9666-74ea991d2f44 with identifier: AX51342
2026-03-29 18:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05173537-eda3-5b76-9666-74ea991d2f44 with identifier: AX51342 to the API
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:28:35Z',
'fuel_type': 'petrol',
'id': '05173537-eda3-5b76-9666-74ea991d2f44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX51342',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 130502,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-09-28',
'seller_name': None,
'title': 'Opel Corsa 1.4 Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2006}
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX51342%27 HTTP/1.1" 200 None
2026-03-29 18:34:33 [auto1.de] INFO: Saving data for AX51342: {'auction_closing_time': 1774884515.0, 'created_time': 1774607700.087076, 'last_price_update_time': 1774809273.833683}
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX51342') HTTP/1.1" 204 0
2026-03-29 18:34:33 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-29 18:34:33 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ71992%27 HTTP/1.1" 200 None
2026-03-29 18:34:33 [auto1.de] INFO: Scrape type for YJ71992: 2
2026-03-29 18:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e075a32-3f89-5397-83f9-ea619d98c775 with identifier: YJ71992
2026-03-29 18:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e075a32-3f89-5397-83f9-ea619d98c775 with scrape type 2
2026-03-29 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e075a32-3f89-5397-83f9-ea619d98c775 with scrape type 2
2026-03-29 18:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e075a32-3f89-5397-83f9-ea619d98c775, identifier: YJ71992
2026-03-29 18:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e075a32-3f89-5397-83f9-ea619d98c775 with identifier: YJ71992
2026-03-29 18:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e075a32-3f89-5397-83f9-ea619d98c775 with identifier: YJ71992
2026-03-29 18:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e075a32-3f89-5397-83f9-ea619d98c775 with identifier: YJ71992 to the API
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:44:07Z',
'fuel_type': 'petrol',
'id': '6e075a32-3f89-5397-83f9-ea619d98c775',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ71992',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 98553,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-27',
'seller_name': None,
'title': 'Hyundai i20 1.0 TGDI Passion blue',
'transmission': 'manual',
'trim': 'Passion blue',
'year': 2017}
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ71992%27 HTTP/1.1" 200 None
2026-03-29 18:34:34 [auto1.de] INFO: Saving data for YJ71992: {'auction_closing_time': 1774885447.0, 'created_time': 1773399081.076848, 'last_price_update_time': 1774809274.310681}
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ71992') HTTP/1.1" 204 0
2026-03-29 18:34:34 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 6740 | hits on page: 40
2026-03-29 18:34:34 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG56142%27 HTTP/1.1" 200 None
2026-03-29 18:34:34 [auto1.de] INFO: Scrape type for SG56142: 0
2026-03-29 18:34:34 [auto1.de] INFO: Found listing with ID: XN70423
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN70423%27 HTTP/1.1" 200 None
2026-03-29 18:34:34 [auto1.de] INFO: Scrape type for XN70423: 2
2026-03-29 18:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4611e11-93ac-5b5c-8a86-b0634b25d7d6 with identifier: XN70423
2026-03-29 18:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4611e11-93ac-5b5c-8a86-b0634b25d7d6 with scrape type 2
2026-03-29 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4611e11-93ac-5b5c-8a86-b0634b25d7d6 with scrape type 2
2026-03-29 18:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4611e11-93ac-5b5c-8a86-b0634b25d7d6, identifier: XN70423
2026-03-29 18:34:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4611e11-93ac-5b5c-8a86-b0634b25d7d6 with identifier: XN70423
2026-03-29 18:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4611e11-93ac-5b5c-8a86-b0634b25d7d6 with identifier: XN70423
2026-03-29 18:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4611e11-93ac-5b5c-8a86-b0634b25d7d6 with identifier: XN70423 to the API
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:31:14Z',
'fuel_type': 'petrol',
'id': 'd4611e11-93ac-5b5c-8a86-b0634b25d7d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN70423',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 87255,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-29',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2019}
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN70423%27 HTTP/1.1" 200 None
2026-03-29 18:34:34 [auto1.de] INFO: Saving data for XN70423: {'auction_closing_time': 1774884674.0, 'created_time': 1774034339.346719, 'last_price_update_time': 1774809274.745577}
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN70423') HTTP/1.1" 204 0
2026-03-29 18:34:34 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB82704%27 HTTP/1.1" 200 None
2026-03-29 18:34:34 [auto1.de] INFO: Scrape type for TB82704: 0
2026-03-29 18:34:34 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC56914%27 HTTP/1.1" 200 None
2026-03-29 18:34:34 [auto1.de] INFO: Scrape type for JC56914: 2
2026-03-29 18:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9f453b0-4262-5a01-94f8-04a0d80dbf06 with identifier: JC56914
2026-03-29 18:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9f453b0-4262-5a01-94f8-04a0d80dbf06 with scrape type 2
2026-03-29 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9f453b0-4262-5a01-94f8-04a0d80dbf06 with scrape type 2
2026-03-29 18:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9f453b0-4262-5a01-94f8-04a0d80dbf06, identifier: JC56914
2026-03-29 18:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9f453b0-4262-5a01-94f8-04a0d80dbf06 with identifier: JC56914
2026-03-29 18:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9f453b0-4262-5a01-94f8-04a0d80dbf06 with identifier: JC56914
2026-03-29 18:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9f453b0-4262-5a01-94f8-04a0d80dbf06 with identifier: JC56914 to the API
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:39:04Z',
'fuel_type': 'diesel',
'id': 'c9f453b0-4262-5a01-94f8-04a0d80dbf06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC56914',
'listing': 'auction',
'make': 'Audi',
'model': 'A6 Allroad',
'odometer': 223190,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-17',
'seller_name': None,
'title': 'Audi A6 Allroad 3.0 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC56914%27 HTTP/1.1" 200 None
2026-03-29 18:34:35 [auto1.de] INFO: Saving data for JC56914: {'auction_closing_time': 1774885144.0, 'created_time': 1774262880.570923, 'last_price_update_time': 1774809275.301544}
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC56914') HTTP/1.1" 204 0
2026-03-29 18:34:35 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG55778%27 HTTP/1.1" 200 None
2026-03-29 18:34:35 [auto1.de] INFO: Scrape type for VG55778: 0
2026-03-29 18:34:35 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA09921%27 HTTP/1.1" 200 None
2026-03-29 18:34:35 [auto1.de] INFO: Scrape type for PA09921: 2
2026-03-29 18:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edc5bd95-1f13-56e0-b9ef-ea3be09829ac with identifier: PA09921
2026-03-29 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edc5bd95-1f13-56e0-b9ef-ea3be09829ac with scrape type 2
2026-03-29 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edc5bd95-1f13-56e0-b9ef-ea3be09829ac with scrape type 2
2026-03-29 18:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edc5bd95-1f13-56e0-b9ef-ea3be09829ac, identifier: PA09921
2026-03-29 18:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edc5bd95-1f13-56e0-b9ef-ea3be09829ac with identifier: PA09921
2026-03-29 18:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edc5bd95-1f13-56e0-b9ef-ea3be09829ac with identifier: PA09921
2026-03-29 18:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edc5bd95-1f13-56e0-b9ef-ea3be09829ac with identifier: PA09921 to the API
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:09:49Z',
'fuel_type': 'diesel',
'id': 'edc5bd95-1f13-56e0-b9ef-ea3be09829ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA09921',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 171760,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-19',
'seller_name': None,
'title': 'BMW 3er 320d GT M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA09921%27 HTTP/1.1" 200 None
2026-03-29 18:34:35 [auto1.de] INFO: Saving data for PA09921: {'auction_closing_time': 1774883389.0, 'created_time': 1774510237.71743, 'last_price_update_time': 1774809275.783179}
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA09921') HTTP/1.1" 204 0
2026-03-29 18:34:35 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD21016%27 HTTP/1.1" 200 None
2026-03-29 18:34:35 [auto1.de] INFO: Scrape type for LD21016: 2
2026-03-29 18:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 547c35b1-695f-5512-8582-39ff6840a886 with identifier: LD21016
2026-03-29 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 547c35b1-695f-5512-8582-39ff6840a886 with scrape type 2
2026-03-29 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 547c35b1-695f-5512-8582-39ff6840a886 with scrape type 2
2026-03-29 18:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 547c35b1-695f-5512-8582-39ff6840a886, identifier: LD21016
2026-03-29 18:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 547c35b1-695f-5512-8582-39ff6840a886 with identifier: LD21016
2026-03-29 18:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 547c35b1-695f-5512-8582-39ff6840a886 with identifier: LD21016
2026-03-29 18:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 547c35b1-695f-5512-8582-39ff6840a886 with identifier: LD21016 to the API
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:31:37Z',
'fuel_type': 'diesel',
'id': '547c35b1-695f-5512-8582-39ff6840a886',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD21016',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 227356,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-18',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Best of',
'transmission': 'automatic',
'trim': 'Best of',
'year': 2015}
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD21016%27 HTTP/1.1" 200 None
2026-03-29 18:34:36 [auto1.de] INFO: Saving data for LD21016: {'auction_closing_time': 1774884697.0, 'created_time': 1773775532.204878, 'last_price_update_time': 1774809276.231203}
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD21016') HTTP/1.1" 204 0
2026-03-29 18:34:36 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-29 18:34:36 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD73380%27 HTTP/1.1" 200 None
2026-03-29 18:34:36 [auto1.de] INFO: Scrape type for AD73380: 0
2026-03-29 18:34:36 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-29 18:34:36 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-29 18:34:36 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-29 18:34:36 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ57142%27 HTTP/1.1" 200 None
2026-03-29 18:34:36 [auto1.de] INFO: Scrape type for EJ57142: 0
2026-03-29 18:34:36 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-29 18:34:36 [auto1.de] INFO: Found listing with ID: JJ39643
2026-03-29 18:34:36 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC19539%27 HTTP/1.1" 200 None
2026-03-29 18:34:36 [auto1.de] INFO: Scrape type for ZC19539: 0
2026-03-29 18:34:36 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG50189%27 HTTP/1.1" 200 None
2026-03-29 18:34:36 [auto1.de] INFO: Scrape type for FG50189: 2
2026-03-29 18:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 578472b3-85db-559f-8d5f-4c447ffba9ce with identifier: FG50189
2026-03-29 18:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 578472b3-85db-559f-8d5f-4c447ffba9ce with scrape type 2
2026-03-29 18:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 578472b3-85db-559f-8d5f-4c447ffba9ce with scrape type 2
2026-03-29 18:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 578472b3-85db-559f-8d5f-4c447ffba9ce, identifier: FG50189
2026-03-29 18:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 578472b3-85db-559f-8d5f-4c447ffba9ce with identifier: FG50189
2026-03-29 18:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 578472b3-85db-559f-8d5f-4c447ffba9ce with identifier: FG50189
2026-03-29 18:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 578472b3-85db-559f-8d5f-4c447ffba9ce with identifier: FG50189 to the API
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:21:16Z',
'fuel_type': 'petrol',
'id': '578472b3-85db-559f-8d5f-4c447ffba9ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG50189',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Colt',
'odometer': 175984,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-02',
'seller_name': None,
'title': 'Mitsubishi Colt 1.3 Inform',
'transmission': 'manual',
'trim': 'Inform',
'year': 2009}
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG50189%27 HTTP/1.1" 200 None
2026-03-29 18:34:36 [auto1.de] INFO: Saving data for FG50189: {'auction_closing_time': 1774884076.0, 'created_time': 1774521618.098945, 'last_price_update_time': 1774809276.702623}
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG50189') HTTP/1.1" 204 0
2026-03-29 18:34:36 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-29 18:34:36 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-29 18:34:36 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA19141%27 HTTP/1.1" 200 None
2026-03-29 18:34:36 [auto1.de] INFO: Scrape type for ZA19141: 2
2026-03-29 18:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecc60949-4263-55a6-a4eb-d8a0491e92d1 with identifier: ZA19141
2026-03-29 18:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecc60949-4263-55a6-a4eb-d8a0491e92d1 with scrape type 2
2026-03-29 18:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecc60949-4263-55a6-a4eb-d8a0491e92d1 with scrape type 2
2026-03-29 18:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecc60949-4263-55a6-a4eb-d8a0491e92d1, identifier: ZA19141
2026-03-29 18:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecc60949-4263-55a6-a4eb-d8a0491e92d1 with identifier: ZA19141
2026-03-29 18:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecc60949-4263-55a6-a4eb-d8a0491e92d1 with identifier: ZA19141
2026-03-29 18:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecc60949-4263-55a6-a4eb-d8a0491e92d1 with identifier: ZA19141 to the API
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:13:03Z',
'fuel_type': 'petrol',
'id': 'ecc60949-4263-55a6-a4eb-d8a0491e92d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA19141',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 83622,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-15',
'seller_name': None,
'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2020}
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA19141%27 HTTP/1.1" 200 None
2026-03-29 18:34:37 [auto1.de] INFO: Saving data for ZA19141: {'auction_closing_time': 1774883583.0, 'created_time': 1774294492.820083, 'last_price_update_time': 1774809277.261607}
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA19141') HTTP/1.1" 204 0
2026-03-29 18:34:37 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-29 18:34:37 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU60385%27 HTTP/1.1" 200 None
2026-03-29 18:34:37 [auto1.de] INFO: Scrape type for BU60385: 0
2026-03-29 18:34:37 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK35059%27 HTTP/1.1" 200 None
2026-03-29 18:34:37 [auto1.de] INFO: Scrape type for MK35059: 0
2026-03-29 18:34:37 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-29 18:34:37 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-29 18:34:37 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88606%27 HTTP/1.1" 200 None
2026-03-29 18:34:37 [auto1.de] INFO: Scrape type for PY88606: 0
2026-03-29 18:34:37 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ04835%27 HTTP/1.1" 200 None
2026-03-29 18:34:37 [auto1.de] INFO: Scrape type for WJ04835: 0
2026-03-29 18:34:37 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM51620%27 HTTP/1.1" 200 None
2026-03-29 18:34:37 [auto1.de] INFO: Scrape type for VM51620: 0
2026-03-29 18:34:37 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA67695%27 HTTP/1.1" 200 None
2026-03-29 18:34:37 [auto1.de] INFO: Scrape type for EA67695: 0
2026-03-29 18:34:37 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP15297%27 HTTP/1.1" 200 None
2026-03-29 18:34:37 [auto1.de] INFO: Scrape type for GP15297: 0
2026-03-29 18:34:37 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA41049%27 HTTP/1.1" 200 None
2026-03-29 18:34:37 [auto1.de] INFO: Scrape type for MA41049: 0
2026-03-29 18:34:37 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU16541%27 HTTP/1.1" 200 None
2026-03-29 18:34:37 [auto1.de] INFO: Scrape type for BU16541: 0
2026-03-29 18:34:37 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40951%27 HTTP/1.1" 200 None
2026-03-29 18:34:37 [auto1.de] INFO: Scrape type for TX40951: 0
2026-03-29 18:34:37 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV25336%27 HTTP/1.1" 200 None
2026-03-29 18:34:37 [auto1.de] INFO: Scrape type for AV25336: 2
2026-03-29 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7684311f-9023-5752-ad89-ae2b4edace59 with identifier: AV25336
2026-03-29 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7684311f-9023-5752-ad89-ae2b4edace59 with scrape type 2
2026-03-29 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7684311f-9023-5752-ad89-ae2b4edace59 with scrape type 2
2026-03-29 18:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7684311f-9023-5752-ad89-ae2b4edace59, identifier: AV25336
2026-03-29 18:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7684311f-9023-5752-ad89-ae2b4edace59 with identifier: AV25336
2026-03-29 18:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7684311f-9023-5752-ad89-ae2b4edace59 with identifier: AV25336
2026-03-29 18:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7684311f-9023-5752-ad89-ae2b4edace59 with identifier: AV25336 to the API
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:47:09Z',
'fuel_type': 'diesel',
'id': '7684311f-9023-5752-ad89-ae2b4edace59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV25336',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 138703,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-18',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2018}
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV25336%27 HTTP/1.1" 200 None
2026-03-29 18:34:37 [auto1.de] INFO: Saving data for AV25336: {'auction_closing_time': 1774885629.0, 'created_time': 1773468410.629751, 'last_price_update_time': 1774809277.87727}
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV25336') HTTP/1.1" 204 0
2026-03-29 18:34:37 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER78775%27 HTTP/1.1" 200 None
2026-03-29 18:34:38 [auto1.de] INFO: Scrape type for ER78775: 2
2026-03-29 18:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 831a3654-c90d-5d42-87ba-34576e961bd9 with identifier: ER78775
2026-03-29 18:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 831a3654-c90d-5d42-87ba-34576e961bd9 with scrape type 2
2026-03-29 18:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 831a3654-c90d-5d42-87ba-34576e961bd9 with scrape type 2
2026-03-29 18:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 831a3654-c90d-5d42-87ba-34576e961bd9, identifier: ER78775
2026-03-29 18:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 831a3654-c90d-5d42-87ba-34576e961bd9 with identifier: ER78775
2026-03-29 18:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 831a3654-c90d-5d42-87ba-34576e961bd9 with identifier: ER78775
2026-03-29 18:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 831a3654-c90d-5d42-87ba-34576e961bd9 with identifier: ER78775 to the API
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:36:11Z',
'fuel_type': 'diesel',
'id': '831a3654-c90d-5d42-87ba-34576e961bd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER78775',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 200541,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-24',
'seller_name': None,
'title': 'Skoda Fabia 1.6 TDI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2012}
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER78775%27 HTTP/1.1" 200 None
2026-03-29 18:34:38 [auto1.de] INFO: Saving data for ER78775: {'auction_closing_time': 1774884971.0, 'created_time': 1773303078.609264, 'last_price_update_time': 1774809278.473314}
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER78775') HTTP/1.1" 204 0
2026-03-29 18:34:38 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG86685%27 HTTP/1.1" 200 None
2026-03-29 18:34:38 [auto1.de] INFO: Scrape type for BG86685: 0
2026-03-29 18:34:38 [auto1.de] INFO: Found listing with ID: EC81606
2026-03-29 18:34:38 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT09542%27 HTTP/1.1" 200 None
2026-03-29 18:34:38 [auto1.de] INFO: Scrape type for LT09542: 0
2026-03-29 18:34:38 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM25044%27 HTTP/1.1" 200 None
2026-03-29 18:34:38 [auto1.de] INFO: Scrape type for TM25044: 0
2026-03-29 18:34:38 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA66980%27 HTTP/1.1" 200 None
2026-03-29 18:34:38 [auto1.de] INFO: Scrape type for LA66980: 2
2026-03-29 18:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa with identifier: LA66980
2026-03-29 18:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa with scrape type 2
2026-03-29 18:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa with scrape type 2
2026-03-29 18:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa, identifier: LA66980
2026-03-29 18:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa with identifier: LA66980
2026-03-29 18:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa with identifier: LA66980
2026-03-29 18:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa with identifier: LA66980 to the API
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:53:59Z',
'fuel_type': 'diesel',
'id': 'c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA66980',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 206965,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-23',
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
'transmission': 'automatic',
'trim': 'BlueTEC',
'year': 2015}
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA66980%27 HTTP/1.1" 200 None
2026-03-29 18:34:39 [auto1.de] INFO: Saving data for LA66980: {'auction_closing_time': 1774886039.0, 'created_time': 1773467604.651753, 'last_price_update_time': 1774809279.023994}
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA66980') HTTP/1.1" 204 0
2026-03-29 18:34:39 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 6740 | hits on page: 40
2026-03-29 18:34:39 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-29 18:34:39 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-29 18:34:39 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW55395%27 HTTP/1.1" 200 None
2026-03-29 18:34:39 [auto1.de] INFO: Scrape type for ZW55395: 0
2026-03-29 18:34:39 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-29 18:34:39 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-29 18:34:39 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY61993%27 HTTP/1.1" 200 None
2026-03-29 18:34:39 [auto1.de] INFO: Scrape type for VY61993: 2
2026-03-29 18:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15ca00c4-cff3-5e3d-acc7-803f0f43615c with identifier: VY61993
2026-03-29 18:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15ca00c4-cff3-5e3d-acc7-803f0f43615c with scrape type 2
2026-03-29 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15ca00c4-cff3-5e3d-acc7-803f0f43615c with scrape type 2
2026-03-29 18:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15ca00c4-cff3-5e3d-acc7-803f0f43615c, identifier: VY61993
2026-03-29 18:34:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15ca00c4-cff3-5e3d-acc7-803f0f43615c with identifier: VY61993
2026-03-29 18:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15ca00c4-cff3-5e3d-acc7-803f0f43615c with identifier: VY61993
2026-03-29 18:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15ca00c4-cff3-5e3d-acc7-803f0f43615c with identifier: VY61993 to the API
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:05:26Z',
'fuel_type': 'petrol',
'id': '15ca00c4-cff3-5e3d-acc7-803f0f43615c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY61993',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 150703,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-12',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2016}
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY61993%27 HTTP/1.1" 200 None
2026-03-29 18:34:39 [auto1.de] INFO: Saving data for VY61993: {'auction_closing_time': 1774883126.0, 'created_time': 1773860188.656103, 'last_price_update_time': 1774809279.504747}
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY61993') HTTP/1.1" 204 0
2026-03-29 18:34:39 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-29 18:34:39 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-29 18:34:39 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-29 18:34:39 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-29 18:34:39 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-29 18:34:39 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU33695%27 HTTP/1.1" 200 None
2026-03-29 18:34:39 [auto1.de] INFO: Scrape type for MU33695: 2
2026-03-29 18:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d33d2238-88ae-5a7a-85d8-0d819d5ede91 with identifier: MU33695
2026-03-29 18:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d33d2238-88ae-5a7a-85d8-0d819d5ede91 with scrape type 2
2026-03-29 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d33d2238-88ae-5a7a-85d8-0d819d5ede91 with scrape type 2
2026-03-29 18:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d33d2238-88ae-5a7a-85d8-0d819d5ede91, identifier: MU33695
2026-03-29 18:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d33d2238-88ae-5a7a-85d8-0d819d5ede91 with identifier: MU33695
2026-03-29 18:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d33d2238-88ae-5a7a-85d8-0d819d5ede91 with identifier: MU33695
2026-03-29 18:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d33d2238-88ae-5a7a-85d8-0d819d5ede91 with identifier: MU33695 to the API
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:16:11Z',
'fuel_type': 'petrol',
'id': 'd33d2238-88ae-5a7a-85d8-0d819d5ede91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU33695',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 214685,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-10',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2018}
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU33695%27 HTTP/1.1" 200 None
2026-03-29 18:34:40 [auto1.de] INFO: Saving data for MU33695: {'auction_closing_time': 1774883771.0, 'created_time': 1773774702.208202, 'last_price_update_time': 1774809280.089017}
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU33695') HTTP/1.1" 204 0
2026-03-29 18:34:40 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-29 18:34:40 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV04533%27 HTTP/1.1" 200 None
2026-03-29 18:34:40 [auto1.de] INFO: Scrape type for LV04533: 0
2026-03-29 18:34:40 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54097%27 HTTP/1.1" 200 None
2026-03-29 18:34:40 [auto1.de] INFO: Scrape type for HJ54097: 0
2026-03-29 18:34:40 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-29 18:34:40 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10430%27 HTTP/1.1" 200 None
2026-03-29 18:34:40 [auto1.de] INFO: Scrape type for HA10430: 2
2026-03-29 18:34:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dd0e221-f794-59ec-8975-d479bc20b4ff with identifier: HA10430
2026-03-29 18:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dd0e221-f794-59ec-8975-d479bc20b4ff with scrape type 2
2026-03-29 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dd0e221-f794-59ec-8975-d479bc20b4ff with scrape type 2
2026-03-29 18:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dd0e221-f794-59ec-8975-d479bc20b4ff, identifier: HA10430
2026-03-29 18:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dd0e221-f794-59ec-8975-d479bc20b4ff with identifier: HA10430
2026-03-29 18:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dd0e221-f794-59ec-8975-d479bc20b4ff with identifier: HA10430
2026-03-29 18:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dd0e221-f794-59ec-8975-d479bc20b4ff with identifier: HA10430 to the API
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:08:21Z',
'fuel_type': 'petrol',
'id': '4dd0e221-f794-59ec-8975-d479bc20b4ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA10430',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 216830,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-31',
'seller_name': None,
'title': 'Mitsubishi Outlander 2.0 MIVEC Invite ClearTec 4WD',
'transmission': 'automatic',
'trim': 'Invite ClearTec 4WD',
'year': 2014}
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10430%27 HTTP/1.1" 200 None
2026-03-29 18:34:40 [auto1.de] INFO: Saving data for HA10430: {'auction_closing_time': 1774883301.0, 'created_time': 1773342431.988387, 'last_price_update_time': 1774809280.579302}
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA10430') HTTP/1.1" 204 0
2026-03-29 18:34:40 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91957%27 HTTP/1.1" 200 None
2026-03-29 18:34:40 [auto1.de] INFO: Scrape type for RY91957: 2
2026-03-29 18:34:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bad3051-6dc0-5c54-8793-8e98ae8be6fe with identifier: RY91957
2026-03-29 18:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bad3051-6dc0-5c54-8793-8e98ae8be6fe with scrape type 2
2026-03-29 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bad3051-6dc0-5c54-8793-8e98ae8be6fe with scrape type 2
2026-03-29 18:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bad3051-6dc0-5c54-8793-8e98ae8be6fe, identifier: RY91957
2026-03-29 18:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bad3051-6dc0-5c54-8793-8e98ae8be6fe with identifier: RY91957
2026-03-29 18:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bad3051-6dc0-5c54-8793-8e98ae8be6fe with identifier: RY91957
2026-03-29 18:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bad3051-6dc0-5c54-8793-8e98ae8be6fe with identifier: RY91957 to the API
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:24:32Z',
'fuel_type': 'diesel',
'id': '3bad3051-6dc0-5c54-8793-8e98ae8be6fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY91957',
'listing': 'auction',
'make': 'Ford',
'model': 'Ranger',
'odometer': 17013,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-29',
'seller_name': None,
'title': 'Ford Ranger 2.0 TDCi EcoBlue Wildtrak e-4WD Doppelkabine',
'transmission': 'automatic',
'trim': 'Wildtrak e-4WD Doppelkabine',
'year': 2023}
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91957%27 HTTP/1.1" 200 None
2026-03-29 18:34:41 [auto1.de] INFO: Saving data for RY91957: {'auction_closing_time': 1774884272.0, 'created_time': 1774636295.262243, 'last_price_update_time': 1774809281.106745}
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY91957') HTTP/1.1" 204 0
2026-03-29 18:34:41 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-29 18:34:41 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-29 18:34:41 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX24804%27 HTTP/1.1" 200 None
2026-03-29 18:34:41 [auto1.de] INFO: Scrape type for DX24804: 0
2026-03-29 18:34:41 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-29 18:34:41 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG08192%27 HTTP/1.1" 200 None
2026-03-29 18:34:41 [auto1.de] INFO: Scrape type for KG08192: 0
2026-03-29 18:34:41 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-29 18:34:41 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-29 18:34:41 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL07101%27 HTTP/1.1" 200 None
2026-03-29 18:34:41 [auto1.de] INFO: Scrape type for GL07101: 0
2026-03-29 18:34:41 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-29 18:34:41 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-29 18:34:41 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE32041%27 HTTP/1.1" 200 None
2026-03-29 18:34:41 [auto1.de] INFO: Scrape type for TE32041: 2
2026-03-29 18:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39ee2a34-aa5f-551c-8601-a0949aa96fa4 with identifier: TE32041
2026-03-29 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39ee2a34-aa5f-551c-8601-a0949aa96fa4 with scrape type 2
2026-03-29 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39ee2a34-aa5f-551c-8601-a0949aa96fa4 with scrape type 2
2026-03-29 18:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39ee2a34-aa5f-551c-8601-a0949aa96fa4, identifier: TE32041
2026-03-29 18:34:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39ee2a34-aa5f-551c-8601-a0949aa96fa4 with identifier: TE32041
2026-03-29 18:34:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39ee2a34-aa5f-551c-8601-a0949aa96fa4 with identifier: TE32041
2026-03-29 18:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39ee2a34-aa5f-551c-8601-a0949aa96fa4 with identifier: TE32041 to the API
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:59:59Z',
'fuel_type': 'petrol',
'id': '39ee2a34-aa5f-551c-8601-a0949aa96fa4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE32041',
'listing': 'auction',
'make': 'Nissan',
'model': 'Micra',
'odometer': 74299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-26',
'seller_name': None,
'title': 'Nissan Micra 1.2 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2017}
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE32041%27 HTTP/1.1" 200 None
2026-03-29 18:34:41 [auto1.de] INFO: Saving data for TE32041: {'auction_closing_time': 1774886399.0, 'created_time': 1774032633.711144, 'last_price_update_time': 1774809281.566461}
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE32041') HTTP/1.1" 204 0
2026-03-29 18:34:41 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-29 18:34:41 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-29 18:34:41 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX34455%27 HTTP/1.1" 200 None
2026-03-29 18:34:41 [auto1.de] INFO: Scrape type for HX34455: 2
2026-03-29 18:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d65715d4-7f34-5a8b-bd13-a89dca28c524 with identifier: HX34455
2026-03-29 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d65715d4-7f34-5a8b-bd13-a89dca28c524 with scrape type 2
2026-03-29 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d65715d4-7f34-5a8b-bd13-a89dca28c524 with scrape type 2
2026-03-29 18:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d65715d4-7f34-5a8b-bd13-a89dca28c524, identifier: HX34455
2026-03-29 18:34:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d65715d4-7f34-5a8b-bd13-a89dca28c524 with identifier: HX34455
2026-03-29 18:34:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d65715d4-7f34-5a8b-bd13-a89dca28c524 with identifier: HX34455
2026-03-29 18:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d65715d4-7f34-5a8b-bd13-a89dca28c524 with identifier: HX34455 to the API
2026-03-29 18:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:21:20Z',
'fuel_type': 'diesel',
'id': 'd65715d4-7f34-5a8b-bd13-a89dca28c524',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX34455',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 111597,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-12',
'seller_name': None,
'title': 'Ford Focus 1.5 EcoBlue TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2019}
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX34455%27 HTTP/1.1" 200 None
2026-03-29 18:34:42 [auto1.de] INFO: Saving data for HX34455: {'auction_closing_time': 1774884080.0, 'created_time': 1773306638.925378, 'last_price_update_time': 1774809282.122017}
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX34455') HTTP/1.1" 204 0
2026-03-29 18:34:42 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG72803%27 HTTP/1.1" 200 None
2026-03-29 18:34:42 [auto1.de] INFO: Scrape type for YG72803: 0
2026-03-29 18:34:42 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-29 18:34:42 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00306%27 HTTP/1.1" 200 None
2026-03-29 18:34:42 [auto1.de] INFO: Scrape type for HX00306: 2
2026-03-29 18:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e19cd1-bafb-5783-877a-afdf277ea06e with identifier: HX00306
2026-03-29 18:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e19cd1-bafb-5783-877a-afdf277ea06e with scrape type 2
2026-03-29 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45e19cd1-bafb-5783-877a-afdf277ea06e with scrape type 2
2026-03-29 18:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45e19cd1-bafb-5783-877a-afdf277ea06e, identifier: HX00306
2026-03-29 18:34:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45e19cd1-bafb-5783-877a-afdf277ea06e with identifier: HX00306
2026-03-29 18:34:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45e19cd1-bafb-5783-877a-afdf277ea06e with identifier: HX00306
2026-03-29 18:34:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45e19cd1-bafb-5783-877a-afdf277ea06e with identifier: HX00306 to the API
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:12:38Z',
'fuel_type': 'diesel',
'id': '45e19cd1-bafb-5783-877a-afdf277ea06e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX00306',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 355675,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-21',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2010}
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00306%27 HTTP/1.1" 200 None
2026-03-29 18:34:42 [auto1.de] INFO: Saving data for HX00306: {'auction_closing_time': 1774883558.0, 'created_time': 1773687000.774716, 'last_price_update_time': 1774809282.583253}
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX00306') HTTP/1.1" 204 0
2026-03-29 18:34:42 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-29 18:34:42 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR62221%27 HTTP/1.1" 200 None
2026-03-29 18:34:42 [auto1.de] INFO: Scrape type for AR62221: 0
2026-03-29 18:34:42 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-29 18:34:42 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-29 18:34:42 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY90259%27 HTTP/1.1" 200 None
2026-03-29 18:34:42 [auto1.de] INFO: Scrape type for CY90259: 2
2026-03-29 18:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2de58bf4-698d-517a-9c72-9c06f59c3952 with identifier: CY90259
2026-03-29 18:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de58bf4-698d-517a-9c72-9c06f59c3952 with scrape type 2
2026-03-29 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2de58bf4-698d-517a-9c72-9c06f59c3952 with scrape type 2
2026-03-29 18:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2de58bf4-698d-517a-9c72-9c06f59c3952, identifier: CY90259
2026-03-29 18:34:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2de58bf4-698d-517a-9c72-9c06f59c3952 with identifier: CY90259
2026-03-29 18:34:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2de58bf4-698d-517a-9c72-9c06f59c3952 with identifier: CY90259
2026-03-29 18:34:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2de58bf4-698d-517a-9c72-9c06f59c3952 with identifier: CY90259 to the API
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:56:02Z',
'fuel_type': 'diesel',
'id': '2de58bf4-698d-517a-9c72-9c06f59c3952',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY90259',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 105578,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-22',
'seller_name': None,
'title': 'Audi A4 40 TDI advanced',
'transmission': 'automatic',
'trim': 'advanced',
'year': 2020}
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY90259%27 HTTP/1.1" 200 None
2026-03-29 18:34:42 [auto1.de] INFO: Saving data for CY90259: {'auction_closing_time': 1774886162.0, 'created_time': 1774521435.043874, 'last_price_update_time': 1774809282.995393}
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY90259') HTTP/1.1" 204 0
2026-03-29 18:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:34:43 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 6740 | hits on page: 40
2026-03-29 18:34:43 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-29 18:34:43 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY14877%27 HTTP/1.1" 200 None
2026-03-29 18:34:43 [auto1.de] INFO: Scrape type for BY14877: 0
2026-03-29 18:34:43 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV93240%27 HTTP/1.1" 200 None
2026-03-29 18:34:43 [auto1.de] INFO: Scrape type for AV93240: 0
2026-03-29 18:34:43 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-29 18:34:43 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-29 18:34:43 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ09697%27 HTTP/1.1" 200 None
2026-03-29 18:34:43 [auto1.de] INFO: Scrape type for BZ09697: 2
2026-03-29 18:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ef7598-ba83-523c-89e6-32bc73e121d3 with identifier: BZ09697
2026-03-29 18:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ef7598-ba83-523c-89e6-32bc73e121d3 with scrape type 2
2026-03-29 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18ef7598-ba83-523c-89e6-32bc73e121d3 with scrape type 2
2026-03-29 18:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18ef7598-ba83-523c-89e6-32bc73e121d3, identifier: BZ09697
2026-03-29 18:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18ef7598-ba83-523c-89e6-32bc73e121d3 with identifier: BZ09697
2026-03-29 18:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18ef7598-ba83-523c-89e6-32bc73e121d3 with identifier: BZ09697
2026-03-29 18:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18ef7598-ba83-523c-89e6-32bc73e121d3 with identifier: BZ09697 to the API
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:14:13Z',
'fuel_type': 'petrol',
'id': '18ef7598-ba83-523c-89e6-32bc73e121d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ09697',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 113182,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-21',
'seller_name': None,
'title': 'Hyundai i20 1.2 Select',
'transmission': 'manual',
'trim': 'Select',
'year': 2018}
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ09697%27 HTTP/1.1" 200 None
2026-03-29 18:34:43 [auto1.de] INFO: Saving data for BZ09697: {'auction_closing_time': 1774883653.0, 'created_time': 1773860086.480419, 'last_price_update_time': 1774809283.689503}
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ09697') HTTP/1.1" 204 0
2026-03-29 18:34:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:34:43 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-29 18:34:43 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC82813%27 HTTP/1.1" 200 None
2026-03-29 18:34:43 [auto1.de] INFO: Scrape type for GC82813: 2
2026-03-29 18:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 992cb1ee-f75f-53eb-b3d1-04018cb38e3a with identifier: GC82813
2026-03-29 18:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 992cb1ee-f75f-53eb-b3d1-04018cb38e3a with scrape type 2
2026-03-29 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 992cb1ee-f75f-53eb-b3d1-04018cb38e3a with scrape type 2
2026-03-29 18:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 992cb1ee-f75f-53eb-b3d1-04018cb38e3a, identifier: GC82813
2026-03-29 18:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 992cb1ee-f75f-53eb-b3d1-04018cb38e3a with identifier: GC82813
2026-03-29 18:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 992cb1ee-f75f-53eb-b3d1-04018cb38e3a with identifier: GC82813
2026-03-29 18:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 992cb1ee-f75f-53eb-b3d1-04018cb38e3a with identifier: GC82813 to the API
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:43:23Z',
'fuel_type': 'petrol',
'id': '992cb1ee-f75f-53eb-b3d1-04018cb38e3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC82813',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 64001,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-02-24',
'seller_name': None,
'title': 'Toyota RAV 4 2.0 4x4',
'transmission': 'automatic',
'trim': '4x4',
'year': 2005}
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC82813%27 HTTP/1.1" 200 None
2026-03-29 18:34:44 [auto1.de] INFO: Saving data for GC82813: {'auction_closing_time': 1774885403.0, 'created_time': 1773830247.659399, 'last_price_update_time': 1774809284.09667}
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC82813') HTTP/1.1" 204 0
2026-03-29 18:34:44 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL23541%27 HTTP/1.1" 200 None
2026-03-29 18:34:44 [auto1.de] INFO: Scrape type for PL23541: 0
2026-03-29 18:34:44 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-29 18:34:44 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND33880%27 HTTP/1.1" 200 None
2026-03-29 18:34:44 [auto1.de] INFO: Scrape type for ND33880: 2
2026-03-29 18:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95012aec-382b-5018-b1d7-3351a4df06d2 with identifier: ND33880
2026-03-29 18:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95012aec-382b-5018-b1d7-3351a4df06d2 with scrape type 2
2026-03-29 18:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95012aec-382b-5018-b1d7-3351a4df06d2 with scrape type 2
2026-03-29 18:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95012aec-382b-5018-b1d7-3351a4df06d2, identifier: ND33880
2026-03-29 18:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95012aec-382b-5018-b1d7-3351a4df06d2 with identifier: ND33880
2026-03-29 18:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95012aec-382b-5018-b1d7-3351a4df06d2 with identifier: ND33880
2026-03-29 18:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95012aec-382b-5018-b1d7-3351a4df06d2 with identifier: ND33880 to the API
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:42:06Z',
'fuel_type': 'petrol',
'id': '95012aec-382b-5018-b1d7-3351a4df06d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND33880',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 133798,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-15',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Kompressor T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2009}
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND33880%27 HTTP/1.1" 200 None
2026-03-29 18:34:44 [auto1.de] INFO: Saving data for ND33880: {'auction_closing_time': 1774885326.0, 'created_time': 1773687628.022583, 'last_price_update_time': 1774809284.570141}
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND33880') HTTP/1.1" 204 0
2026-03-29 18:34:44 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE28071%27 HTTP/1.1" 200 None
2026-03-29 18:34:44 [auto1.de] INFO: Scrape type for GE28071: 0
2026-03-29 18:34:44 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB26225%27 HTTP/1.1" 200 None
2026-03-29 18:34:44 [auto1.de] INFO: Scrape type for AB26225: 2
2026-03-29 18:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with identifier: AB26225
2026-03-29 18:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with scrape type 2
2026-03-29 18:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with scrape type 2
2026-03-29 18:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33, identifier: AB26225
2026-03-29 18:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with identifier: AB26225
2026-03-29 18:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with identifier: AB26225
2026-03-29 18:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with identifier: AB26225 to the API
2026-03-29 18:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:39:20Z',
'fuel_type': 'diesel',
'id': '63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB26225',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 25742,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-22',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TDI R-Line 4Motion',
'transmission': 'automatic',
'trim': 'R-Line 4Motion',
'year': 2024}
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB26225%27 HTTP/1.1" 200 None
2026-03-29 18:34:45 [auto1.de] INFO: Saving data for AB26225: {'auction_closing_time': 1774885160.0, 'created_time': 1773773960.64453, 'last_price_update_time': 1774809285.17763}
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB26225') HTTP/1.1" 204 0
2026-03-29 18:34:45 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX62858%27 HTTP/1.1" 200 None
2026-03-29 18:34:45 [auto1.de] INFO: Scrape type for FX62858: 0
2026-03-29 18:34:45 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC70285%27 HTTP/1.1" 200 None
2026-03-29 18:34:45 [auto1.de] INFO: Scrape type for SC70285: 2
2026-03-29 18:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bb24ee4-37db-5074-9208-16d3d2d58feb with identifier: SC70285
2026-03-29 18:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bb24ee4-37db-5074-9208-16d3d2d58feb with scrape type 2
2026-03-29 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bb24ee4-37db-5074-9208-16d3d2d58feb with scrape type 2
2026-03-29 18:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bb24ee4-37db-5074-9208-16d3d2d58feb, identifier: SC70285
2026-03-29 18:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bb24ee4-37db-5074-9208-16d3d2d58feb with identifier: SC70285
2026-03-29 18:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bb24ee4-37db-5074-9208-16d3d2d58feb with identifier: SC70285
2026-03-29 18:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bb24ee4-37db-5074-9208-16d3d2d58feb with identifier: SC70285 to the API
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:24:49Z',
'fuel_type': 'diesel',
'id': '3bb24ee4-37db-5074-9208-16d3d2d58feb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC70285',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 273874,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-21',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2011}
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC70285%27 HTTP/1.1" 200 None
2026-03-29 18:34:45 [auto1.de] INFO: Saving data for SC70285: {'auction_closing_time': 1774884289.0, 'created_time': 1773137311.513845, 'last_price_update_time': 1774809285.670165}
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC70285') HTTP/1.1" 204 0
2026-03-29 18:34:45 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-29 18:34:45 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB46016%27 HTTP/1.1" 200 None
2026-03-29 18:34:45 [auto1.de] INFO: Scrape type for XB46016: 0
2026-03-29 18:34:45 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX34768%27 HTTP/1.1" 200 None
2026-03-29 18:34:45 [auto1.de] INFO: Scrape type for BX34768: 0
2026-03-29 18:34:45 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-29 18:34:45 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF74386%27 HTTP/1.1" 200 None
2026-03-29 18:34:45 [auto1.de] INFO: Scrape type for CF74386: 0
2026-03-29 18:34:45 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-29 18:34:45 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-29 18:34:45 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-29 18:34:45 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG17958%27 HTTP/1.1" 200 None
2026-03-29 18:34:45 [auto1.de] INFO: Scrape type for CG17958: 0
2026-03-29 18:34:45 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-29 18:34:45 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-29 18:34:45 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG09102%27 HTTP/1.1" 200 None
2026-03-29 18:34:45 [auto1.de] INFO: Scrape type for FG09102: 2
2026-03-29 18:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 691e4556-610d-5f26-b273-26021a1321f0 with identifier: FG09102
2026-03-29 18:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 691e4556-610d-5f26-b273-26021a1321f0 with scrape type 2
2026-03-29 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 691e4556-610d-5f26-b273-26021a1321f0 with scrape type 2
2026-03-29 18:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 691e4556-610d-5f26-b273-26021a1321f0, identifier: FG09102
2026-03-29 18:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 691e4556-610d-5f26-b273-26021a1321f0 with identifier: FG09102
2026-03-29 18:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 691e4556-610d-5f26-b273-26021a1321f0 with identifier: FG09102
2026-03-29 18:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 691e4556-610d-5f26-b273-26021a1321f0 with identifier: FG09102 to the API
2026-03-29 18:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:58:41Z',
'fuel_type': 'diesel',
'id': '691e4556-610d-5f26-b273-26021a1321f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG09102',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 167170,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-17',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion',
'year': 2008}
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG09102%27 HTTP/1.1" 200 None
2026-03-29 18:34:46 [auto1.de] INFO: Saving data for FG09102: {'auction_closing_time': 1774886321.0, 'created_time': 1774262256.235742, 'last_price_update_time': 1774809286.211232}
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG09102') HTTP/1.1" 204 0
2026-03-29 18:34:46 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF25460%27 HTTP/1.1" 200 None
2026-03-29 18:34:46 [auto1.de] INFO: Scrape type for YF25460: 2
2026-03-29 18:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db0a03e-3685-57f7-b0de-67562b6f97a2 with identifier: YF25460
2026-03-29 18:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db0a03e-3685-57f7-b0de-67562b6f97a2 with scrape type 2
2026-03-29 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db0a03e-3685-57f7-b0de-67562b6f97a2 with scrape type 2
2026-03-29 18:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3db0a03e-3685-57f7-b0de-67562b6f97a2, identifier: YF25460
2026-03-29 18:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3db0a03e-3685-57f7-b0de-67562b6f97a2 with identifier: YF25460
2026-03-29 18:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3db0a03e-3685-57f7-b0de-67562b6f97a2 with identifier: YF25460
2026-03-29 18:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3db0a03e-3685-57f7-b0de-67562b6f97a2 with identifier: YF25460 to the API
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:52:26Z',
'fuel_type': 'petrol',
'id': '3db0a03e-3685-57f7-b0de-67562b6f97a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF25460',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 122225,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-15',
'seller_name': None,
'title': 'Opel Zafira 1.8 Family Plus',
'transmission': 'manual',
'trim': 'Family Plus',
'year': 2012}
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF25460%27 HTTP/1.1" 200 None
2026-03-29 18:34:46 [auto1.de] INFO: Saving data for YF25460: {'auction_closing_time': 1774885946.0, 'created_time': 1773773704.188081, 'last_price_update_time': 1774809286.762342}
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF25460') HTTP/1.1" 204 0
2026-03-29 18:34:46 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-29 18:34:46 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-29 18:34:46 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90255%27 HTTP/1.1" 200 None
2026-03-29 18:34:46 [auto1.de] INFO: Scrape type for KE90255: 2
2026-03-29 18:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 010ebf66-8f9b-5507-b009-10645d8d5d95 with identifier: KE90255
2026-03-29 18:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010ebf66-8f9b-5507-b009-10645d8d5d95 with scrape type 2
2026-03-29 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 010ebf66-8f9b-5507-b009-10645d8d5d95 with scrape type 2
2026-03-29 18:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 010ebf66-8f9b-5507-b009-10645d8d5d95, identifier: KE90255
2026-03-29 18:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 010ebf66-8f9b-5507-b009-10645d8d5d95 with identifier: KE90255
2026-03-29 18:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 010ebf66-8f9b-5507-b009-10645d8d5d95 with identifier: KE90255
2026-03-29 18:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 010ebf66-8f9b-5507-b009-10645d8d5d95 with identifier: KE90255 to the API
2026-03-29 18:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:27:19Z',
'fuel_type': 'petrol',
'id': '010ebf66-8f9b-5507-b009-10645d8d5d95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE90255',
'listing': 'auction',
'make': 'Subaru',
'model': 'Forester',
'odometer': 201062,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-20',
'seller_name': None,
'title': 'Subaru Forester 2.0 Platinum',
'transmission': 'automatic',
'trim': 'Platinum',
'year': 2015}
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90255%27 HTTP/1.1" 200 None
2026-03-29 18:34:47 [auto1.de] INFO: Saving data for KE90255: {'auction_closing_time': 1774884439.0, 'created_time': 1774521639.262795, 'last_price_update_time': 1774809287.163234}
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE90255') HTTP/1.1" 204 0
2026-03-29 18:34:47 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72052%27 HTTP/1.1" 200 None
2026-03-29 18:34:47 [auto1.de] INFO: Scrape type for GJ72052: 0
2026-03-29 18:34:47 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ55573%27 HTTP/1.1" 200 None
2026-03-29 18:34:47 [auto1.de] INFO: Scrape type for KJ55573: 2
2026-03-29 18:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with identifier: KJ55573
2026-03-29 18:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with scrape type 2
2026-03-29 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with scrape type 2
2026-03-29 18:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0, identifier: KJ55573
2026-03-29 18:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with identifier: KJ55573
2026-03-29 18:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with identifier: KJ55573
2026-03-29 18:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with identifier: KJ55573 to the API
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:14:50Z',
'fuel_type': 'diesel',
'id': 'eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ55573',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLK-Klasse',
'odometer': 180448,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-23',
'seller_name': None,
'title': 'Mercedes-Benz GLK-Klasse GLK 200 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ55573%27 HTTP/1.1" 200 None
2026-03-29 18:34:47 [auto1.de] INFO: Saving data for KJ55573: {'auction_closing_time': 1774883690.0, 'created_time': 1774293423.03468, 'last_price_update_time': 1774809287.645775}
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ55573') HTTP/1.1" 204 0
2026-03-29 18:34:47 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK87583%27 HTTP/1.1" 200 None
2026-03-29 18:34:47 [auto1.de] INFO: Scrape type for XK87583: 2
2026-03-29 18:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with identifier: XK87583
2026-03-29 18:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with scrape type 2
2026-03-29 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with scrape type 2
2026-03-29 18:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d, identifier: XK87583
2026-03-29 18:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with identifier: XK87583
2026-03-29 18:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with identifier: XK87583
2026-03-29 18:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with identifier: XK87583 to the API
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:44:43Z',
'fuel_type': 'diesel',
'id': 'ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK87583',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 209117,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-13',
'seller_name': None,
'title': 'BMW 3er 330d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2014}
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK87583%27 HTTP/1.1" 200 None
2026-03-29 18:34:48 [auto1.de] INFO: Saving data for XK87583: {'auction_closing_time': 1774885483.0, 'created_time': 1773775519.798467, 'last_price_update_time': 1774809288.099633}
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK87583') HTTP/1.1" 204 0
2026-03-29 18:34:48 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT25770%27 HTTP/1.1" 200 None
2026-03-29 18:34:48 [auto1.de] INFO: Scrape type for UT25770: 2
2026-03-29 18:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6aa6d5c-3457-51f1-8480-a5784e581506 with identifier: UT25770
2026-03-29 18:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6aa6d5c-3457-51f1-8480-a5784e581506 with scrape type 2
2026-03-29 18:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6aa6d5c-3457-51f1-8480-a5784e581506 with scrape type 2
2026-03-29 18:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6aa6d5c-3457-51f1-8480-a5784e581506, identifier: UT25770
2026-03-29 18:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6aa6d5c-3457-51f1-8480-a5784e581506 with identifier: UT25770
2026-03-29 18:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6aa6d5c-3457-51f1-8480-a5784e581506 with identifier: UT25770
2026-03-29 18:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6aa6d5c-3457-51f1-8480-a5784e581506 with identifier: UT25770 to the API
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:04:17Z',
'fuel_type': 'diesel',
'id': 'd6aa6d5c-3457-51f1-8480-a5784e581506',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT25770',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 111903,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-03',
'seller_name': None,
'title': 'BMW 3er 330d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2017}
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT25770%27 HTTP/1.1" 200 None
2026-03-29 18:34:48 [auto1.de] INFO: Saving data for UT25770: {'auction_closing_time': 1774883057.0, 'created_time': 1774636301.317554, 'last_price_update_time': 1774809288.493442}
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT25770') HTTP/1.1" 204 0
2026-03-29 18:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:34:48 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD46257%27 HTTP/1.1" 200 None
2026-03-29 18:34:48 [auto1.de] INFO: Scrape type for YD46257: 2
2026-03-29 18:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 386cff13-9da0-52da-af4a-50c32cd3b172 with identifier: YD46257
2026-03-29 18:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 386cff13-9da0-52da-af4a-50c32cd3b172 with scrape type 2
2026-03-29 18:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 386cff13-9da0-52da-af4a-50c32cd3b172 with scrape type 2
2026-03-29 18:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 386cff13-9da0-52da-af4a-50c32cd3b172, identifier: YD46257
2026-03-29 18:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 386cff13-9da0-52da-af4a-50c32cd3b172 with identifier: YD46257
2026-03-29 18:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 386cff13-9da0-52da-af4a-50c32cd3b172 with identifier: YD46257
2026-03-29 18:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 386cff13-9da0-52da-af4a-50c32cd3b172 with identifier: YD46257 to the API
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:45:13Z',
'fuel_type': 'petrol',
'id': '386cff13-9da0-52da-af4a-50c32cd3b172',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD46257',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 26632,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-25',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2023}
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD46257%27 HTTP/1.1" 200 None
2026-03-29 18:34:48 [auto1.de] INFO: Saving data for YD46257: {'auction_closing_time': 1774885513.0, 'created_time': 1774521795.939227, 'last_price_update_time': 1774809288.878893}
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD46257') HTTP/1.1" 204 0
2026-03-29 18:34:48 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA14554%27 HTTP/1.1" 200 None
2026-03-29 18:34:48 [auto1.de] INFO: Scrape type for TA14554: 2
2026-03-29 18:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca6367a3-acf5-5416-98e1-5bb9e61bada7 with identifier: TA14554
2026-03-29 18:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca6367a3-acf5-5416-98e1-5bb9e61bada7 with scrape type 2
2026-03-29 18:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca6367a3-acf5-5416-98e1-5bb9e61bada7 with scrape type 2
2026-03-29 18:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca6367a3-acf5-5416-98e1-5bb9e61bada7, identifier: TA14554
2026-03-29 18:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca6367a3-acf5-5416-98e1-5bb9e61bada7 with identifier: TA14554
2026-03-29 18:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca6367a3-acf5-5416-98e1-5bb9e61bada7 with identifier: TA14554
2026-03-29 18:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca6367a3-acf5-5416-98e1-5bb9e61bada7 with identifier: TA14554 to the API
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:04:32Z',
'fuel_type': 'diesel',
'id': 'ca6367a3-acf5-5416-98e1-5bb9e61bada7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA14554',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 152714,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-25',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2015}
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA14554%27 HTTP/1.1" 200 None
2026-03-29 18:34:49 [auto1.de] INFO: Saving data for TA14554: {'auction_closing_time': 1774883072.0, 'created_time': 1774034070.955445, 'last_price_update_time': 1774809289.325313}
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA14554') HTTP/1.1" 204 0
2026-03-29 18:34:49 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 6740 | hits on page: 40
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP89370%27 HTTP/1.1" 200 None
2026-03-29 18:34:49 [auto1.de] INFO: Scrape type for RP89370: 0
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB28845%27 HTTP/1.1" 200 None
2026-03-29 18:34:49 [auto1.de] INFO: Scrape type for DB28845: 0
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG30420%27 HTTP/1.1" 200 None
2026-03-29 18:34:49 [auto1.de] INFO: Scrape type for PG30420: 2
2026-03-29 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b69417ab-3c6b-5403-bb16-59fdad78d7da with identifier: PG30420
2026-03-29 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69417ab-3c6b-5403-bb16-59fdad78d7da with scrape type 2
2026-03-29 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b69417ab-3c6b-5403-bb16-59fdad78d7da with scrape type 2
2026-03-29 18:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b69417ab-3c6b-5403-bb16-59fdad78d7da, identifier: PG30420
2026-03-29 18:34:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b69417ab-3c6b-5403-bb16-59fdad78d7da with identifier: PG30420
2026-03-29 18:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b69417ab-3c6b-5403-bb16-59fdad78d7da with identifier: PG30420
2026-03-29 18:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b69417ab-3c6b-5403-bb16-59fdad78d7da with identifier: PG30420 to the API
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:10:30Z',
'fuel_type': 'petrol',
'id': 'b69417ab-3c6b-5403-bb16-59fdad78d7da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG30420',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 163376,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-30',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2013}
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG30420%27 HTTP/1.1" 200 None
2026-03-29 18:34:49 [auto1.de] INFO: Saving data for PG30420: {'auction_closing_time': 1774883430.0, 'created_time': 1773400605.870425, 'last_price_update_time': 1774809289.807848}
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG30420') HTTP/1.1" 204 0
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX76120%27 HTTP/1.1" 200 None
2026-03-29 18:34:49 [auto1.de] INFO: Scrape type for FX76120: 0
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF84610%27 HTTP/1.1" 200 None
2026-03-29 18:34:49 [auto1.de] INFO: Scrape type for UF84610: 0
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: PV33295
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA07254%27 HTTP/1.1" 200 None
2026-03-29 18:34:49 [auto1.de] INFO: Scrape type for VA07254: 0
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-29 18:34:49 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW39371%27 HTTP/1.1" 200 None
2026-03-29 18:34:49 [auto1.de] INFO: Scrape type for NW39371: 2
2026-03-29 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f22e3e5a-10a3-5421-a506-edf88de556c6 with identifier: NW39371
2026-03-29 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f22e3e5a-10a3-5421-a506-edf88de556c6 with scrape type 2
2026-03-29 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f22e3e5a-10a3-5421-a506-edf88de556c6 with scrape type 2
2026-03-29 18:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f22e3e5a-10a3-5421-a506-edf88de556c6, identifier: NW39371
2026-03-29 18:34:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f22e3e5a-10a3-5421-a506-edf88de556c6 with identifier: NW39371
2026-03-29 18:34:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f22e3e5a-10a3-5421-a506-edf88de556c6 with identifier: NW39371
2026-03-29 18:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f22e3e5a-10a3-5421-a506-edf88de556c6 with identifier: NW39371 to the API
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:46:19Z',
'fuel_type': 'petrol',
'id': 'f22e3e5a-10a3-5421-a506-edf88de556c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW39371',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 389440,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-11',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2009}
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW39371%27 HTTP/1.1" 200 None
2026-03-29 18:34:50 [auto1.de] INFO: Saving data for NW39371: {'auction_closing_time': 1774885579.0, 'created_time': 1773466929.653275, 'last_price_update_time': 1774809290.38225}
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW39371') HTTP/1.1" 204 0
2026-03-29 18:34:50 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR95231%27 HTTP/1.1" 200 None
2026-03-29 18:34:50 [auto1.de] INFO: Scrape type for BR95231: 2
2026-03-29 18:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03bebd53-3ec3-5991-b70a-5d5cae425a75 with identifier: BR95231
2026-03-29 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03bebd53-3ec3-5991-b70a-5d5cae425a75 with scrape type 2
2026-03-29 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03bebd53-3ec3-5991-b70a-5d5cae425a75 with scrape type 2
2026-03-29 18:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03bebd53-3ec3-5991-b70a-5d5cae425a75, identifier: BR95231
2026-03-29 18:34:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03bebd53-3ec3-5991-b70a-5d5cae425a75 with identifier: BR95231
2026-03-29 18:34:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03bebd53-3ec3-5991-b70a-5d5cae425a75 with identifier: BR95231
2026-03-29 18:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03bebd53-3ec3-5991-b70a-5d5cae425a75 with identifier: BR95231 to the API
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 271,
'expiration_date': '2026-03-30T15:54:26Z',
'fuel_type': 'petrol',
'id': '03bebd53-3ec3-5991-b70a-5d5cae425a75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR95231',
'listing': 'auction',
'make': 'Jeep',
'model': 'Wrangler Unlimited',
'odometer': 69320,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-15',
'seller_name': None,
'title': 'Jeep Wrangler Unlimited 2.0 TGDi Sahara',
'transmission': 'automatic',
'trim': 'Sahara',
'year': 2020}
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR95231%27 HTTP/1.1" 200 None
2026-03-29 18:34:50 [auto1.de] INFO: Saving data for BR95231: {'auction_closing_time': 1774886066.0, 'created_time': 1774292812.641651, 'last_price_update_time': 1774809290.937681}
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR95231') HTTP/1.1" 204 0
2026-03-29 18:34:50 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-29 18:34:50 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-29 18:34:50 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-29 18:34:50 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY42207%27 HTTP/1.1" 200 None
2026-03-29 18:34:50 [auto1.de] INFO: Scrape type for BY42207: 2
2026-03-29 18:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96745c70-3014-551d-951f-3b074df8859f with identifier: BY42207
2026-03-29 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96745c70-3014-551d-951f-3b074df8859f with scrape type 2
2026-03-29 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96745c70-3014-551d-951f-3b074df8859f with scrape type 2
2026-03-29 18:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96745c70-3014-551d-951f-3b074df8859f, identifier: BY42207
2026-03-29 18:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96745c70-3014-551d-951f-3b074df8859f with identifier: BY42207
2026-03-29 18:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96745c70-3014-551d-951f-3b074df8859f with identifier: BY42207
2026-03-29 18:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96745c70-3014-551d-951f-3b074df8859f with identifier: BY42207 to the API
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-30T15:12:20Z',
'fuel_type': 'petrol',
'id': '96745c70-3014-551d-951f-3b074df8859f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY42207',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'ASX',
'odometer': 48787,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-26',
'seller_name': None,
'title': 'Mitsubishi ASX 1.6 Basis 2WD',
'transmission': 'manual',
'trim': 'Basis 2WD',
'year': 2018}
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY42207%27 HTTP/1.1" 200 None
2026-03-29 18:34:51 [auto1.de] INFO: Saving data for BY42207: {'auction_closing_time': 1774883540.0, 'created_time': 1773466963.286455, 'last_price_update_time': 1774809291.360791}
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY42207') HTTP/1.1" 204 0
2026-03-29 18:34:51 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-29 18:34:51 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT60095%27 HTTP/1.1" 200 None
2026-03-29 18:34:51 [auto1.de] INFO: Scrape type for WT60095: 2
2026-03-29 18:34:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97042aa8-c767-5d71-8a41-28072e248773 with identifier: WT60095
2026-03-29 18:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97042aa8-c767-5d71-8a41-28072e248773 with scrape type 2
2026-03-29 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97042aa8-c767-5d71-8a41-28072e248773 with scrape type 2
2026-03-29 18:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97042aa8-c767-5d71-8a41-28072e248773, identifier: WT60095
2026-03-29 18:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97042aa8-c767-5d71-8a41-28072e248773 with identifier: WT60095
2026-03-29 18:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97042aa8-c767-5d71-8a41-28072e248773 with identifier: WT60095
2026-03-29 18:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97042aa8-c767-5d71-8a41-28072e248773 with identifier: WT60095 to the API
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 194,
'expiration_date': '2026-03-30T15:27:20Z',
'fuel_type': 'diesel',
'id': '97042aa8-c767-5d71-8a41-28072e248773',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT60095',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 188024,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-24',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2018}
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT60095%27 HTTP/1.1" 200 None
2026-03-29 18:34:51 [auto1.de] INFO: Saving data for WT60095: {'auction_closing_time': 1774884440.0, 'created_time': 1773687135.837734, 'last_price_update_time': 1774809291.798037}
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT60095') HTTP/1.1" 204 0
2026-03-29 18:34:51 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-29 18:34:51 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-29 18:34:51 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-29 18:34:51 [auto1.de] INFO: Scrape type for ZT20326: 2
2026-03-29 18:34:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afe77dfe-c652-540f-b195-1447fbd1f5cc with identifier: ZT20326
2026-03-29 18:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afe77dfe-c652-540f-b195-1447fbd1f5cc with scrape type 2
2026-03-29 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afe77dfe-c652-540f-b195-1447fbd1f5cc with scrape type 2
2026-03-29 18:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afe77dfe-c652-540f-b195-1447fbd1f5cc, identifier: ZT20326
2026-03-29 18:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afe77dfe-c652-540f-b195-1447fbd1f5cc with identifier: ZT20326
2026-03-29 18:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afe77dfe-c652-540f-b195-1447fbd1f5cc with identifier: ZT20326
2026-03-29 18:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afe77dfe-c652-540f-b195-1447fbd1f5cc with identifier: ZT20326 to the API
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:38:23Z',
'fuel_type': 'petrol',
'id': 'afe77dfe-c652-540f-b195-1447fbd1f5cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT20326',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'up!',
'odometer': 75169,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-05',
'seller_name': None,
'title': 'Volkswagen up! 1.0 Move up! BlueMotion Tech',
'transmission': 'manual',
'trim': 'Move BlueMotion Tech',
'year': 2014}
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-29 18:34:52 [auto1.de] INFO: Saving data for ZT20326: {'auction_closing_time': 1774885103.0, 'created_time': 1774349331.688643, 'last_price_update_time': 1774809292.27377}
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT20326') HTTP/1.1" 204 0
2026-03-29 18:34:52 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC65519%27 HTTP/1.1" 200 None
2026-03-29 18:34:52 [auto1.de] INFO: Scrape type for NC65519: 2
2026-03-29 18:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1457ace6-b797-5441-a90c-31a7ea8eaed2 with identifier: NC65519
2026-03-29 18:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1457ace6-b797-5441-a90c-31a7ea8eaed2 with scrape type 2
2026-03-29 18:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1457ace6-b797-5441-a90c-31a7ea8eaed2 with scrape type 2
2026-03-29 18:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1457ace6-b797-5441-a90c-31a7ea8eaed2, identifier: NC65519
2026-03-29 18:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1457ace6-b797-5441-a90c-31a7ea8eaed2 with identifier: NC65519
2026-03-29 18:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1457ace6-b797-5441-a90c-31a7ea8eaed2 with identifier: NC65519
2026-03-29 18:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1457ace6-b797-5441-a90c-31a7ea8eaed2 with identifier: NC65519 to the API
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:03:06Z',
'fuel_type': 'petrol',
'id': '1457ace6-b797-5441-a90c-31a7ea8eaed2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC65519',
'listing': 'auction',
'make': 'Nissan',
'model': 'Pulsar',
'odometer': 117681,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-26',
'seller_name': None,
'title': 'Nissan Pulsar 1.6 Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2016}
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC65519%27 HTTP/1.1" 200 None
2026-03-29 18:34:52 [auto1.de] INFO: Saving data for NC65519: {'auction_closing_time': 1774882986.0, 'created_time': 1773308158.323328, 'last_price_update_time': 1774809292.749261}
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC65519') HTTP/1.1" 204 0
2026-03-29 18:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:34:52 [auto1.de] INFO: Found listing with ID: SV25975
2026-03-29 18:34:52 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-29 18:34:52 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20287%27 HTTP/1.1" 200 None
2026-03-29 18:34:52 [auto1.de] INFO: Scrape type for HZ20287: 0
2026-03-29 18:34:52 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-29 18:34:52 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-29 18:34:52 [auto1.de] INFO: Scrape type for MD11027: 2
2026-03-29 18:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f509094e-1301-5c23-87ef-a32a3b69de00 with identifier: MD11027
2026-03-29 18:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f509094e-1301-5c23-87ef-a32a3b69de00 with scrape type 2
2026-03-29 18:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f509094e-1301-5c23-87ef-a32a3b69de00 with scrape type 2
2026-03-29 18:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f509094e-1301-5c23-87ef-a32a3b69de00, identifier: MD11027
2026-03-29 18:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f509094e-1301-5c23-87ef-a32a3b69de00 with identifier: MD11027
2026-03-29 18:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f509094e-1301-5c23-87ef-a32a3b69de00 with identifier: MD11027
2026-03-29 18:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f509094e-1301-5c23-87ef-a32a3b69de00 with identifier: MD11027 to the API
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:55:46Z',
'fuel_type': 'petrol',
'id': 'f509094e-1301-5c23-87ef-a32a3b69de00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD11027',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 117455,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-28',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.8 TSI Highline Aktionsmodell T',
'transmission': 'manual',
'trim': 'Highline Aktionsmodell T',
'year': 2009}
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-29 18:34:53 [auto1.de] INFO: Saving data for MD11027: {'auction_closing_time': 1774886146.0, 'created_time': 1773830356.094439, 'last_price_update_time': 1774809293.304625}
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD11027') HTTP/1.1" 204 0
2026-03-29 18:34:53 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE80218%27 HTTP/1.1" 200 None
2026-03-29 18:34:53 [auto1.de] INFO: Scrape type for VE80218: 0
2026-03-29 18:34:53 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-29 18:34:53 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-29 18:34:53 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU20206%27 HTTP/1.1" 200 None
2026-03-29 18:34:53 [auto1.de] INFO: Scrape type for FU20206: 0
2026-03-29 18:34:53 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT47109%27 HTTP/1.1" 200 None
2026-03-29 18:34:53 [auto1.de] INFO: Scrape type for LT47109: 2
2026-03-29 18:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with identifier: LT47109
2026-03-29 18:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with scrape type 2
2026-03-29 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with scrape type 2
2026-03-29 18:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26c0ac4b-95b8-5a8b-968d-df677fc18d31, identifier: LT47109
2026-03-29 18:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with identifier: LT47109
2026-03-29 18:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with identifier: LT47109
2026-03-29 18:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with identifier: LT47109 to the API
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:38:14Z',
'fuel_type': 'petrol',
'id': '26c0ac4b-95b8-5a8b-968d-df677fc18d31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT47109',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 134954,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-26',
'seller_name': None,
'title': 'Skoda Fabia 1.0 MPI Cool Plus',
'transmission': 'manual',
'trim': 'Cool Plus',
'year': 2018}
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT47109%27 HTTP/1.1" 200 None
2026-03-29 18:34:53 [auto1.de] INFO: Saving data for LT47109: {'auction_closing_time': 1774885094.0, 'created_time': 1773741883.359919, 'last_price_update_time': 1774809293.791473}
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT47109') HTTP/1.1" 204 0
2026-03-29 18:34:53 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 6740 | hits on page: 40
2026-03-29 18:34:53 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT27360%27 HTTP/1.1" 200 None
2026-03-29 18:34:53 [auto1.de] INFO: Scrape type for RT27360: 2
2026-03-29 18:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with identifier: RT27360
2026-03-29 18:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with scrape type 2
2026-03-29 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with scrape type 2
2026-03-29 18:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1053ddd0-2e1c-51ce-aaa8-24d04d06c897, identifier: RT27360
2026-03-29 18:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with identifier: RT27360
2026-03-29 18:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with identifier: RT27360
2026-03-29 18:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with identifier: RT27360 to the API
2026-03-29 18:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:09:33Z',
'fuel_type': 'petrol',
'id': '1053ddd0-2e1c-51ce-aaa8-24d04d06c897',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT27360',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 13951,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-19',
'seller_name': None,
'title': 'Renault Captur 1.3 TCe Mild-Hybrid Evolution',
'transmission': 'automatic',
'trim': 'Evolution',
'year': 2023}
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT27360%27 HTTP/1.1" 200 None
2026-03-29 18:34:55 [auto1.de] INFO: Saving data for RT27360: {'auction_closing_time': 1774883373.0, 'created_time': 1773426998.384676, 'last_price_update_time': 1774809295.075041}
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT27360') HTTP/1.1" 204 0
2026-03-29 18:34:55 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD11713%27 HTTP/1.1" 200 None
2026-03-29 18:34:55 [auto1.de] INFO: Scrape type for XD11713: 2
2026-03-29 18:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71a0007e-82fc-524f-8c93-a1303c8d44ec with identifier: XD11713
2026-03-29 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71a0007e-82fc-524f-8c93-a1303c8d44ec with scrape type 2
2026-03-29 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71a0007e-82fc-524f-8c93-a1303c8d44ec with scrape type 2
2026-03-29 18:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71a0007e-82fc-524f-8c93-a1303c8d44ec, identifier: XD11713
2026-03-29 18:34:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:34:55 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH04581%27 HTTP/1.1" 200 None
2026-03-29 18:34:55 [auto1.de] INFO: Scrape type for RH04581: 0
2026-03-29 18:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71a0007e-82fc-524f-8c93-a1303c8d44ec with identifier: XD11713
2026-03-29 18:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71a0007e-82fc-524f-8c93-a1303c8d44ec with identifier: XD11713
2026-03-29 18:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71a0007e-82fc-524f-8c93-a1303c8d44ec with identifier: XD11713 to the API
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:08:25Z',
'fuel_type': 'diesel',
'id': '71a0007e-82fc-524f-8c93-a1303c8d44ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD11713',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 264567,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-09',
'seller_name': None,
'title': 'Volvo XC90 2.4 D5 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2025}
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD11713%27 HTTP/1.1" 200 None
2026-03-29 18:34:55 [auto1.de] INFO: Saving data for XD11713: {'auction_closing_time': 1774883305.0, 'created_time': 1773302971.43695, 'last_price_update_time': 1774809295.629068}
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD11713') HTTP/1.1" 204 0
2026-03-29 18:34:55 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR62368%27 HTTP/1.1" 200 None
2026-03-29 18:34:55 [auto1.de] INFO: Scrape type for HR62368: 0
2026-03-29 18:34:55 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-29 18:34:55 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-29 18:34:55 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-29 18:34:55 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-29 18:34:55 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-29 18:34:55 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW35011%27 HTTP/1.1" 200 None
2026-03-29 18:34:55 [auto1.de] INFO: Scrape type for NW35011: 2
2026-03-29 18:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with identifier: NW35011
2026-03-29 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with scrape type 2
2026-03-29 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with scrape type 2
2026-03-29 18:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4, identifier: NW35011
2026-03-29 18:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with identifier: NW35011
2026-03-29 18:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with identifier: NW35011
2026-03-29 18:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with identifier: NW35011 to the API
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:09:29Z',
'fuel_type': 'petrol',
'id': '9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW35011',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 165892,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-20',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2014}
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW35011%27 HTTP/1.1" 200 None
2026-03-29 18:34:56 [auto1.de] INFO: Saving data for NW35011: {'auction_closing_time': 1774883369.0, 'created_time': 1773303376.421663, 'last_price_update_time': 1774809296.092285}
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW35011') HTTP/1.1" 204 0
2026-03-29 18:34:56 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34642%27 HTTP/1.1" 200 None
2026-03-29 18:34:56 [auto1.de] INFO: Scrape type for CA34642: 0
2026-03-29 18:34:56 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW84966%27 HTTP/1.1" 200 None
2026-03-29 18:34:56 [auto1.de] INFO: Scrape type for JW84966: 0
2026-03-29 18:34:56 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-29 18:34:56 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-29 18:34:56 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP50374%27 HTTP/1.1" 200 None
2026-03-29 18:34:56 [auto1.de] INFO: Scrape type for RP50374: 2
2026-03-29 18:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c083207e-7ddf-5cb1-a4f9-d1ad6373808a with identifier: RP50374
2026-03-29 18:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c083207e-7ddf-5cb1-a4f9-d1ad6373808a with scrape type 2
2026-03-29 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c083207e-7ddf-5cb1-a4f9-d1ad6373808a with scrape type 2
2026-03-29 18:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c083207e-7ddf-5cb1-a4f9-d1ad6373808a, identifier: RP50374
2026-03-29 18:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c083207e-7ddf-5cb1-a4f9-d1ad6373808a with identifier: RP50374
2026-03-29 18:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c083207e-7ddf-5cb1-a4f9-d1ad6373808a with identifier: RP50374
2026-03-29 18:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c083207e-7ddf-5cb1-a4f9-d1ad6373808a with identifier: RP50374 to the API
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:20:19Z',
'fuel_type': 'diesel',
'id': 'c083207e-7ddf-5cb1-a4f9-d1ad6373808a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP50374',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 321636,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-30',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2014}
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP50374%27 HTTP/1.1" 200 None
2026-03-29 18:34:56 [auto1.de] INFO: Saving data for RP50374: {'auction_closing_time': 1774884019.0, 'created_time': 1773685901.74374, 'last_price_update_time': 1774809296.564041}
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP50374') HTTP/1.1" 204 0
2026-03-29 18:34:56 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-29 18:34:56 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF78107%27 HTTP/1.1" 200 None
2026-03-29 18:34:56 [auto1.de] INFO: Scrape type for GF78107: 0
2026-03-29 18:34:56 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-29 18:34:56 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG74532%27 HTTP/1.1" 200 None
2026-03-29 18:34:56 [auto1.de] INFO: Scrape type for CG74532: 2
2026-03-29 18:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a58d5979-6367-5f36-826c-2bb8c4b2a739 with identifier: CG74532
2026-03-29 18:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a58d5979-6367-5f36-826c-2bb8c4b2a739 with scrape type 2
2026-03-29 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a58d5979-6367-5f36-826c-2bb8c4b2a739 with scrape type 2
2026-03-29 18:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a58d5979-6367-5f36-826c-2bb8c4b2a739, identifier: CG74532
2026-03-29 18:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a58d5979-6367-5f36-826c-2bb8c4b2a739 with identifier: CG74532
2026-03-29 18:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a58d5979-6367-5f36-826c-2bb8c4b2a739 with identifier: CG74532
2026-03-29 18:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a58d5979-6367-5f36-826c-2bb8c4b2a739 with identifier: CG74532 to the API
2026-03-29 18:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:20:02Z',
'fuel_type': 'diesel',
'id': 'a58d5979-6367-5f36-826c-2bb8c4b2a739',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG74532',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 125978,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-23',
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG74532%27 HTTP/1.1" 200 None
2026-03-29 18:34:57 [auto1.de] INFO: Saving data for CG74532: {'auction_closing_time': 1774884002.0, 'created_time': 1773308375.619079, 'last_price_update_time': 1774809297.18245}
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG74532') HTTP/1.1" 204 0
2026-03-29 18:34:57 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM47095%27 HTTP/1.1" 200 None
2026-03-29 18:34:57 [auto1.de] INFO: Scrape type for SM47095: 2
2026-03-29 18:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f863274d-1687-5436-b2f5-3ca064a057e2 with identifier: SM47095
2026-03-29 18:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f863274d-1687-5436-b2f5-3ca064a057e2 with scrape type 2
2026-03-29 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f863274d-1687-5436-b2f5-3ca064a057e2 with scrape type 2
2026-03-29 18:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f863274d-1687-5436-b2f5-3ca064a057e2, identifier: SM47095
2026-03-29 18:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f863274d-1687-5436-b2f5-3ca064a057e2 with identifier: SM47095
2026-03-29 18:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f863274d-1687-5436-b2f5-3ca064a057e2 with identifier: SM47095
2026-03-29 18:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f863274d-1687-5436-b2f5-3ca064a057e2 with identifier: SM47095 to the API
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:00:23Z',
'fuel_type': 'petrol',
'id': 'f863274d-1687-5436-b2f5-3ca064a057e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM47095',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 131250,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-21',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI ACT FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2016}
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM47095%27 HTTP/1.1" 200 None
2026-03-29 18:34:57 [auto1.de] INFO: Saving data for SM47095: {'auction_closing_time': 1774882823.0, 'created_time': 1774521258.134441, 'last_price_update_time': 1774809297.580224}
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM47095') HTTP/1.1" 204 0
2026-03-29 18:34:57 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD86365%27 HTTP/1.1" 200 None
2026-03-29 18:34:57 [auto1.de] INFO: Scrape type for SD86365: 2
2026-03-29 18:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with identifier: SD86365
2026-03-29 18:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with scrape type 2
2026-03-29 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with scrape type 2
2026-03-29 18:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f, identifier: SD86365
2026-03-29 18:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with identifier: SD86365
2026-03-29 18:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with identifier: SD86365
2026-03-29 18:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with identifier: SD86365 to the API
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:56Z',
'fuel_type': 'petrol',
'id': '823f3697-7e54-5ca7-8bc2-9b9aef41ab8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD86365',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 22707,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-16',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2023}
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD86365%27 HTTP/1.1" 200 None
2026-03-29 18:34:58 [auto1.de] INFO: Saving data for SD86365: {'auction_closing_time': 1774885616.0, 'created_time': 1774607840.816728, 'last_price_update_time': 1774809298.01427}
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD86365') HTTP/1.1" 204 0
2026-03-29 18:34:58 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG31591%27 HTTP/1.1" 200 None
2026-03-29 18:34:58 [auto1.de] INFO: Scrape type for RG31591: 0
2026-03-29 18:34:58 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ48596%27 HTTP/1.1" 200 None
2026-03-29 18:34:58 [auto1.de] INFO: Scrape type for SZ48596: 2
2026-03-29 18:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with identifier: SZ48596
2026-03-29 18:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with scrape type 2
2026-03-29 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with scrape type 2
2026-03-29 18:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1, identifier: SZ48596
2026-03-29 18:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with identifier: SZ48596
2026-03-29 18:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with identifier: SZ48596
2026-03-29 18:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with identifier: SZ48596 to the API
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:22:57Z',
'fuel_type': 'diesel',
'id': '8aca3659-3eeb-5cbe-bc35-caa6efafbfc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ48596',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 118336,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-07',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Cruise FWD',
'transmission': 'automatic',
'trim': 'Cruise FWD',
'year': 2020}
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ48596%27 HTTP/1.1" 200 None
2026-03-29 18:34:58 [auto1.de] INFO: Saving data for SZ48596: {'auction_closing_time': 1774884177.0, 'created_time': 1773304168.733015, 'last_price_update_time': 1774809298.462954}
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ48596') HTTP/1.1" 204 0
2026-03-29 18:34:58 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-29 18:34:58 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-29 18:34:58 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE46941%27 HTTP/1.1" 200 None
2026-03-29 18:34:58 [auto1.de] INFO: Scrape type for YE46941: 2
2026-03-29 18:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d63ba39-de09-516d-95e4-e3885ba51ce3 with identifier: YE46941
2026-03-29 18:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d63ba39-de09-516d-95e4-e3885ba51ce3 with scrape type 2
2026-03-29 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d63ba39-de09-516d-95e4-e3885ba51ce3 with scrape type 2
2026-03-29 18:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d63ba39-de09-516d-95e4-e3885ba51ce3, identifier: YE46941
2026-03-29 18:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d63ba39-de09-516d-95e4-e3885ba51ce3 with identifier: YE46941
2026-03-29 18:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d63ba39-de09-516d-95e4-e3885ba51ce3 with identifier: YE46941
2026-03-29 18:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d63ba39-de09-516d-95e4-e3885ba51ce3 with identifier: YE46941 to the API
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:48:53Z',
'fuel_type': 'diesel',
'id': '6d63ba39-de09-516d-95e4-e3885ba51ce3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE46941',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 129869,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-22',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2016}
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE46941%27 HTTP/1.1" 200 None
2026-03-29 18:34:58 [auto1.de] INFO: Saving data for YE46941: {'auction_closing_time': 1774885733.0, 'created_time': 1773304500.754375, 'last_price_update_time': 1774809298.93613}
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE46941') HTTP/1.1" 204 0
2026-03-29 18:34:59 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-29 18:34:59 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM09546%27 HTTP/1.1" 200 None
2026-03-29 18:34:59 [auto1.de] INFO: Scrape type for WM09546: 2
2026-03-29 18:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 563c1543-2196-5caa-bcd8-61959bb74a5e with identifier: WM09546
2026-03-29 18:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 563c1543-2196-5caa-bcd8-61959bb74a5e with scrape type 2
2026-03-29 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 563c1543-2196-5caa-bcd8-61959bb74a5e with scrape type 2
2026-03-29 18:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 563c1543-2196-5caa-bcd8-61959bb74a5e, identifier: WM09546
2026-03-29 18:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 563c1543-2196-5caa-bcd8-61959bb74a5e with identifier: WM09546
2026-03-29 18:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 563c1543-2196-5caa-bcd8-61959bb74a5e with identifier: WM09546
2026-03-29 18:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 563c1543-2196-5caa-bcd8-61959bb74a5e with identifier: WM09546 to the API
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:22:20Z',
'fuel_type': 'petrol',
'id': '563c1543-2196-5caa-bcd8-61959bb74a5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM09546',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 182200,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-10-31',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.6 FSI Sportline',
'transmission': 'manual',
'trim': 'Sportline',
'year': 2006}
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM09546%27 HTTP/1.1" 200 None
2026-03-29 18:34:59 [auto1.de] INFO: Saving data for WM09546: {'auction_closing_time': 1774884140.0, 'created_time': 1774118848.537404, 'last_price_update_time': 1774809299.453252}
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM09546') HTTP/1.1" 204 0
2026-03-29 18:34:59 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-29 18:34:59 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR11811%27 HTTP/1.1" 200 None
2026-03-29 18:34:59 [auto1.de] INFO: Scrape type for BR11811: 0
2026-03-29 18:34:59 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-29 18:34:59 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ62462%27 HTTP/1.1" 200 None
2026-03-29 18:34:59 [auto1.de] INFO: Scrape type for GJ62462: 0
2026-03-29 18:34:59 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG41390%27 HTTP/1.1" 200 None
2026-03-29 18:34:59 [auto1.de] INFO: Scrape type for WG41390: 0
2026-03-29 18:34:59 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS71504%27 HTTP/1.1" 200 None
2026-03-29 18:34:59 [auto1.de] INFO: Scrape type for DS71504: 2
2026-03-29 18:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a16104c-a989-59e4-a076-4ccb828c94a3 with identifier: DS71504
2026-03-29 18:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a16104c-a989-59e4-a076-4ccb828c94a3 with scrape type 2
2026-03-29 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a16104c-a989-59e4-a076-4ccb828c94a3 with scrape type 2
2026-03-29 18:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a16104c-a989-59e4-a076-4ccb828c94a3, identifier: DS71504
2026-03-29 18:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a16104c-a989-59e4-a076-4ccb828c94a3 with identifier: DS71504
2026-03-29 18:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a16104c-a989-59e4-a076-4ccb828c94a3 with identifier: DS71504
2026-03-29 18:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a16104c-a989-59e4-a076-4ccb828c94a3 with identifier: DS71504 to the API
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:45:18Z',
'fuel_type': 'petrol',
'id': '5a16104c-a989-59e4-a076-4ccb828c94a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS71504',
'listing': 'auction',
'make': 'Jeep',
'model': 'Wrangler Unlimited',
'odometer': 318722,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-30',
'seller_name': None,
'title': 'Jeep Wrangler Unlimited 3.8 V6 Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2009}
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS71504%27 HTTP/1.1" 200 None
2026-03-29 18:34:59 [auto1.de] INFO: Saving data for DS71504: {'auction_closing_time': 1774885518.0, 'created_time': 1773774573.224593, 'last_price_update_time': 1774809299.957456}
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS71504') HTTP/1.1" 204 0
2026-03-29 18:34:59 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-29 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC00063%27 HTTP/1.1" 200 None
2026-03-29 18:35:00 [auto1.de] INFO: Scrape type for SC00063: 0
2026-03-29 18:35:00 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-29 18:35:00 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-29 18:35:00 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY64526%27 HTTP/1.1" 200 None
2026-03-29 18:35:00 [auto1.de] INFO: Scrape type for FY64526: 2
2026-03-29 18:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with identifier: FY64526
2026-03-29 18:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with scrape type 2
2026-03-29 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with scrape type 2
2026-03-29 18:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68d25788-6d5f-503c-a51c-b95d0d8ed2d8, identifier: FY64526
2026-03-29 18:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with identifier: FY64526
2026-03-29 18:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with identifier: FY64526
2026-03-29 18:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with identifier: FY64526 to the API
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-30T15:21:32Z',
'fuel_type': 'diesel',
'id': '68d25788-6d5f-503c-a51c-b95d0d8ed2d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY64526',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 182219,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-30',
'seller_name': None,
'title': 'Peugeot 2008 1.6 e-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY64526%27 HTTP/1.1" 200 None
2026-03-29 18:35:00 [auto1.de] INFO: Saving data for FY64526: {'auction_closing_time': 1774884092.0, 'created_time': 1773917492.14851, 'last_price_update_time': 1774809300.459}
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY64526') HTTP/1.1" 204 0
2026-03-29 18:35:00 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE79254%27 HTTP/1.1" 200 None
2026-03-29 18:35:00 [auto1.de] INFO: Scrape type for WE79254: 0
2026-03-29 18:35:00 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT28952%27 HTTP/1.1" 200 None
2026-03-29 18:35:00 [auto1.de] INFO: Scrape type for MT28952: 0
2026-03-29 18:35:00 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-29 18:35:00 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-29 18:35:00 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:00 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-29 18:35:00 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-29 18:35:00 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK84600%27 HTTP/1.1" 200 None
2026-03-29 18:35:00 [auto1.de] INFO: Scrape type for NK84600: 0
2026-03-29 18:35:00 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-29 18:35:00 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY75534%27 HTTP/1.1" 200 None
2026-03-29 18:35:00 [auto1.de] INFO: Scrape type for TY75534: 2
2026-03-29 18:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc4b0dca-f543-520e-9f8b-7bd77b15d21b with identifier: TY75534
2026-03-29 18:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc4b0dca-f543-520e-9f8b-7bd77b15d21b with scrape type 2
2026-03-29 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc4b0dca-f543-520e-9f8b-7bd77b15d21b with scrape type 2
2026-03-29 18:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc4b0dca-f543-520e-9f8b-7bd77b15d21b, identifier: TY75534
2026-03-29 18:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc4b0dca-f543-520e-9f8b-7bd77b15d21b with identifier: TY75534
2026-03-29 18:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc4b0dca-f543-520e-9f8b-7bd77b15d21b with identifier: TY75534
2026-03-29 18:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc4b0dca-f543-520e-9f8b-7bd77b15d21b with identifier: TY75534 to the API
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:01:18Z',
'fuel_type': 'diesel',
'id': 'dc4b0dca-f543-520e-9f8b-7bd77b15d21b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY75534',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 164537,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-03',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Style Salsa',
'transmission': 'manual',
'trim': 'Style Salsa',
'year': 2013}
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY75534%27 HTTP/1.1" 200 None
2026-03-29 18:35:01 [auto1.de] INFO: Saving data for TY75534: {'auction_closing_time': 1774882878.0, 'created_time': 1774521872.122957, 'last_price_update_time': 1774809301.031675}
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY75534') HTTP/1.1" 204 0
2026-03-29 18:35:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:01 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16808%27 HTTP/1.1" 200 None
2026-03-29 18:35:01 [auto1.de] INFO: Scrape type for YT16808: 0
2026-03-29 18:35:01 [auto1.de] INFO: Found listing with ID: AW88722
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW88722%27 HTTP/1.1" 200 None
2026-03-29 18:35:01 [auto1.de] INFO: Scrape type for AW88722: 2
2026-03-29 18:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db856033-7507-5080-8c54-52e42804df02 with identifier: AW88722
2026-03-29 18:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db856033-7507-5080-8c54-52e42804df02 with scrape type 2
2026-03-29 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db856033-7507-5080-8c54-52e42804df02 with scrape type 2
2026-03-29 18:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db856033-7507-5080-8c54-52e42804df02, identifier: AW88722
2026-03-29 18:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db856033-7507-5080-8c54-52e42804df02 with identifier: AW88722
2026-03-29 18:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db856033-7507-5080-8c54-52e42804df02 with identifier: AW88722
2026-03-29 18:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db856033-7507-5080-8c54-52e42804df02 with identifier: AW88722 to the API
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:39:41Z',
'fuel_type': 'petrol',
'id': 'db856033-7507-5080-8c54-52e42804df02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW88722',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 36331,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-30',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200',
'transmission': 'automatic',
'trim': '',
'year': 2022}
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW88722%27 HTTP/1.1" 200 None
2026-03-29 18:35:01 [auto1.de] INFO: Saving data for AW88722: {'auction_closing_time': 1774885181.0, 'created_time': 1774722751.466357, 'last_price_update_time': 1774809301.524466}
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW88722') HTTP/1.1" 204 0
2026-03-29 18:35:01 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-29 18:35:01 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ19484%27 HTTP/1.1" 200 None
2026-03-29 18:35:01 [auto1.de] INFO: Scrape type for ZJ19484: 0
2026-03-29 18:35:01 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP34925%27 HTTP/1.1" 200 None
2026-03-29 18:35:01 [auto1.de] INFO: Scrape type for AP34925: 2
2026-03-29 18:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fcf05dc-b68f-5cc9-8a4f-78176e97c822 with identifier: AP34925
2026-03-29 18:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fcf05dc-b68f-5cc9-8a4f-78176e97c822 with scrape type 2
2026-03-29 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fcf05dc-b68f-5cc9-8a4f-78176e97c822 with scrape type 2
2026-03-29 18:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fcf05dc-b68f-5cc9-8a4f-78176e97c822, identifier: AP34925
2026-03-29 18:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fcf05dc-b68f-5cc9-8a4f-78176e97c822 with identifier: AP34925
2026-03-29 18:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fcf05dc-b68f-5cc9-8a4f-78176e97c822 with identifier: AP34925
2026-03-29 18:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fcf05dc-b68f-5cc9-8a4f-78176e97c822 with identifier: AP34925 to the API
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:35:11Z',
'fuel_type': 'diesel',
'id': '8fcf05dc-b68f-5cc9-8a4f-78176e97c822',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP34925',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 284261,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-16',
'seller_name': None,
'title': 'Ford Fiesta 1.5 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2014}
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP34925%27 HTTP/1.1" 200 None
2026-03-29 18:35:02 [auto1.de] INFO: Saving data for AP34925: {'auction_closing_time': 1774884911.0, 'created_time': 1774522363.001254, 'last_price_update_time': 1774809302.073997}
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP34925') HTTP/1.1" 204 0
2026-03-29 18:35:02 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB95370%27 HTTP/1.1" 200 None
2026-03-29 18:35:02 [auto1.de] INFO: Scrape type for JB95370: 0
2026-03-29 18:35:02 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD75324%27 HTTP/1.1" 200 None
2026-03-29 18:35:02 [auto1.de] INFO: Scrape type for CD75324: 2
2026-03-29 18:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573 with identifier: CD75324
2026-03-29 18:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573 with scrape type 2
2026-03-29 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573 with scrape type 2
2026-03-29 18:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573, identifier: CD75324
2026-03-29 18:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573 with identifier: CD75324
2026-03-29 18:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573 with identifier: CD75324
2026-03-29 18:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573 with identifier: CD75324 to the API
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:34:41Z',
'fuel_type': 'diesel',
'id': 'dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD75324',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 188031,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-31',
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 TDI JAKO-O Trendline',
'transmission': 'manual',
'trim': 'JAKO-O Trendline',
'year': 2013}
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD75324%27 HTTP/1.1" 200 None
2026-03-29 18:35:02 [auto1.de] INFO: Saving data for CD75324: {'auction_closing_time': 1774884881.0, 'created_time': 1774636235.26286, 'last_price_update_time': 1774809302.506869}
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD75324') HTTP/1.1" 204 0
2026-03-29 18:35:02 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-29 18:35:02 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-29 18:35:02 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY62714%27 HTTP/1.1" 200 None
2026-03-29 18:35:02 [auto1.de] INFO: Scrape type for ZY62714: 2
2026-03-29 18:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with identifier: ZY62714
2026-03-29 18:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with scrape type 2
2026-03-29 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with scrape type 2
2026-03-29 18:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9aac8b8a-e6ff-50e7-ad34-5b5751990815, identifier: ZY62714
2026-03-29 18:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with identifier: ZY62714
2026-03-29 18:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with identifier: ZY62714
2026-03-29 18:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with identifier: ZY62714 to the API
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-30T15:30:02Z',
'fuel_type': 'petrol',
'id': '9aac8b8a-e6ff-50e7-ad34-5b5751990815',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY62714',
'listing': 'auction',
'make': 'Audi',
'model': 'S4',
'odometer': 196122,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-11',
'seller_name': None,
'title': 'Audi S4 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2012}
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY62714%27 HTTP/1.1" 200 None
2026-03-29 18:35:02 [auto1.de] INFO: Saving data for ZY62714: {'auction_closing_time': 1774884602.0, 'created_time': 1773305612.110451, 'last_price_update_time': 1774809302.997314}
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY62714') HTTP/1.1" 204 0
2026-03-29 18:35:03 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP95404%27 HTTP/1.1" 200 None
2026-03-29 18:35:03 [auto1.de] INFO: Scrape type for HP95404: 2
2026-03-29 18:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1561db0f-b688-5d18-a454-650b34866fef with identifier: HP95404
2026-03-29 18:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1561db0f-b688-5d18-a454-650b34866fef with scrape type 2
2026-03-29 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1561db0f-b688-5d18-a454-650b34866fef with scrape type 2
2026-03-29 18:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1561db0f-b688-5d18-a454-650b34866fef, identifier: HP95404
2026-03-29 18:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1561db0f-b688-5d18-a454-650b34866fef with identifier: HP95404
2026-03-29 18:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1561db0f-b688-5d18-a454-650b34866fef with identifier: HP95404
2026-03-29 18:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1561db0f-b688-5d18-a454-650b34866fef with identifier: HP95404 to the API
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:07:54Z',
'fuel_type': 'diesel',
'id': '1561db0f-b688-5d18-a454-650b34866fef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP95404',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 109213,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-21',
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP95404%27 HTTP/1.1" 200 None
2026-03-29 18:35:03 [auto1.de] INFO: Saving data for HP95404: {'auction_closing_time': 1774883274.0, 'created_time': 1773341653.53218, 'last_price_update_time': 1774809303.465914}
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP95404') HTTP/1.1" 204 0
2026-03-29 18:35:03 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-29 18:35:03 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN87800%27 HTTP/1.1" 200 None
2026-03-29 18:35:03 [auto1.de] INFO: Scrape type for CN87800: 2
2026-03-29 18:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with identifier: CN87800
2026-03-29 18:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with scrape type 2
2026-03-29 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with scrape type 2
2026-03-29 18:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ba28a4f-6003-5c2d-9a1d-801c29d22cda, identifier: CN87800
2026-03-29 18:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with identifier: CN87800
2026-03-29 18:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with identifier: CN87800
2026-03-29 18:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with identifier: CN87800 to the API
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:23:56Z',
'fuel_type': 'diesel',
'id': '3ba28a4f-6003-5c2d-9a1d-801c29d22cda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN87800',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 125367,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-21',
'seller_name': None,
'title': 'BMW X5 sDrive 25d',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN87800%27 HTTP/1.1" 200 None
2026-03-29 18:35:03 [auto1.de] INFO: Saving data for CN87800: {'auction_closing_time': 1774884236.0, 'created_time': 1773399939.317202, 'last_price_update_time': 1774809303.926352}
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN87800') HTTP/1.1" 204 0
2026-03-29 18:35:04 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-29 18:35:04 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-29 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN68043%27 HTTP/1.1" 200 None
2026-03-29 18:35:04 [auto1.de] INFO: Scrape type for GN68043: 2
2026-03-29 18:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd56c9d-c984-5d14-b99e-3053d8342966 with identifier: GN68043
2026-03-29 18:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd56c9d-c984-5d14-b99e-3053d8342966 with scrape type 2
2026-03-29 18:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dd56c9d-c984-5d14-b99e-3053d8342966 with scrape type 2
2026-03-29 18:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9dd56c9d-c984-5d14-b99e-3053d8342966, identifier: GN68043
2026-03-29 18:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9dd56c9d-c984-5d14-b99e-3053d8342966 with identifier: GN68043
2026-03-29 18:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9dd56c9d-c984-5d14-b99e-3053d8342966 with identifier: GN68043
2026-03-29 18:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9dd56c9d-c984-5d14-b99e-3053d8342966 with identifier: GN68043 to the API
2026-03-29 18:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:33:08Z',
'fuel_type': 'diesel',
'id': '9dd56c9d-c984-5d14-b99e-3053d8342966',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN68043',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 253628,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-08',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2013}
2026-03-29 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN68043%27 HTTP/1.1" 200 None
2026-03-29 18:35:04 [auto1.de] INFO: Saving data for GN68043: {'auction_closing_time': 1774884788.0, 'created_time': 1773306614.871053, 'last_price_update_time': 1774809304.50994}
2026-03-29 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN68043') HTTP/1.1" 204 0
2026-03-29 18:35:04 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-29 18:35:04 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-29 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR83846%27 HTTP/1.1" 200 None
2026-03-29 18:35:04 [auto1.de] INFO: Scrape type for CR83846: 0
2026-03-29 18:35:04 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-29 18:35:04 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-29 18:35:04 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-29 18:35:04 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-29 18:35:04 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-29 18:35:04 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-29 18:35:04 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-29 18:35:04 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-29 18:35:04 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-29 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH99848%27 HTTP/1.1" 200 None
2026-03-29 18:35:04 [auto1.de] INFO: Scrape type for UH99848: 2
2026-03-29 18:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6621d8f1-0d38-51de-aca4-fa266393b116 with identifier: UH99848
2026-03-29 18:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6621d8f1-0d38-51de-aca4-fa266393b116 with scrape type 2
2026-03-29 18:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6621d8f1-0d38-51de-aca4-fa266393b116 with scrape type 2
2026-03-29 18:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6621d8f1-0d38-51de-aca4-fa266393b116, identifier: UH99848
2026-03-29 18:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6621d8f1-0d38-51de-aca4-fa266393b116 with identifier: UH99848
2026-03-29 18:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6621d8f1-0d38-51de-aca4-fa266393b116 with identifier: UH99848
2026-03-29 18:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6621d8f1-0d38-51de-aca4-fa266393b116 with identifier: UH99848 to the API
2026-03-29 18:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 328,
'expiration_date': '2026-03-30T15:16:36Z',
'fuel_type': 'hybrid',
'id': '6621d8f1-0d38-51de-aca4-fa266393b116',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH99848',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-60',
'odometer': 77335,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-01',
'seller_name': None,
'title': 'Mazda CX-60 2.5 e-Skyactiv Plug-in Hybrid Prime-Line AWD',
'transmission': 'automatic',
'trim': 'Prime-Line AWD',
'year': 2023}
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH99848%27 HTTP/1.1" 200 None
2026-03-29 18:35:05 [auto1.de] INFO: Saving data for UH99848: {'auction_closing_time': 1774883796.0, 'created_time': 1773223968.395854, 'last_price_update_time': 1774809305.02553}
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH99848') HTTP/1.1" 204 0
2026-03-29 18:35:05 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG64056%27 HTTP/1.1" 200 None
2026-03-29 18:35:05 [auto1.de] INFO: Scrape type for HG64056: 2
2026-03-29 18:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with identifier: HG64056
2026-03-29 18:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with scrape type 2
2026-03-29 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with scrape type 2
2026-03-29 18:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f68b3c0-8911-50b9-b54f-b15889e2dfa0, identifier: HG64056
2026-03-29 18:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with identifier: HG64056
2026-03-29 18:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with identifier: HG64056
2026-03-29 18:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with identifier: HG64056 to the API
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:46:10Z',
'fuel_type': 'petrol',
'id': '6f68b3c0-8911-50b9-b54f-b15889e2dfa0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG64056',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 139940,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-03',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 FSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG64056%27 HTTP/1.1" 200 None
2026-03-29 18:35:05 [auto1.de] INFO: Saving data for HG64056: {'auction_closing_time': 1774885570.0, 'created_time': 1773660014.792979, 'last_price_update_time': 1774809305.555717}
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG64056') HTTP/1.1" 204 0
2026-03-29 18:35:05 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP05566%27 HTTP/1.1" 200 None
2026-03-29 18:35:05 [auto1.de] INFO: Scrape type for NP05566: 0
2026-03-29 18:35:05 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-29 18:35:05 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP93113%27 HTTP/1.1" 200 None
2026-03-29 18:35:05 [auto1.de] INFO: Scrape type for MP93113: 0
2026-03-29 18:35:05 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-29 18:35:05 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83292%27 HTTP/1.1" 200 None
2026-03-29 18:35:05 [auto1.de] INFO: Scrape type for RL83292: 0
2026-03-29 18:35:05 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX99653%27 HTTP/1.1" 200 None
2026-03-29 18:35:05 [auto1.de] INFO: Scrape type for VX99653: 0
2026-03-29 18:35:05 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-29 18:35:05 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-29 18:35:05 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:05 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-29 18:35:05 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR08314%27 HTTP/1.1" 200 None
2026-03-29 18:35:05 [auto1.de] INFO: Scrape type for SR08314: 2
2026-03-29 18:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with identifier: SR08314
2026-03-29 18:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with scrape type 2
2026-03-29 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with scrape type 2
2026-03-29 18:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8, identifier: SR08314
2026-03-29 18:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with identifier: SR08314
2026-03-29 18:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with identifier: SR08314
2026-03-29 18:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with identifier: SR08314 to the API
2026-03-29 18:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:20:52Z',
'fuel_type': 'diesel',
'id': '0abbd100-4ddd-588c-a609-5c7bb2c6a7e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR08314',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 436322,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-15',
'seller_name': None,
'title': 'Audi A5 Sportback 2.7 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR08314%27 HTTP/1.1" 200 None
2026-03-29 18:35:06 [auto1.de] INFO: Saving data for SR08314: {'auction_closing_time': 1774884052.0, 'created_time': 1773136891.848533, 'last_price_update_time': 1774809306.136019}
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR08314') HTTP/1.1" 204 0
2026-03-29 18:35:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:06 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-29 18:35:06 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-29 18:35:06 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-29 18:35:06 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98458%27 HTTP/1.1" 200 None
2026-03-29 18:35:06 [auto1.de] INFO: Scrape type for BB98458: 2
2026-03-29 18:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9e8ef4a-c716-5274-9f4b-b70140f5928a with identifier: BB98458
2026-03-29 18:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e8ef4a-c716-5274-9f4b-b70140f5928a with scrape type 2
2026-03-29 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9e8ef4a-c716-5274-9f4b-b70140f5928a with scrape type 2
2026-03-29 18:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9e8ef4a-c716-5274-9f4b-b70140f5928a, identifier: BB98458
2026-03-29 18:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9e8ef4a-c716-5274-9f4b-b70140f5928a with identifier: BB98458
2026-03-29 18:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9e8ef4a-c716-5274-9f4b-b70140f5928a with identifier: BB98458
2026-03-29 18:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9e8ef4a-c716-5274-9f4b-b70140f5928a with identifier: BB98458 to the API
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:56:57Z',
'fuel_type': 'petrol',
'id': 'c9e8ef4a-c716-5274-9f4b-b70140f5928a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB98458',
'listing': 'auction',
'make': 'Ford',
'model': 'Puma',
'odometer': 22183,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-09',
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line Vignale',
'transmission': 'automatic',
'trim': 'ST-Line Vignale',
'year': 2021}
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98458%27 HTTP/1.1" 200 None
2026-03-29 18:35:06 [auto1.de] INFO: Saving data for BB98458: {'auction_closing_time': 1774886217.0, 'created_time': 1773466973.445288, 'last_price_update_time': 1774809306.694949}
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB98458') HTTP/1.1" 204 0
2026-03-29 18:35:06 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-29 18:35:06 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88123%27 HTTP/1.1" 200 None
2026-03-29 18:35:06 [auto1.de] INFO: Scrape type for PY88123: 0
2026-03-29 18:35:06 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV84359%27 HTTP/1.1" 200 None
2026-03-29 18:35:06 [auto1.de] INFO: Scrape type for ZV84359: 2
2026-03-29 18:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with identifier: ZV84359
2026-03-29 18:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with scrape type 2
2026-03-29 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with scrape type 2
2026-03-29 18:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef68b548-af9a-5cd2-bb4e-0c0fb178d817, identifier: ZV84359
2026-03-29 18:35:06 [scrapy.extensions.logstats] INFO: Crawled 65 pages (at 11 pages/min), scraped 383 items (at 113 items/min)
2026-03-29 18:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with identifier: ZV84359
2026-03-29 18:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with identifier: ZV84359
2026-03-29 18:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with identifier: ZV84359 to the API
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:19:14Z',
'fuel_type': 'diesel',
'id': 'ef68b548-af9a-5cd2-bb4e-0c0fb178d817',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV84359',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 156647,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-03',
'seller_name': None,
'title': 'BMW X5 xDrive 40d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV84359%27 HTTP/1.1" 200 None
2026-03-29 18:35:07 [auto1.de] INFO: Saving data for ZV84359: {'auction_closing_time': 1774883954.0, 'created_time': 1773426853.951205, 'last_price_update_time': 1774809307.199967}
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV84359') HTTP/1.1" 204 0
2026-03-29 18:35:07 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-29 18:35:07 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-29 18:35:07 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-29 18:35:07 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-29 18:35:07 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-29 18:35:07 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF95353%27 HTTP/1.1" 200 None
2026-03-29 18:35:07 [auto1.de] INFO: Scrape type for DF95353: 0
2026-03-29 18:35:07 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-29 18:35:07 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB88110%27 HTTP/1.1" 200 None
2026-03-29 18:35:07 [auto1.de] INFO: Scrape type for AB88110: 2
2026-03-29 18:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with identifier: AB88110
2026-03-29 18:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with scrape type 2
2026-03-29 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with scrape type 2
2026-03-29 18:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a, identifier: AB88110
2026-03-29 18:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with identifier: AB88110
2026-03-29 18:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with identifier: AB88110
2026-03-29 18:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with identifier: AB88110 to the API
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:26:53Z',
'fuel_type': 'diesel',
'id': '5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB88110',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 222846,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-01',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Exclusive 4x4',
'transmission': 'automatic',
'trim': 'Exclusive 4x4',
'year': 2015}
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB88110%27 HTTP/1.1" 200 None
2026-03-29 18:35:07 [auto1.de] INFO: Saving data for AB88110: {'auction_closing_time': 1774884413.0, 'created_time': 1774608305.174039, 'last_price_update_time': 1774809307.683601}
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB88110') HTTP/1.1" 204 0
2026-03-29 18:35:07 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC26030%27 HTTP/1.1" 200 None
2026-03-29 18:35:07 [auto1.de] INFO: Scrape type for KC26030: 0
2026-03-29 18:35:07 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-29 18:35:07 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM35887%27 HTTP/1.1" 200 None
2026-03-29 18:35:07 [auto1.de] INFO: Scrape type for GM35887: 0
2026-03-29 18:35:07 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-29 18:35:07 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-29 18:35:07 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-29 18:35:07 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM23375%27 HTTP/1.1" 200 None
2026-03-29 18:35:07 [auto1.de] INFO: Scrape type for PM23375: 2
2026-03-29 18:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91f7cf98-31ce-5b5c-9c20-140c62704a58 with identifier: PM23375
2026-03-29 18:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f7cf98-31ce-5b5c-9c20-140c62704a58 with scrape type 2
2026-03-29 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91f7cf98-31ce-5b5c-9c20-140c62704a58 with scrape type 2
2026-03-29 18:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91f7cf98-31ce-5b5c-9c20-140c62704a58, identifier: PM23375
2026-03-29 18:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91f7cf98-31ce-5b5c-9c20-140c62704a58 with identifier: PM23375
2026-03-29 18:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91f7cf98-31ce-5b5c-9c20-140c62704a58 with identifier: PM23375
2026-03-29 18:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91f7cf98-31ce-5b5c-9c20-140c62704a58 with identifier: PM23375 to the API
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:31:40Z',
'fuel_type': 'diesel',
'id': '91f7cf98-31ce-5b5c-9c20-140c62704a58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM23375',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 204176,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-03',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2014}
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM23375%27 HTTP/1.1" 200 None
2026-03-29 18:35:08 [auto1.de] INFO: Saving data for PM23375: {'auction_closing_time': 1774884700.0, 'created_time': 1774349164.412524, 'last_price_update_time': 1774809308.273953}
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM23375') HTTP/1.1" 204 0
2026-03-29 18:35:08 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10791%27 HTTP/1.1" 200 None
2026-03-29 18:35:08 [auto1.de] INFO: Scrape type for HR10791: 2
2026-03-29 18:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c12cc02-5c90-503f-b86d-3517fb83850b with identifier: HR10791
2026-03-29 18:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c12cc02-5c90-503f-b86d-3517fb83850b with scrape type 2
2026-03-29 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c12cc02-5c90-503f-b86d-3517fb83850b with scrape type 2
2026-03-29 18:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c12cc02-5c90-503f-b86d-3517fb83850b, identifier: HR10791
2026-03-29 18:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c12cc02-5c90-503f-b86d-3517fb83850b with identifier: HR10791
2026-03-29 18:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c12cc02-5c90-503f-b86d-3517fb83850b with identifier: HR10791
2026-03-29 18:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c12cc02-5c90-503f-b86d-3517fb83850b with identifier: HR10791 to the API
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:56:56Z',
'fuel_type': 'diesel',
'id': '2c12cc02-5c90-503f-b86d-3517fb83850b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR10791',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 108952,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-18',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Center-Line 2WD',
'transmission': 'automatic',
'trim': 'Center-Line 2WD',
'year': 2012}
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10791%27 HTTP/1.1" 200 None
2026-03-29 18:35:08 [auto1.de] INFO: Saving data for HR10791: {'auction_closing_time': 1774886216.0, 'created_time': 1774032298.734091, 'last_price_update_time': 1774809308.70491}
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR10791') HTTP/1.1" 204 0
2026-03-29 18:35:08 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-29 18:35:08 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-29 18:35:08 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-29 18:35:08 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW77657%27 HTTP/1.1" 200 None
2026-03-29 18:35:08 [auto1.de] INFO: Scrape type for BW77657: 2
2026-03-29 18:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43174215-e98c-5c0d-8275-4abbaf9d486a with identifier: BW77657
2026-03-29 18:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43174215-e98c-5c0d-8275-4abbaf9d486a with scrape type 2
2026-03-29 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43174215-e98c-5c0d-8275-4abbaf9d486a with scrape type 2
2026-03-29 18:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43174215-e98c-5c0d-8275-4abbaf9d486a, identifier: BW77657
2026-03-29 18:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43174215-e98c-5c0d-8275-4abbaf9d486a with identifier: BW77657
2026-03-29 18:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43174215-e98c-5c0d-8275-4abbaf9d486a with identifier: BW77657
2026-03-29 18:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43174215-e98c-5c0d-8275-4abbaf9d486a with identifier: BW77657 to the API
2026-03-29 18:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:05:51Z',
'fuel_type': 'diesel',
'id': '43174215-e98c-5c0d-8275-4abbaf9d486a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW77657',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 109924,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-24',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion',
'transmission': 'automatic',
'trim': 'GTD BlueMotion',
'year': 2019}
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW77657%27 HTTP/1.1" 200 None
2026-03-29 18:35:09 [auto1.de] INFO: Saving data for BW77657: {'auction_closing_time': 1774883151.0, 'created_time': 1773830855.84561, 'last_price_update_time': 1774809309.17658}
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW77657') HTTP/1.1" 204 0
2026-03-29 18:35:09 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-29 18:35:09 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-29 18:35:09 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK83819%27 HTTP/1.1" 200 None
2026-03-29 18:35:09 [auto1.de] INFO: Scrape type for NK83819: 2
2026-03-29 18:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f9f659-1548-59ce-a865-56311a1774ba with identifier: NK83819
2026-03-29 18:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f9f659-1548-59ce-a865-56311a1774ba with scrape type 2
2026-03-29 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5f9f659-1548-59ce-a865-56311a1774ba with scrape type 2
2026-03-29 18:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5f9f659-1548-59ce-a865-56311a1774ba, identifier: NK83819
2026-03-29 18:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5f9f659-1548-59ce-a865-56311a1774ba with identifier: NK83819
2026-03-29 18:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5f9f659-1548-59ce-a865-56311a1774ba with identifier: NK83819
2026-03-29 18:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5f9f659-1548-59ce-a865-56311a1774ba with identifier: NK83819 to the API
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:21:44Z',
'fuel_type': 'petrol',
'id': 'd5f9f659-1548-59ce-a865-56311a1774ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK83819',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 169450,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-04-07',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 160 Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2003}
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK83819%27 HTTP/1.1" 200 None
2026-03-29 18:35:09 [auto1.de] INFO: Saving data for NK83819: {'auction_closing_time': 1774884104.0, 'created_time': 1774607500.998042, 'last_price_update_time': 1774809309.713224}
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK83819') HTTP/1.1" 204 0
2026-03-29 18:35:09 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-29 18:35:09 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE29906%27 HTTP/1.1" 200 None
2026-03-29 18:35:09 [auto1.de] INFO: Scrape type for ZE29906: 0
2026-03-29 18:35:09 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-29 18:35:09 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-29 18:35:09 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09458%27 HTTP/1.1" 200 None
2026-03-29 18:35:09 [auto1.de] INFO: Scrape type for LL09458: 0
2026-03-29 18:35:09 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ59930%27 HTTP/1.1" 200 None
2026-03-29 18:35:09 [auto1.de] INFO: Scrape type for ZZ59930: 2
2026-03-29 18:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with identifier: ZZ59930
2026-03-29 18:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with scrape type 2
2026-03-29 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with scrape type 2
2026-03-29 18:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1519479c-f49e-5f48-a2b2-a37769cd0ed4, identifier: ZZ59930
2026-03-29 18:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with identifier: ZZ59930
2026-03-29 18:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with identifier: ZZ59930
2026-03-29 18:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with identifier: ZZ59930 to the API
2026-03-29 18:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:21:15Z',
'fuel_type': 'petrol',
'id': '1519479c-f49e-5f48-a2b2-a37769cd0ed4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ59930',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 150118,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-10',
'seller_name': None,
'title': 'Skoda Kamiq 1.5 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2020}
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ59930%27 HTTP/1.1" 200 None
2026-03-29 18:35:10 [auto1.de] INFO: Saving data for ZZ59930: {'auction_closing_time': 1774884075.0, 'created_time': 1773859271.207919, 'last_price_update_time': 1774809310.202591}
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ59930') HTTP/1.1" 204 0
2026-03-29 18:35:10 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-29 18:35:10 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU82814%27 HTTP/1.1" 200 None
2026-03-29 18:35:10 [auto1.de] INFO: Scrape type for AU82814: 0
2026-03-29 18:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:10 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:10 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH56316%27 HTTP/1.1" 200 None
2026-03-29 18:35:10 [auto1.de] INFO: Scrape type for HH56316: 2
2026-03-29 18:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85b71412-e77f-5f61-bf1d-5350a5bafdaa with identifier: HH56316
2026-03-29 18:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85b71412-e77f-5f61-bf1d-5350a5bafdaa with scrape type 2
2026-03-29 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85b71412-e77f-5f61-bf1d-5350a5bafdaa with scrape type 2
2026-03-29 18:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85b71412-e77f-5f61-bf1d-5350a5bafdaa, identifier: HH56316
2026-03-29 18:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85b71412-e77f-5f61-bf1d-5350a5bafdaa with identifier: HH56316
2026-03-29 18:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85b71412-e77f-5f61-bf1d-5350a5bafdaa with identifier: HH56316
2026-03-29 18:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85b71412-e77f-5f61-bf1d-5350a5bafdaa with identifier: HH56316 to the API
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:32:15Z',
'fuel_type': 'diesel',
'id': '85b71412-e77f-5f61-bf1d-5350a5bafdaa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH56316',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 217113,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-13',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Lounge BlueMotion Tech',
'transmission': 'manual',
'trim': 'Lounge BlueMotion Tech',
'year': 2015}
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH56316%27 HTTP/1.1" 200 None
2026-03-29 18:35:10 [auto1.de] INFO: Saving data for HH56316: {'auction_closing_time': 1774884735.0, 'created_time': 1774522283.021663, 'last_price_update_time': 1774809310.72888}
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH56316') HTTP/1.1" 204 0
2026-03-29 18:35:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:10 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX86336%27 HTTP/1.1" 200 None
2026-03-29 18:35:10 [auto1.de] INFO: Scrape type for LX86336: 2
2026-03-29 18:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667ce6bf-58de-515c-98fa-e28fac7675bb with identifier: LX86336
2026-03-29 18:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667ce6bf-58de-515c-98fa-e28fac7675bb with scrape type 2
2026-03-29 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 667ce6bf-58de-515c-98fa-e28fac7675bb with scrape type 2
2026-03-29 18:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 667ce6bf-58de-515c-98fa-e28fac7675bb, identifier: LX86336
2026-03-29 18:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 667ce6bf-58de-515c-98fa-e28fac7675bb with identifier: LX86336
2026-03-29 18:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 667ce6bf-58de-515c-98fa-e28fac7675bb with identifier: LX86336
2026-03-29 18:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 667ce6bf-58de-515c-98fa-e28fac7675bb with identifier: LX86336 to the API
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:59:07Z',
'fuel_type': 'petrol',
'id': '667ce6bf-58de-515c-98fa-e28fac7675bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX86336',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 49143,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-18',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2018}
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX86336%27 HTTP/1.1" 200 None
2026-03-29 18:35:11 [auto1.de] INFO: Saving data for LX86336: {'auction_closing_time': 1774886347.0, 'created_time': 1774291167.36695, 'last_price_update_time': 1774809311.239797}
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX86336') HTTP/1.1" 204 0
2026-03-29 18:35:11 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-29 18:35:11 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67519%27 HTTP/1.1" 200 None
2026-03-29 18:35:11 [auto1.de] INFO: Scrape type for XY67519: 0
2026-03-29 18:35:11 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT42792%27 HTTP/1.1" 200 None
2026-03-29 18:35:11 [auto1.de] INFO: Scrape type for VT42792: 0
2026-03-29 18:35:11 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-29 18:35:11 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX25662%27 HTTP/1.1" 200 None
2026-03-29 18:35:11 [auto1.de] INFO: Scrape type for FX25662: 0
2026-03-29 18:35:11 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF83287%27 HTTP/1.1" 200 None
2026-03-29 18:35:11 [auto1.de] INFO: Scrape type for XF83287: 2
2026-03-29 18:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 182166df-a758-5861-8c9c-caf74e2fa5ad with identifier: XF83287
2026-03-29 18:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 182166df-a758-5861-8c9c-caf74e2fa5ad with scrape type 2
2026-03-29 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 182166df-a758-5861-8c9c-caf74e2fa5ad with scrape type 2
2026-03-29 18:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 182166df-a758-5861-8c9c-caf74e2fa5ad, identifier: XF83287
2026-03-29 18:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 182166df-a758-5861-8c9c-caf74e2fa5ad with identifier: XF83287
2026-03-29 18:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 182166df-a758-5861-8c9c-caf74e2fa5ad with identifier: XF83287
2026-03-29 18:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 182166df-a758-5861-8c9c-caf74e2fa5ad with identifier: XF83287 to the API
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:04:41Z',
'fuel_type': 'petrol',
'id': '182166df-a758-5861-8c9c-caf74e2fa5ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF83287',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 202722,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-09',
'seller_name': None,
'title': 'Audi A4 2.0 TFSI S line Sportpaket plus',
'transmission': 'manual',
'trim': 'S line Sportpaket plus',
'year': 2009}
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF83287%27 HTTP/1.1" 200 None
2026-03-29 18:35:11 [auto1.de] INFO: Saving data for XF83287: {'auction_closing_time': 1774883081.0, 'created_time': 1774262939.739456, 'last_price_update_time': 1774809311.754415}
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF83287') HTTP/1.1" 204 0
2026-03-29 18:35:11 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-29 18:35:11 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80548%27 HTTP/1.1" 200 None
2026-03-29 18:35:11 [auto1.de] INFO: Scrape type for RX80548: 0
2026-03-29 18:35:11 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-29 18:35:11 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-29 18:35:11 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT57989%27 HTTP/1.1" 200 None
2026-03-29 18:35:11 [auto1.de] INFO: Scrape type for YT57989: 2
2026-03-29 18:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9c0a936-6110-5211-82a2-53b21169dc3e with identifier: YT57989
2026-03-29 18:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9c0a936-6110-5211-82a2-53b21169dc3e with scrape type 2
2026-03-29 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9c0a936-6110-5211-82a2-53b21169dc3e with scrape type 2
2026-03-29 18:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9c0a936-6110-5211-82a2-53b21169dc3e, identifier: YT57989
2026-03-29 18:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9c0a936-6110-5211-82a2-53b21169dc3e with identifier: YT57989
2026-03-29 18:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9c0a936-6110-5211-82a2-53b21169dc3e with identifier: YT57989
2026-03-29 18:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9c0a936-6110-5211-82a2-53b21169dc3e with identifier: YT57989 to the API
2026-03-29 18:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:05:18Z',
'fuel_type': 'diesel',
'id': 'f9c0a936-6110-5211-82a2-53b21169dc3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT57989',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 244573,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-17',
'seller_name': None,
'title': 'BMW 3er 320d xDrive',
'transmission': 'manual',
'trim': 'xDrive',
'year': 2011}
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT57989%27 HTTP/1.1" 200 None
2026-03-29 18:35:12 [auto1.de] INFO: Saving data for YT57989: {'auction_closing_time': 1774883118.0, 'created_time': 1774521896.857507, 'last_price_update_time': 1774809312.166794}
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT57989') HTTP/1.1" 204 0
2026-03-29 18:35:12 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-29 18:35:12 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS13151%27 HTTP/1.1" 200 None
2026-03-29 18:35:12 [auto1.de] INFO: Scrape type for JS13151: 2
2026-03-29 18:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d42e471d-29d6-5e33-9d9d-5152535fa1a9 with identifier: JS13151
2026-03-29 18:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d42e471d-29d6-5e33-9d9d-5152535fa1a9 with scrape type 2
2026-03-29 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d42e471d-29d6-5e33-9d9d-5152535fa1a9 with scrape type 2
2026-03-29 18:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d42e471d-29d6-5e33-9d9d-5152535fa1a9, identifier: JS13151
2026-03-29 18:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d42e471d-29d6-5e33-9d9d-5152535fa1a9 with identifier: JS13151
2026-03-29 18:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d42e471d-29d6-5e33-9d9d-5152535fa1a9 with identifier: JS13151
2026-03-29 18:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d42e471d-29d6-5e33-9d9d-5152535fa1a9 with identifier: JS13151 to the API
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:35:52Z',
'fuel_type': 'petrol',
'id': 'd42e471d-29d6-5e33-9d9d-5152535fa1a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS13151',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 38452,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-12',
'seller_name': None,
'title': 'Audi A4 40 TFSI Mild-Hybrid quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2023}
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS13151%27 HTTP/1.1" 200 None
2026-03-29 18:35:12 [auto1.de] INFO: Saving data for JS13151: {'auction_closing_time': 1774884952.0, 'created_time': 1774607679.821267, 'last_price_update_time': 1774809312.706017}
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS13151') HTTP/1.1" 204 0
2026-03-29 18:35:12 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX91762%27 HTTP/1.1" 200 None
2026-03-29 18:35:12 [auto1.de] INFO: Scrape type for WX91762: 0
2026-03-29 18:35:12 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF38330%27 HTTP/1.1" 200 None
2026-03-29 18:35:12 [auto1.de] INFO: Scrape type for NF38330: 0
2026-03-29 18:35:12 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-29 18:35:12 [auto1.de] INFO: Found listing with ID: PP10507
2026-03-29 18:35:12 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-29 18:35:12 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN67073%27 HTTP/1.1" 200 None
2026-03-29 18:35:12 [auto1.de] INFO: Scrape type for WN67073: 0
2026-03-29 18:35:12 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN76417%27 HTTP/1.1" 200 None
2026-03-29 18:35:12 [auto1.de] INFO: Scrape type for BN76417: 0
2026-03-29 18:35:12 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47676%27 HTTP/1.1" 200 None
2026-03-29 18:35:12 [auto1.de] INFO: Scrape type for ZS47676: 2
2026-03-29 18:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed011539-6c54-56ca-a50a-4ce55ee95ad3 with identifier: ZS47676
2026-03-29 18:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed011539-6c54-56ca-a50a-4ce55ee95ad3 with scrape type 2
2026-03-29 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed011539-6c54-56ca-a50a-4ce55ee95ad3 with scrape type 2
2026-03-29 18:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed011539-6c54-56ca-a50a-4ce55ee95ad3, identifier: ZS47676
2026-03-29 18:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed011539-6c54-56ca-a50a-4ce55ee95ad3 with identifier: ZS47676
2026-03-29 18:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed011539-6c54-56ca-a50a-4ce55ee95ad3 with identifier: ZS47676
2026-03-29 18:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed011539-6c54-56ca-a50a-4ce55ee95ad3 with identifier: ZS47676 to the API
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:18:03Z',
'fuel_type': 'diesel',
'id': 'ed011539-6c54-56ca-a50a-4ce55ee95ad3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS47676',
'listing': 'auction',
'make': 'Volvo',
'model': 'S80',
'odometer': 297353,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-13',
'seller_name': None,
'title': 'Volvo S80 2.0 D4 Summum',
'transmission': 'automatic',
'trim': 'Summum',
'year': 2016}
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47676%27 HTTP/1.1" 200 None
2026-03-29 18:35:13 [auto1.de] INFO: Saving data for ZS47676: {'auction_closing_time': 1774883883.0, 'created_time': 1773659610.705324, 'last_price_update_time': 1774809313.233074}
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS47676') HTTP/1.1" 204 0
2026-03-29 18:35:13 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM15300%27 HTTP/1.1" 200 None
2026-03-29 18:35:13 [auto1.de] INFO: Scrape type for CM15300: 2
2026-03-29 18:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36abdd27-a159-58c7-ad06-27686163d3f1 with identifier: CM15300
2026-03-29 18:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36abdd27-a159-58c7-ad06-27686163d3f1 with scrape type 2
2026-03-29 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36abdd27-a159-58c7-ad06-27686163d3f1 with scrape type 2
2026-03-29 18:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36abdd27-a159-58c7-ad06-27686163d3f1, identifier: CM15300
2026-03-29 18:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36abdd27-a159-58c7-ad06-27686163d3f1 with identifier: CM15300
2026-03-29 18:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36abdd27-a159-58c7-ad06-27686163d3f1 with identifier: CM15300
2026-03-29 18:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36abdd27-a159-58c7-ad06-27686163d3f1 with identifier: CM15300 to the API
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:05:15Z',
'fuel_type': 'petrol',
'id': '36abdd27-a159-58c7-ad06-27686163d3f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM15300',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 30243,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-24',
'seller_name': None,
'title': 'Seat Ateca 1.5 TSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2020}
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM15300%27 HTTP/1.1" 200 None
2026-03-29 18:35:13 [auto1.de] INFO: Saving data for CM15300: {'auction_closing_time': 1774883115.0, 'created_time': 1773387056.450722, 'last_price_update_time': 1774809313.630676}
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM15300') HTTP/1.1" 204 0
2026-03-29 18:35:13 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC93517%27 HTTP/1.1" 200 None
2026-03-29 18:35:13 [auto1.de] INFO: Scrape type for EC93517: 2
2026-03-29 18:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 682696fe-9d7c-55a9-9875-9e834f054b1e with identifier: EC93517
2026-03-29 18:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 682696fe-9d7c-55a9-9875-9e834f054b1e with scrape type 2
2026-03-29 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 682696fe-9d7c-55a9-9875-9e834f054b1e with scrape type 2
2026-03-29 18:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 682696fe-9d7c-55a9-9875-9e834f054b1e, identifier: EC93517
2026-03-29 18:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 682696fe-9d7c-55a9-9875-9e834f054b1e with identifier: EC93517
2026-03-29 18:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 682696fe-9d7c-55a9-9875-9e834f054b1e with identifier: EC93517
2026-03-29 18:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 682696fe-9d7c-55a9-9875-9e834f054b1e with identifier: EC93517 to the API
2026-03-29 18:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:49:39Z',
'fuel_type': 'petrol',
'id': '682696fe-9d7c-55a9-9875-9e834f054b1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC93517',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 215659,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-06-25',
'seller_name': None,
'title': 'BMW 3er 325i Edition Exclusiv',
'transmission': 'automatic',
'trim': 'Edition Exclusiv',
'year': 2003}
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC93517%27 HTTP/1.1" 200 None
2026-03-29 18:35:14 [auto1.de] INFO: Saving data for EC93517: {'auction_closing_time': 1774885779.0, 'created_time': 1773400170.806879, 'last_price_update_time': 1774809314.18236}
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC93517') HTTP/1.1" 204 0
2026-03-29 18:35:14 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-29 18:35:14 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-29 18:35:14 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN35790%27 HTTP/1.1" 200 None
2026-03-29 18:35:14 [auto1.de] INFO: Scrape type for YN35790: 2
2026-03-29 18:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with identifier: YN35790
2026-03-29 18:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with scrape type 2
2026-03-29 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with scrape type 2
2026-03-29 18:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3, identifier: YN35790
2026-03-29 18:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with identifier: YN35790
2026-03-29 18:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with identifier: YN35790
2026-03-29 18:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with identifier: YN35790 to the API
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 310,
'expiration_date': '2026-03-30T15:08:03Z',
'fuel_type': 'petrol',
'id': 'de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN35790',
'listing': 'auction',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 38915,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-21',
'seller_name': None,
'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
'transmission': 'automatic',
'trim': 'VZ 4Drive',
'year': 2021}
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN35790%27 HTTP/1.1" 200 None
2026-03-29 18:35:14 [auto1.de] INFO: Saving data for YN35790: {'auction_closing_time': 1774883283.0, 'created_time': 1774265118.820482, 'last_price_update_time': 1774809314.659372}
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN35790') HTTP/1.1" 204 0
2026-03-29 18:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:14 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-29 18:35:14 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND34621%27 HTTP/1.1" 200 None
2026-03-29 18:35:14 [auto1.de] INFO: Scrape type for ND34621: 0
2026-03-29 18:35:14 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT29180%27 HTTP/1.1" 200 None
2026-03-29 18:35:14 [auto1.de] INFO: Scrape type for LT29180: 0
2026-03-29 18:35:14 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-29 18:35:14 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW08292%27 HTTP/1.1" 200 None
2026-03-29 18:35:14 [auto1.de] INFO: Scrape type for AW08292: 0
2026-03-29 18:35:14 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-29 18:35:14 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95124%27 HTTP/1.1" 200 None
2026-03-29 18:35:14 [auto1.de] INFO: Scrape type for EY95124: 0
2026-03-29 18:35:14 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-29 18:35:14 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-29 18:35:14 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC63070%27 HTTP/1.1" 200 None
2026-03-29 18:35:14 [auto1.de] INFO: Scrape type for VC63070: 2
2026-03-29 18:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with identifier: VC63070
2026-03-29 18:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with scrape type 2
2026-03-29 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with scrape type 2
2026-03-29 18:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2d28c24-e7ec-502e-bf8a-e3cad0aded94, identifier: VC63070
2026-03-29 18:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with identifier: VC63070
2026-03-29 18:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with identifier: VC63070
2026-03-29 18:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with identifier: VC63070 to the API
2026-03-29 18:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:57:36Z',
'fuel_type': 'diesel',
'id': 'a2d28c24-e7ec-502e-bf8a-e3cad0aded94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC63070',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 121427,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-17',
'seller_name': None,
'title': 'Hyundai Tucson 1.7 CRDi Trend blue 2WD',
'transmission': 'manual',
'trim': 'Trend blue 2WD',
'year': 2018}
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC63070%27 HTTP/1.1" 200 None
2026-03-29 18:35:15 [auto1.de] INFO: Saving data for VC63070: {'auction_closing_time': 1774886256.0, 'created_time': 1773775438.495913, 'last_price_update_time': 1774809315.193401}
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC63070') HTTP/1.1" 204 0
2026-03-29 18:35:15 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-29 18:35:15 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF71705%27 HTTP/1.1" 200 None
2026-03-29 18:35:15 [auto1.de] INFO: Scrape type for TF71705: 2
2026-03-29 18:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b595b112-23bc-5c26-a2e7-7992cc165dda with identifier: TF71705
2026-03-29 18:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b595b112-23bc-5c26-a2e7-7992cc165dda with scrape type 2
2026-03-29 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b595b112-23bc-5c26-a2e7-7992cc165dda with scrape type 2
2026-03-29 18:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b595b112-23bc-5c26-a2e7-7992cc165dda, identifier: TF71705
2026-03-29 18:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b595b112-23bc-5c26-a2e7-7992cc165dda with identifier: TF71705
2026-03-29 18:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b595b112-23bc-5c26-a2e7-7992cc165dda with identifier: TF71705
2026-03-29 18:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b595b112-23bc-5c26-a2e7-7992cc165dda with identifier: TF71705 to the API
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:48:55Z',
'fuel_type': 'petrol',
'id': 'b595b112-23bc-5c26-a2e7-7992cc165dda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF71705',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 100530,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-03-20',
'seller_name': None,
'title': 'BMW 1er 118i',
'transmission': 'manual',
'trim': '',
'year': 2006}
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF71705%27 HTTP/1.1" 200 None
2026-03-29 18:35:15 [auto1.de] INFO: Saving data for TF71705: {'auction_closing_time': 1774885735.0, 'created_time': 1774636313.028779, 'last_price_update_time': 1774809315.665499}
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF71705') HTTP/1.1" 204 0
2026-03-29 18:35:15 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:15 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97147%27 HTTP/1.1" 200 None
2026-03-29 18:35:15 [auto1.de] INFO: Scrape type for BT97147: 0
2026-03-29 18:35:15 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-29 18:35:15 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT86563%27 HTTP/1.1" 200 None
2026-03-29 18:35:15 [auto1.de] INFO: Scrape type for WT86563: 2
2026-03-29 18:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with identifier: WT86563
2026-03-29 18:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with scrape type 2
2026-03-29 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with scrape type 2
2026-03-29 18:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 609db12b-2ba2-51fd-88b4-fb8ddb490b57, identifier: WT86563
2026-03-29 18:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with identifier: WT86563
2026-03-29 18:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with identifier: WT86563
2026-03-29 18:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with identifier: WT86563 to the API
2026-03-29 18:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 195,
'expiration_date': '2026-03-30T15:15:09Z',
'fuel_type': 'diesel',
'id': '609db12b-2ba2-51fd-88b4-fb8ddb490b57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT86563',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 191953,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-28',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Sport 4x4',
'transmission': 'manual',
'trim': 'Sport 4x4',
'year': 2012}
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT86563%27 HTTP/1.1" 200 None
2026-03-29 18:35:16 [auto1.de] INFO: Saving data for WT86563: {'auction_closing_time': 1774883709.0, 'created_time': 1774294028.121884, 'last_price_update_time': 1774809316.134481}
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT86563') HTTP/1.1" 204 0
2026-03-29 18:35:16 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-29 18:35:16 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS47170%27 HTTP/1.1" 200 None
2026-03-29 18:35:16 [auto1.de] INFO: Scrape type for PS47170: 2
2026-03-29 18:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b19f91f-080b-5ab6-9076-724827ca0d6f with identifier: PS47170
2026-03-29 18:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b19f91f-080b-5ab6-9076-724827ca0d6f with scrape type 2
2026-03-29 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b19f91f-080b-5ab6-9076-724827ca0d6f with scrape type 2
2026-03-29 18:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b19f91f-080b-5ab6-9076-724827ca0d6f, identifier: PS47170
2026-03-29 18:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b19f91f-080b-5ab6-9076-724827ca0d6f with identifier: PS47170
2026-03-29 18:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b19f91f-080b-5ab6-9076-724827ca0d6f with identifier: PS47170
2026-03-29 18:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b19f91f-080b-5ab6-9076-724827ca0d6f with identifier: PS47170 to the API
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:54:16Z',
'fuel_type': 'petrol',
'id': '1b19f91f-080b-5ab6-9076-724827ca0d6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS47170',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 167989,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-01',
'seller_name': None,
'title': 'Citroen C3 1.2 VTi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2014}
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS47170%27 HTTP/1.1" 200 None
2026-03-29 18:35:16 [auto1.de] INFO: Saving data for PS47170: {'auction_closing_time': 1774886056.0, 'created_time': 1773426834.292713, 'last_price_update_time': 1774809316.576155}
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS47170') HTTP/1.1" 204 0
2026-03-29 18:35:16 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-29 18:35:16 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-29 18:35:16 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-29 18:35:16 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-29 18:35:16 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP30062%27 HTTP/1.1" 200 None
2026-03-29 18:35:16 [auto1.de] INFO: Scrape type for DP30062: 0
2026-03-29 18:35:16 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-29 18:35:16 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM03411%27 HTTP/1.1" 200 None
2026-03-29 18:35:16 [auto1.de] INFO: Scrape type for RM03411: 2
2026-03-29 18:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with identifier: RM03411
2026-03-29 18:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with scrape type 2
2026-03-29 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with scrape type 2
2026-03-29 18:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f71a3a4-afe0-50b4-9484-c3763ef3d681, identifier: RM03411
2026-03-29 18:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with identifier: RM03411
2026-03-29 18:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with identifier: RM03411
2026-03-29 18:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with identifier: RM03411 to the API
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:31:15Z',
'fuel_type': 'diesel',
'id': '0f71a3a4-afe0-50b4-9484-c3763ef3d681',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM03411',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 157444,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-17',
'seller_name': None,
'title': 'Audi A4 2.0 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2017}
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM03411%27 HTTP/1.1" 200 None
2026-03-29 18:35:17 [auto1.de] INFO: Saving data for RM03411: {'auction_closing_time': 1774884675.0, 'created_time': 1774608282.501107, 'last_price_update_time': 1774809317.012134}
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM03411') HTTP/1.1" 204 0
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG08443%27 HTTP/1.1" 200 None
2026-03-29 18:35:17 [auto1.de] INFO: Scrape type for AG08443: 2
2026-03-29 18:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff62bfea-5c5f-5c3f-919d-29caaa75af5c with identifier: AG08443
2026-03-29 18:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff62bfea-5c5f-5c3f-919d-29caaa75af5c with scrape type 2
2026-03-29 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff62bfea-5c5f-5c3f-919d-29caaa75af5c with scrape type 2
2026-03-29 18:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff62bfea-5c5f-5c3f-919d-29caaa75af5c, identifier: AG08443
2026-03-29 18:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff62bfea-5c5f-5c3f-919d-29caaa75af5c with identifier: AG08443
2026-03-29 18:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff62bfea-5c5f-5c3f-919d-29caaa75af5c with identifier: AG08443
2026-03-29 18:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff62bfea-5c5f-5c3f-919d-29caaa75af5c with identifier: AG08443 to the API
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 67,
'expiration_date': '2026-03-30T15:24:19Z',
'fuel_type': 'petrol',
'id': 'ff62bfea-5c5f-5c3f-919d-29caaa75af5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG08443',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 5323,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-01',
'seller_name': None,
'title': 'Hyundai i10 1.0 Trend',
'transmission': 'automatic',
'trim': 'Trend',
'year': 2024}
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG08443%27 HTTP/1.1" 200 None
2026-03-29 18:35:17 [auto1.de] INFO: Saving data for AG08443: {'auction_closing_time': 1774884259.0, 'created_time': 1774522287.468967, 'last_price_update_time': 1774809317.49893}
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG08443') HTTP/1.1" 204 0
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47814%27 HTTP/1.1" 200 None
2026-03-29 18:35:17 [auto1.de] INFO: Scrape type for YJ47814: 0
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ76786%27 HTTP/1.1" 200 None
2026-03-29 18:35:17 [auto1.de] INFO: Scrape type for XZ76786: 0
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX12116%27 HTTP/1.1" 200 None
2026-03-29 18:35:17 [auto1.de] INFO: Scrape type for KX12116: 0
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ16531%27 HTTP/1.1" 200 None
2026-03-29 18:35:17 [auto1.de] INFO: Scrape type for AJ16531: 0
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD56842%27 HTTP/1.1" 200 None
2026-03-29 18:35:17 [auto1.de] INFO: Scrape type for TD56842: 0
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12906%27 HTTP/1.1" 200 None
2026-03-29 18:35:17 [auto1.de] INFO: Scrape type for RK12906: 0
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR99013%27 HTTP/1.1" 200 None
2026-03-29 18:35:17 [auto1.de] INFO: Scrape type for KR99013: 0
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB93359%27 HTTP/1.1" 200 None
2026-03-29 18:35:17 [auto1.de] INFO: Scrape type for VB93359: 0
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-29 18:35:17 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC90555%27 HTTP/1.1" 200 None
2026-03-29 18:35:17 [auto1.de] INFO: Scrape type for DC90555: 2
2026-03-29 18:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 332b15ed-913a-5e5b-9834-defa8e804cac with identifier: DC90555
2026-03-29 18:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 332b15ed-913a-5e5b-9834-defa8e804cac with scrape type 2
2026-03-29 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 332b15ed-913a-5e5b-9834-defa8e804cac with scrape type 2
2026-03-29 18:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 332b15ed-913a-5e5b-9834-defa8e804cac, identifier: DC90555
2026-03-29 18:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 332b15ed-913a-5e5b-9834-defa8e804cac with identifier: DC90555
2026-03-29 18:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 332b15ed-913a-5e5b-9834-defa8e804cac with identifier: DC90555
2026-03-29 18:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 332b15ed-913a-5e5b-9834-defa8e804cac with identifier: DC90555 to the API
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:51:59Z',
'fuel_type': 'diesel',
'id': '332b15ed-913a-5e5b-9834-defa8e804cac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC90555',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 106358,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-18',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Lounge BlueMotion Tech',
'transmission': 'manual',
'trim': 'Lounge BlueMotion Tech',
'year': 2016}
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC90555%27 HTTP/1.1" 200 None
2026-03-29 18:35:18 [auto1.de] INFO: Saving data for DC90555: {'auction_closing_time': 1774885919.0, 'created_time': 1774293285.570253, 'last_price_update_time': 1774809318.101506}
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC90555') HTTP/1.1" 204 0
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL45510%27 HTTP/1.1" 200 None
2026-03-29 18:35:18 [auto1.de] INFO: Scrape type for AL45510: 2
2026-03-29 18:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4523eb2-f67f-53b2-a556-693798ed8a5c with identifier: AL45510
2026-03-29 18:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4523eb2-f67f-53b2-a556-693798ed8a5c with scrape type 2
2026-03-29 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4523eb2-f67f-53b2-a556-693798ed8a5c with scrape type 2
2026-03-29 18:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4523eb2-f67f-53b2-a556-693798ed8a5c, identifier: AL45510
2026-03-29 18:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4523eb2-f67f-53b2-a556-693798ed8a5c with identifier: AL45510
2026-03-29 18:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4523eb2-f67f-53b2-a556-693798ed8a5c with identifier: AL45510
2026-03-29 18:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4523eb2-f67f-53b2-a556-693798ed8a5c with identifier: AL45510 to the API
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:47:12Z',
'fuel_type': 'petrol',
'id': 'e4523eb2-f67f-53b2-a556-693798ed8a5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL45510',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 154940,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-29',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL45510%27 HTTP/1.1" 200 None
2026-03-29 18:35:18 [auto1.de] INFO: Saving data for AL45510: {'auction_closing_time': 1774885632.0, 'created_time': 1774031534.622478, 'last_price_update_time': 1774809318.581413}
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL45510') HTTP/1.1" 204 0
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG02124%27 HTTP/1.1" 200 None
2026-03-29 18:35:18 [auto1.de] INFO: Scrape type for XG02124: 0
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ61824%27 HTTP/1.1" 200 None
2026-03-29 18:35:18 [auto1.de] INFO: Scrape type for GJ61824: 0
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK65785%27 HTTP/1.1" 200 None
2026-03-29 18:35:18 [auto1.de] INFO: Scrape type for AK65785: 2
2026-03-29 18:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with identifier: AK65785
2026-03-29 18:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with scrape type 2
2026-03-29 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with scrape type 2
2026-03-29 18:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8, identifier: AK65785
2026-03-29 18:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with identifier: AK65785
2026-03-29 18:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with identifier: AK65785
2026-03-29 18:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with identifier: AK65785 to the API
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:08:44Z',
'fuel_type': 'diesel',
'id': 'fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK65785',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 254611,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-08',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2010}
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK65785%27 HTTP/1.1" 200 None
2026-03-29 18:35:19 [auto1.de] INFO: Saving data for AK65785: {'auction_closing_time': 1774883324.0, 'created_time': 1773340412.094104, 'last_price_update_time': 1774809319.05799}
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK65785') HTTP/1.1" 204 0
2026-03-29 18:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:19 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:19 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-29 18:35:19 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH76604%27 HTTP/1.1" 200 None
2026-03-29 18:35:19 [auto1.de] INFO: Scrape type for YH76604: 2
2026-03-29 18:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4d65542-27cb-5bc6-9c90-e6c74d3ff839 with identifier: YH76604
2026-03-29 18:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4d65542-27cb-5bc6-9c90-e6c74d3ff839 with scrape type 2
2026-03-29 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4d65542-27cb-5bc6-9c90-e6c74d3ff839 with scrape type 2
2026-03-29 18:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4d65542-27cb-5bc6-9c90-e6c74d3ff839, identifier: YH76604
2026-03-29 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4d65542-27cb-5bc6-9c90-e6c74d3ff839 with identifier: YH76604
2026-03-29 18:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4d65542-27cb-5bc6-9c90-e6c74d3ff839 with identifier: YH76604
2026-03-29 18:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4d65542-27cb-5bc6-9c90-e6c74d3ff839 with identifier: YH76604 to the API
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:44:54Z',
'fuel_type': 'petrol',
'id': 'a4d65542-27cb-5bc6-9c90-e6c74d3ff839',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH76604',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 17609,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-05',
'seller_name': None,
'title': 'Volkswagen T-Cross 1.5 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2022}
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH76604%27 HTTP/1.1" 200 None
2026-03-29 18:35:19 [auto1.de] INFO: Saving data for YH76604: {'auction_closing_time': 1774885494.0, 'created_time': 1774521646.812735, 'last_price_update_time': 1774809319.565485}
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH76604') HTTP/1.1" 204 0
2026-03-29 18:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:19 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG34201%27 HTTP/1.1" 200 None
2026-03-29 18:35:19 [auto1.de] INFO: Scrape type for EG34201: 2
2026-03-29 18:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with identifier: EG34201
2026-03-29 18:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with scrape type 2
2026-03-29 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with scrape type 2
2026-03-29 18:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bedc9dc1-37d8-58bf-a424-2b2ac84e9701, identifier: EG34201
2026-03-29 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with identifier: EG34201
2026-03-29 18:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with identifier: EG34201
2026-03-29 18:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with identifier: EG34201 to the API
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:49:03Z',
'fuel_type': 'petrol',
'id': 'bedc9dc1-37d8-58bf-a424-2b2ac84e9701',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG34201',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 191827,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-03',
'seller_name': None,
'title': 'Audi A4 2.0 TFSIe',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG34201%27 HTTP/1.1" 200 None
2026-03-29 18:35:20 [auto1.de] INFO: Saving data for EG34201: {'auction_closing_time': 1774885743.0, 'created_time': 1773776371.311434, 'last_price_update_time': 1774809320.026459}
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG34201') HTTP/1.1" 204 0
2026-03-29 18:35:20 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-29 18:35:20 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW17852%27 HTTP/1.1" 200 None
2026-03-29 18:35:20 [auto1.de] INFO: Scrape type for AW17852: 2
2026-03-29 18:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50c8e0ef-26cb-54d3-8803-0458b7249a7d with identifier: AW17852
2026-03-29 18:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50c8e0ef-26cb-54d3-8803-0458b7249a7d with scrape type 2
2026-03-29 18:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50c8e0ef-26cb-54d3-8803-0458b7249a7d with scrape type 2
2026-03-29 18:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50c8e0ef-26cb-54d3-8803-0458b7249a7d, identifier: AW17852
2026-03-29 18:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50c8e0ef-26cb-54d3-8803-0458b7249a7d with identifier: AW17852
2026-03-29 18:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50c8e0ef-26cb-54d3-8803-0458b7249a7d with identifier: AW17852
2026-03-29 18:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50c8e0ef-26cb-54d3-8803-0458b7249a7d with identifier: AW17852 to the API
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:32:42Z',
'fuel_type': 'diesel',
'id': '50c8e0ef-26cb-54d3-8803-0458b7249a7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW17852',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 169832,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-29',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2022}
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW17852%27 HTTP/1.1" 200 None
2026-03-29 18:35:20 [auto1.de] INFO: Saving data for AW17852: {'auction_closing_time': 1774884762.0, 'created_time': 1774292936.926799, 'last_price_update_time': 1774809320.594882}
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW17852') HTTP/1.1" 204 0
2026-03-29 18:35:20 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57435%27 HTTP/1.1" 200 None
2026-03-29 18:35:20 [auto1.de] INFO: Scrape type for AY57435: 2
2026-03-29 18:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68658590-2bbf-5ac0-bea9-29e94c7e6106 with identifier: AY57435
2026-03-29 18:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68658590-2bbf-5ac0-bea9-29e94c7e6106 with scrape type 2
2026-03-29 18:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68658590-2bbf-5ac0-bea9-29e94c7e6106 with scrape type 2
2026-03-29 18:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68658590-2bbf-5ac0-bea9-29e94c7e6106, identifier: AY57435
2026-03-29 18:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68658590-2bbf-5ac0-bea9-29e94c7e6106 with identifier: AY57435
2026-03-29 18:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68658590-2bbf-5ac0-bea9-29e94c7e6106 with identifier: AY57435
2026-03-29 18:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68658590-2bbf-5ac0-bea9-29e94c7e6106 with identifier: AY57435 to the API
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:01:10Z',
'fuel_type': 'petrol',
'id': '68658590-2bbf-5ac0-bea9-29e94c7e6106',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY57435',
'listing': 'auction',
'make': 'Toyota',
'model': 'Auris',
'odometer': 80979,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-20',
'seller_name': None,
'title': 'Toyota Auris 1.3 Cool',
'transmission': 'manual',
'trim': 'Cool',
'year': 2016}
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57435%27 HTTP/1.1" 200 None
2026-03-29 18:35:21 [auto1.de] INFO: Saving data for AY57435: {'auction_closing_time': 1774882870.0, 'created_time': 1774608339.877896, 'last_price_update_time': 1774809321.042547}
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY57435') HTTP/1.1" 204 0
2026-03-29 18:35:21 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-29 18:35:21 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-29 18:35:21 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ79893%27 HTTP/1.1" 200 None
2026-03-29 18:35:21 [auto1.de] INFO: Scrape type for ZZ79893: 2
2026-03-29 18:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d511f27d-b882-54db-8c50-d5592c08d4bb with identifier: ZZ79893
2026-03-29 18:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d511f27d-b882-54db-8c50-d5592c08d4bb with scrape type 2
2026-03-29 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d511f27d-b882-54db-8c50-d5592c08d4bb with scrape type 2
2026-03-29 18:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d511f27d-b882-54db-8c50-d5592c08d4bb, identifier: ZZ79893
2026-03-29 18:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d511f27d-b882-54db-8c50-d5592c08d4bb with identifier: ZZ79893
2026-03-29 18:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d511f27d-b882-54db-8c50-d5592c08d4bb with identifier: ZZ79893
2026-03-29 18:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d511f27d-b882-54db-8c50-d5592c08d4bb with identifier: ZZ79893 to the API
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:15:17Z',
'fuel_type': 'diesel',
'id': 'd511f27d-b882-54db-8c50-d5592c08d4bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ79893',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Sprinter',
'odometer': 313169,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-07-16',
'seller_name': None,
'title': 'Mercedes-Benz Sprinter 211 CDI',
'transmission': 'manual',
'trim': '',
'year': 2003}
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ79893%27 HTTP/1.1" 200 None
2026-03-29 18:35:21 [auto1.de] INFO: Saving data for ZZ79893: {'auction_closing_time': 1774883717.0, 'created_time': 1774608208.2517, 'last_price_update_time': 1774809321.505199}
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ79893') HTTP/1.1" 204 0
2026-03-29 18:35:21 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-29 18:35:21 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-29 18:35:21 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-29 18:35:21 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX98591%27 HTTP/1.1" 200 None
2026-03-29 18:35:21 [auto1.de] INFO: Scrape type for VX98591: 0
2026-03-29 18:35:21 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44201%27 HTTP/1.1" 200 None
2026-03-29 18:35:21 [auto1.de] INFO: Scrape type for BD44201: 2
2026-03-29 18:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69c631cc-a091-5d47-ac9c-8aad38f66977 with identifier: BD44201
2026-03-29 18:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69c631cc-a091-5d47-ac9c-8aad38f66977 with scrape type 2
2026-03-29 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69c631cc-a091-5d47-ac9c-8aad38f66977 with scrape type 2
2026-03-29 18:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69c631cc-a091-5d47-ac9c-8aad38f66977, identifier: BD44201
2026-03-29 18:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69c631cc-a091-5d47-ac9c-8aad38f66977 with identifier: BD44201
2026-03-29 18:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69c631cc-a091-5d47-ac9c-8aad38f66977 with identifier: BD44201
2026-03-29 18:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69c631cc-a091-5d47-ac9c-8aad38f66977 with identifier: BD44201 to the API
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:16:30Z',
'fuel_type': 'diesel',
'id': '69c631cc-a091-5d47-ac9c-8aad38f66977',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD44201',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 89877,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-26',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44201%27 HTTP/1.1" 200 None
2026-03-29 18:35:21 [auto1.de] INFO: Saving data for BD44201: {'auction_closing_time': 1774883790.0, 'created_time': 1773830655.282444, 'last_price_update_time': 1774809321.942202}
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD44201') HTTP/1.1" 204 0
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG07529%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Scrape type for NG07529: 2
2026-03-29 18:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 669d0112-9e4f-53f1-bc26-c617ed536000 with identifier: NG07529
2026-03-29 18:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 669d0112-9e4f-53f1-bc26-c617ed536000 with scrape type 2
2026-03-29 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 669d0112-9e4f-53f1-bc26-c617ed536000 with scrape type 2
2026-03-29 18:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 669d0112-9e4f-53f1-bc26-c617ed536000, identifier: NG07529
2026-03-29 18:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 669d0112-9e4f-53f1-bc26-c617ed536000 with identifier: NG07529
2026-03-29 18:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 669d0112-9e4f-53f1-bc26-c617ed536000 with identifier: NG07529
2026-03-29 18:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 669d0112-9e4f-53f1-bc26-c617ed536000 with identifier: NG07529 to the API
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:31:26Z',
'fuel_type': 'diesel',
'id': '669d0112-9e4f-53f1-bc26-c617ed536000',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG07529',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 159522,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-01',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2015}
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG07529%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Saving data for NG07529: {'auction_closing_time': 1774884686.0, 'created_time': 1773343465.60809, 'last_price_update_time': 1774809322.491127}
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG07529') HTTP/1.1" 204 0
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR76257%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Scrape type for LR76257: 2
2026-03-29 18:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with identifier: LR76257
2026-03-29 18:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with scrape type 2
2026-03-29 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with scrape type 2
2026-03-29 18:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dde93fbc-d47f-5bdc-912e-f44c64e7c2a2, identifier: LR76257
2026-03-29 18:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with identifier: LR76257
2026-03-29 18:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with identifier: LR76257
2026-03-29 18:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with identifier: LR76257 to the API
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:18:50Z',
'fuel_type': 'petrol',
'id': 'dde93fbc-d47f-5bdc-912e-f44c64e7c2a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR76257',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto Evo',
'odometer': 111778,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-30',
'seller_name': None,
'title': 'Fiat Punto Evo 1.4 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2010}
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR76257%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Saving data for LR76257: {'auction_closing_time': 1774883930.0, 'created_time': 1773306784.281635, 'last_price_update_time': 1774809322.973841}
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR76257') HTTP/1.1" 204 0
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97857%27 HTTP/1.1" 200 None
2026-03-29 18:35:23 [auto1.de] INFO: Scrape type for YY97857: 0
2026-03-29 18:35:23 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS47068%27 HTTP/1.1" 200 None
2026-03-29 18:35:23 [auto1.de] INFO: Scrape type for DS47068: 2
2026-03-29 18:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42faee34-d0da-5db2-9cd5-5cbb3913290d with identifier: DS47068
2026-03-29 18:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42faee34-d0da-5db2-9cd5-5cbb3913290d with scrape type 2
2026-03-29 18:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42faee34-d0da-5db2-9cd5-5cbb3913290d with scrape type 2
2026-03-29 18:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42faee34-d0da-5db2-9cd5-5cbb3913290d, identifier: DS47068
2026-03-29 18:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42faee34-d0da-5db2-9cd5-5cbb3913290d with identifier: DS47068
2026-03-29 18:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42faee34-d0da-5db2-9cd5-5cbb3913290d with identifier: DS47068
2026-03-29 18:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42faee34-d0da-5db2-9cd5-5cbb3913290d with identifier: DS47068 to the API
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:49:55Z',
'fuel_type': 'diesel',
'id': '42faee34-d0da-5db2-9cd5-5cbb3913290d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS47068',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 197112,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-17',
'seller_name': None,
'title': 'BMW 5er 525d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2014}
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS47068%27 HTTP/1.1" 200 None
2026-03-29 18:35:23 [auto1.de] INFO: Saving data for DS47068: {'auction_closing_time': 1774885795.0, 'created_time': 1773399504.68243, 'last_price_update_time': 1774809323.431467}
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS47068') HTTP/1.1" 204 0
2026-03-29 18:35:23 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC50657%27 HTTP/1.1" 200 None
2026-03-29 18:35:23 [auto1.de] INFO: Scrape type for DC50657: 0
2026-03-29 18:35:23 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-29 18:35:23 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-29 18:35:23 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-29 18:35:23 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-29 18:35:23 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-29 18:35:23 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-29 18:35:23 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX10113%27 HTTP/1.1" 200 None
2026-03-29 18:35:23 [auto1.de] INFO: Scrape type for UX10113: 2
2026-03-29 18:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3889fa25-cc75-583f-8264-4a13d76c1e8a with identifier: UX10113
2026-03-29 18:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3889fa25-cc75-583f-8264-4a13d76c1e8a with scrape type 2
2026-03-29 18:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3889fa25-cc75-583f-8264-4a13d76c1e8a with scrape type 2
2026-03-29 18:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3889fa25-cc75-583f-8264-4a13d76c1e8a, identifier: UX10113
2026-03-29 18:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3889fa25-cc75-583f-8264-4a13d76c1e8a with identifier: UX10113
2026-03-29 18:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3889fa25-cc75-583f-8264-4a13d76c1e8a with identifier: UX10113
2026-03-29 18:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3889fa25-cc75-583f-8264-4a13d76c1e8a with identifier: UX10113 to the API
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:09:05Z',
'fuel_type': 'petrol',
'id': '3889fa25-cc75-583f-8264-4a13d76c1e8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX10113',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 79272,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-21',
'seller_name': None,
'title': 'Dacia Duster 1.6 Ice 4x2',
'transmission': 'manual',
'trim': 'Ice 4x2',
'year': 2015}
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX10113%27 HTTP/1.1" 200 None
2026-03-29 18:35:23 [auto1.de] INFO: Saving data for UX10113: {'auction_closing_time': 1774883345.0, 'created_time': 1773859798.68633, 'last_price_update_time': 1774809323.916312}
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX10113') HTTP/1.1" 204 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77842%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for LC77842: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78558%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for YF78558: 2
2026-03-29 18:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with identifier: YF78558
2026-03-29 18:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with scrape type 2
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with scrape type 2
2026-03-29 18:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 209a5d1e-9028-5d3b-b29a-2381b4e0f067, identifier: YF78558
2026-03-29 18:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with identifier: YF78558
2026-03-29 18:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with identifier: YF78558
2026-03-29 18:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with identifier: YF78558 to the API
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:20:19Z',
'fuel_type': 'diesel',
'id': '209a5d1e-9028-5d3b-b29a-2381b4e0f067',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF78558',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 244679,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-15',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2014}
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78558%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Saving data for YF78558: {'auction_closing_time': 1774884019.0, 'created_time': 1774607831.562437, 'last_price_update_time': 1774809324.498617}
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF78558') HTTP/1.1" 204 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS73974%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for MS73974: 2
2026-03-29 18:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with identifier: MS73974
2026-03-29 18:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with scrape type 2
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with scrape type 2
2026-03-29 18:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95f2dc29-fad0-5f6f-84fb-346c1535ef71, identifier: MS73974
2026-03-29 18:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with identifier: MS73974
2026-03-29 18:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with identifier: MS73974
2026-03-29 18:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with identifier: MS73974 to the API
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:23:34Z',
'fuel_type': 'diesel',
'id': '95f2dc29-fad0-5f6f-84fb-346c1535ef71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS73974',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 156030,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-08',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2013}
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS73974%27 HTTP/1.1" 200 None
2026-03-29 18:35:25 [auto1.de] INFO: Saving data for MS73974: {'auction_closing_time': 1774884214.0, 'created_time': 1773230356.63605, 'last_price_update_time': 1774809325.000654}
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS73974') HTTP/1.1" 204 0
2026-03-29 18:35:25 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-29 18:35:25 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE35535%27 HTTP/1.1" 200 None
2026-03-29 18:35:25 [auto1.de] INFO: Scrape type for TE35535: 0
2026-03-29 18:35:25 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-29 18:35:25 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-29 18:35:25 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:25 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE26333%27 HTTP/1.1" 200 None
2026-03-29 18:35:25 [auto1.de] INFO: Scrape type for XE26333: 2
2026-03-29 18:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d759cfc9-b2e2-50e0-84ab-45e2145608f2 with identifier: XE26333
2026-03-29 18:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d759cfc9-b2e2-50e0-84ab-45e2145608f2 with scrape type 2
2026-03-29 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d759cfc9-b2e2-50e0-84ab-45e2145608f2 with scrape type 2
2026-03-29 18:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d759cfc9-b2e2-50e0-84ab-45e2145608f2, identifier: XE26333
2026-03-29 18:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d759cfc9-b2e2-50e0-84ab-45e2145608f2 with identifier: XE26333
2026-03-29 18:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d759cfc9-b2e2-50e0-84ab-45e2145608f2 with identifier: XE26333
2026-03-29 18:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d759cfc9-b2e2-50e0-84ab-45e2145608f2 with identifier: XE26333 to the API
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:53:22Z',
'fuel_type': 'diesel',
'id': 'd759cfc9-b2e2-50e0-84ab-45e2145608f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE26333',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 187267,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-26',
'seller_name': None,
'title': 'Volkswagen Golf Plus 2.0 TDI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2012}
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE26333%27 HTTP/1.1" 200 None
2026-03-29 18:35:25 [auto1.de] INFO: Saving data for XE26333: {'auction_closing_time': 1774886002.0, 'created_time': 1773772239.073326, 'last_price_update_time': 1774809325.488004}
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE26333') HTTP/1.1" 204 0
2026-03-29 18:35:25 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-29 18:35:25 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68666%27 HTTP/1.1" 200 None
2026-03-29 18:35:25 [auto1.de] INFO: Scrape type for NX68666: 2
2026-03-29 18:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0edef07e-dd48-59ca-bd0d-b906c2156b4e with identifier: NX68666
2026-03-29 18:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0edef07e-dd48-59ca-bd0d-b906c2156b4e with scrape type 2
2026-03-29 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0edef07e-dd48-59ca-bd0d-b906c2156b4e with scrape type 2
2026-03-29 18:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0edef07e-dd48-59ca-bd0d-b906c2156b4e, identifier: NX68666
2026-03-29 18:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0edef07e-dd48-59ca-bd0d-b906c2156b4e with identifier: NX68666
2026-03-29 18:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0edef07e-dd48-59ca-bd0d-b906c2156b4e with identifier: NX68666
2026-03-29 18:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0edef07e-dd48-59ca-bd0d-b906c2156b4e with identifier: NX68666 to the API
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:18:01Z',
'fuel_type': 'diesel',
'id': '0edef07e-dd48-59ca-bd0d-b906c2156b4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX68666',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 257580,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-03',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2014}
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68666%27 HTTP/1.1" 200 None
2026-03-29 18:35:25 [auto1.de] INFO: Saving data for NX68666: {'auction_closing_time': 1774883881.0, 'created_time': 1773306693.534233, 'last_price_update_time': 1774809325.938229}
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX68666') HTTP/1.1" 204 0
2026-03-29 18:35:26 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK13717%27 HTTP/1.1" 200 None
2026-03-29 18:35:26 [auto1.de] INFO: Scrape type for RK13717: 2
2026-03-29 18:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8821174b-8858-519f-b316-aa8a59f896ba with identifier: RK13717
2026-03-29 18:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8821174b-8858-519f-b316-aa8a59f896ba with scrape type 2
2026-03-29 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8821174b-8858-519f-b316-aa8a59f896ba with scrape type 2
2026-03-29 18:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8821174b-8858-519f-b316-aa8a59f896ba, identifier: RK13717
2026-03-29 18:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8821174b-8858-519f-b316-aa8a59f896ba with identifier: RK13717
2026-03-29 18:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8821174b-8858-519f-b316-aa8a59f896ba with identifier: RK13717
2026-03-29 18:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8821174b-8858-519f-b316-aa8a59f896ba with identifier: RK13717 to the API
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:39:49Z',
'fuel_type': 'petrol',
'id': '8821174b-8858-519f-b316-aa8a59f896ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK13717',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 75633,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-25',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Vignale',
'transmission': 'manual',
'trim': 'Vignale',
'year': 2020}
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK13717%27 HTTP/1.1" 200 None
2026-03-29 18:35:26 [auto1.de] INFO: Saving data for RK13717: {'auction_closing_time': 1774885189.0, 'created_time': 1774522316.792286, 'last_price_update_time': 1774809326.444789}
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK13717') HTTP/1.1" 204 0
2026-03-29 18:35:26 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91395%27 HTTP/1.1" 200 None
2026-03-29 18:35:26 [auto1.de] INFO: Scrape type for EL91395: 0
2026-03-29 18:35:26 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-29 18:35:26 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN65444%27 HTTP/1.1" 200 None
2026-03-29 18:35:26 [auto1.de] INFO: Scrape type for KN65444: 2
2026-03-29 18:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4a209ed-c1ec-58e8-8243-fd471eaa4511 with identifier: KN65444
2026-03-29 18:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4a209ed-c1ec-58e8-8243-fd471eaa4511 with scrape type 2
2026-03-29 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4a209ed-c1ec-58e8-8243-fd471eaa4511 with scrape type 2
2026-03-29 18:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4a209ed-c1ec-58e8-8243-fd471eaa4511, identifier: KN65444
2026-03-29 18:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4a209ed-c1ec-58e8-8243-fd471eaa4511 with identifier: KN65444
2026-03-29 18:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4a209ed-c1ec-58e8-8243-fd471eaa4511 with identifier: KN65444
2026-03-29 18:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4a209ed-c1ec-58e8-8243-fd471eaa4511 with identifier: KN65444 to the API
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 261,
'expiration_date': '2026-03-30T15:54:12Z',
'fuel_type': 'hybrid',
'id': 'a4a209ed-c1ec-58e8-8243-fd471eaa4511',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN65444',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 47574,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-31',
'seller_name': None,
'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Inscription 2WD',
'transmission': 'automatic',
'trim': 'Inscription 2WD',
'year': 2021}
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN65444%27 HTTP/1.1" 200 None
2026-03-29 18:35:26 [auto1.de] INFO: Saving data for KN65444: {'auction_closing_time': 1774886052.0, 'created_time': 1774290894.901808, 'last_price_update_time': 1774809326.926486}
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN65444') HTTP/1.1" 204 0
2026-03-29 18:35:26 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-29 18:35:26 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB01944%27 HTTP/1.1" 200 None
2026-03-29 18:35:26 [auto1.de] INFO: Scrape type for EB01944: 2
2026-03-29 18:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with identifier: EB01944
2026-03-29 18:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with scrape type 2
2026-03-29 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with scrape type 2
2026-03-29 18:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebe88af6-9a60-5dfe-a689-4ef75fbf16e1, identifier: EB01944
2026-03-29 18:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with identifier: EB01944
2026-03-29 18:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with identifier: EB01944
2026-03-29 18:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with identifier: EB01944 to the API
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:47:10Z',
'fuel_type': 'petrol',
'id': 'ebe88af6-9a60-5dfe-a689-4ef75fbf16e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB01944',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 87327,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-13',
'seller_name': None,
'title': 'BMW 1er 114i',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB01944%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Saving data for EB01944: {'auction_closing_time': 1774885630.0, 'created_time': 1773136467.123687, 'last_price_update_time': 1774809327.402225}
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB01944') HTTP/1.1" 204 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX08499%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for SX08499: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96368%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for TR96368: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ99986%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for NJ99986: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM66171%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for KM66171: 2
2026-03-29 18:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9bd72b3-bf31-54d5-8033-a5b253fd8afe with identifier: KM66171
2026-03-29 18:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9bd72b3-bf31-54d5-8033-a5b253fd8afe with scrape type 2
2026-03-29 18:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9bd72b3-bf31-54d5-8033-a5b253fd8afe with scrape type 2
2026-03-29 18:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9bd72b3-bf31-54d5-8033-a5b253fd8afe, identifier: KM66171
2026-03-29 18:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9bd72b3-bf31-54d5-8033-a5b253fd8afe with identifier: KM66171
2026-03-29 18:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9bd72b3-bf31-54d5-8033-a5b253fd8afe with identifier: KM66171
2026-03-29 18:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9bd72b3-bf31-54d5-8033-a5b253fd8afe with identifier: KM66171 to the API
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:30:18Z',
'fuel_type': 'petrol',
'id': 'e9bd72b3-bf31-54d5-8033-a5b253fd8afe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM66171',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 93938,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-29',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
'transmission': 'manual',
'trim': 'BlueEfficiency Urban',
'year': 2016}
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM66171%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Saving data for KM66171: {'auction_closing_time': 1774884618.0, 'created_time': 1773134586.161787, 'last_price_update_time': 1774809327.930068}
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM66171') HTTP/1.1" 204 0
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU73668%27 HTTP/1.1" 200 None
2026-03-29 18:35:28 [auto1.de] INFO: Scrape type for TU73668: 2
2026-03-29 18:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4 with identifier: TU73668
2026-03-29 18:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4 with scrape type 2
2026-03-29 18:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4 with scrape type 2
2026-03-29 18:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4, identifier: TU73668
2026-03-29 18:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4 with identifier: TU73668
2026-03-29 18:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4 with identifier: TU73668
2026-03-29 18:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4 with identifier: TU73668 to the API
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-30T15:34:24Z',
'fuel_type': 'petrol',
'id': 'ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU73668',
'listing': 'auction',
'make': 'Audi',
'model': 'S5 Sportback',
'odometer': 169049,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-30',
'seller_name': None,
'title': 'Audi S5 Sportback 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2010}
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU73668%27 HTTP/1.1" 200 None
2026-03-29 18:35:28 [auto1.de] INFO: Saving data for TU73668: {'auction_closing_time': 1774884864.0, 'created_time': 1773224092.670537, 'last_price_update_time': 1774809328.440215}
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU73668') HTTP/1.1" 204 0
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT08625%27 HTTP/1.1" 200 None
2026-03-29 18:35:28 [auto1.de] INFO: Scrape type for PT08625: 2
2026-03-29 18:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with identifier: PT08625
2026-03-29 18:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with scrape type 2
2026-03-29 18:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with scrape type 2
2026-03-29 18:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b65ed8c8-5731-5d43-aac3-c0d408dd8f9d, identifier: PT08625
2026-03-29 18:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with identifier: PT08625
2026-03-29 18:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with identifier: PT08625
2026-03-29 18:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with identifier: PT08625 to the API
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:39:46Z',
'fuel_type': 'diesel',
'id': 'b65ed8c8-5731-5d43-aac3-c0d408dd8f9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT08625',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 209275,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-22',
'seller_name': None,
'title': 'Audi A4 35 TDI Mild-Hybrid S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2019}
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT08625%27 HTTP/1.1" 200 None
2026-03-29 18:35:28 [auto1.de] INFO: Saving data for PT08625: {'auction_closing_time': 1774885186.0, 'created_time': 1774290707.975346, 'last_price_update_time': 1774809328.904202}
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT08625') HTTP/1.1" 204 0
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM95018%27 HTTP/1.1" 200 None
2026-03-29 18:35:28 [auto1.de] INFO: Scrape type for HM95018: 0
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR56038%27 HTTP/1.1" 200 None
2026-03-29 18:35:28 [auto1.de] INFO: Scrape type for JR56038: 0
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39643%27 HTTP/1.1" 200 None
2026-03-29 18:35:28 [auto1.de] INFO: Scrape type for ZR39643: 2
2026-03-29 18:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbf69fe3-72fa-518b-85bc-30f2c413c9ff with identifier: ZR39643
2026-03-29 18:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbf69fe3-72fa-518b-85bc-30f2c413c9ff with scrape type 2
2026-03-29 18:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbf69fe3-72fa-518b-85bc-30f2c413c9ff with scrape type 2
2026-03-29 18:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbf69fe3-72fa-518b-85bc-30f2c413c9ff, identifier: ZR39643
2026-03-29 18:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbf69fe3-72fa-518b-85bc-30f2c413c9ff with identifier: ZR39643
2026-03-29 18:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbf69fe3-72fa-518b-85bc-30f2c413c9ff with identifier: ZR39643
2026-03-29 18:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbf69fe3-72fa-518b-85bc-30f2c413c9ff with identifier: ZR39643 to the API
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:45:44Z',
'fuel_type': 'diesel',
'id': 'cbf69fe3-72fa-518b-85bc-30f2c413c9ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR39643',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 310704,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-02',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI Maxi Roncalli',
'transmission': 'manual',
'trim': 'Maxi Roncalli',
'year': 2012}
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39643%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Saving data for ZR39643: {'auction_closing_time': 1774885544.0, 'created_time': 1773859552.325996, 'last_price_update_time': 1774809329.417502}
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR39643') HTTP/1.1" 204 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34004%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for PJ34004: 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65692%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for JL65692: 2
2026-03-29 18:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b602d74-654e-532b-9eea-20ed15e62c97 with identifier: JL65692
2026-03-29 18:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b602d74-654e-532b-9eea-20ed15e62c97 with scrape type 2
2026-03-29 18:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b602d74-654e-532b-9eea-20ed15e62c97 with scrape type 2
2026-03-29 18:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b602d74-654e-532b-9eea-20ed15e62c97, identifier: JL65692
2026-03-29 18:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b602d74-654e-532b-9eea-20ed15e62c97 with identifier: JL65692
2026-03-29 18:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b602d74-654e-532b-9eea-20ed15e62c97 with identifier: JL65692
2026-03-29 18:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b602d74-654e-532b-9eea-20ed15e62c97 with identifier: JL65692 to the API
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:50:16Z',
'fuel_type': 'petrol',
'id': '1b602d74-654e-532b-9eea-20ed15e62c97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL65692',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 82227,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-05',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.0 TSI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2019}
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65692%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Saving data for JL65692: {'auction_closing_time': 1774885816.0, 'created_time': 1774608023.403767, 'last_price_update_time': 1774809329.886426}
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL65692') HTTP/1.1" 204 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37752%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for MX37752: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK79875%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for LK79875: 2
2026-03-29 18:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b86f708b-ed24-5274-b1b7-861ba7a6be0d with identifier: LK79875
2026-03-29 18:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b86f708b-ed24-5274-b1b7-861ba7a6be0d with scrape type 2
2026-03-29 18:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b86f708b-ed24-5274-b1b7-861ba7a6be0d with scrape type 2
2026-03-29 18:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b86f708b-ed24-5274-b1b7-861ba7a6be0d, identifier: LK79875
2026-03-29 18:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b86f708b-ed24-5274-b1b7-861ba7a6be0d with identifier: LK79875
2026-03-29 18:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b86f708b-ed24-5274-b1b7-861ba7a6be0d with identifier: LK79875
2026-03-29 18:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b86f708b-ed24-5274-b1b7-861ba7a6be0d with identifier: LK79875 to the API
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:50:26Z',
'fuel_type': 'petrol',
'id': 'b86f708b-ed24-5274-b1b7-861ba7a6be0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK79875',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 48222,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-12',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2017}
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK79875%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Saving data for LK79875: {'auction_closing_time': 1774885826.0, 'created_time': 1774521909.589608, 'last_price_update_time': 1774809330.39505}
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK79875') HTTP/1.1" 204 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG47249%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for AG47249: 2
2026-03-29 18:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3a6adb2-a393-50b7-8a9a-7045b947086d with identifier: AG47249
2026-03-29 18:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3a6adb2-a393-50b7-8a9a-7045b947086d with scrape type 2
2026-03-29 18:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3a6adb2-a393-50b7-8a9a-7045b947086d with scrape type 2
2026-03-29 18:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3a6adb2-a393-50b7-8a9a-7045b947086d, identifier: AG47249
2026-03-29 18:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3a6adb2-a393-50b7-8a9a-7045b947086d with identifier: AG47249
2026-03-29 18:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3a6adb2-a393-50b7-8a9a-7045b947086d with identifier: AG47249
2026-03-29 18:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3a6adb2-a393-50b7-8a9a-7045b947086d with identifier: AG47249 to the API
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:43:37Z',
'fuel_type': 'diesel',
'id': 'f3a6adb2-a393-50b7-8a9a-7045b947086d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG47249',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 250528,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-11',
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
'transmission': 'automatic',
'trim': 'BlueMotion',
'year': 2013}
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG47249%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Saving data for AG47249: {'auction_closing_time': 1774885417.0, 'created_time': 1773945113.523103, 'last_price_update_time': 1774809330.830701}
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG47249') HTTP/1.1" 204 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK34875%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for LK34875: 0
2026-03-29 18:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:57 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY55649%27 HTTP/1.1" 200 None
2026-03-29 18:35:57 [auto1.de] INFO: Scrape type for EY55649: 0
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB46013%27 HTTP/1.1" 200 None
2026-03-29 18:35:57 [auto1.de] INFO: Scrape type for DB46013: 2
2026-03-29 18:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88abe614-304a-51eb-8deb-bc8dcfc5f306 with identifier: DB46013
2026-03-29 18:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88abe614-304a-51eb-8deb-bc8dcfc5f306 with scrape type 2
2026-03-29 18:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88abe614-304a-51eb-8deb-bc8dcfc5f306 with scrape type 2
2026-03-29 18:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88abe614-304a-51eb-8deb-bc8dcfc5f306, identifier: DB46013
2026-03-29 18:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88abe614-304a-51eb-8deb-bc8dcfc5f306 with identifier: DB46013
2026-03-29 18:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88abe614-304a-51eb-8deb-bc8dcfc5f306 with identifier: DB46013
2026-03-29 18:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88abe614-304a-51eb-8deb-bc8dcfc5f306 with identifier: DB46013 to the API
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:28:30Z',
'fuel_type': 'petrol',
'id': '88abe614-304a-51eb-8deb-bc8dcfc5f306',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB46013',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 170400,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-29',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB46013%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Saving data for DB46013: {'auction_closing_time': 1774884510.0, 'created_time': 1774118784.130635, 'last_price_update_time': 1774809358.428182}
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB46013') HTTP/1.1" 204 0
2026-03-29 18:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB43693%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for XB43693: 2
2026-03-29 18:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b1058e7-4540-5f61-b879-830ee46b1b64 with identifier: XB43693
2026-03-29 18:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b1058e7-4540-5f61-b879-830ee46b1b64 with scrape type 2
2026-03-29 18:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b1058e7-4540-5f61-b879-830ee46b1b64 with scrape type 2
2026-03-29 18:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b1058e7-4540-5f61-b879-830ee46b1b64, identifier: XB43693
2026-03-29 18:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b1058e7-4540-5f61-b879-830ee46b1b64 with identifier: XB43693
2026-03-29 18:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b1058e7-4540-5f61-b879-830ee46b1b64 with identifier: XB43693
2026-03-29 18:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b1058e7-4540-5f61-b879-830ee46b1b64 with identifier: XB43693 to the API
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:42:37Z',
'fuel_type': 'diesel',
'id': '3b1058e7-4540-5f61-b879-830ee46b1b64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB43693',
'listing': 'auction',
'make': 'Skoda',
'model': 'Rapid Spaceback',
'odometer': 138253,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-31',
'seller_name': None,
'title': 'Skoda Rapid Spaceback 1.6 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2016}
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB43693%27 HTTP/1.1" 200 None
2026-03-29 18:35:59 [auto1.de] INFO: Saving data for XB43693: {'auction_closing_time': 1774885357.0, 'created_time': 1774294167.329932, 'last_price_update_time': 1774809359.43049}
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB43693') HTTP/1.1" 204 0
2026-03-29 18:35:59 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51376%27 HTTP/1.1" 200 None
2026-03-29 18:35:59 [auto1.de] INFO: Scrape type for ER51376: 0
2026-03-29 18:35:59 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-29 18:35:59 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-29 18:35:59 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS53864%27 HTTP/1.1" 200 None
2026-03-29 18:35:59 [auto1.de] INFO: Scrape type for HS53864: 2
2026-03-29 18:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with identifier: HS53864
2026-03-29 18:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with scrape type 2
2026-03-29 18:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with scrape type 2
2026-03-29 18:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb, identifier: HS53864
2026-03-29 18:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with identifier: HS53864
2026-03-29 18:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with identifier: HS53864
2026-03-29 18:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with identifier: HS53864 to the API
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:07:51Z',
'fuel_type': 'diesel',
'id': '096f9ff6-ff5e-5368-9de9-59b8ac2c74cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS53864',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 190005,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-06',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS53864%27 HTTP/1.1" 200 None
2026-03-29 18:35:59 [auto1.de] INFO: Saving data for HS53864: {'auction_closing_time': 1774883271.0, 'created_time': 1773858670.207965, 'last_price_update_time': 1774809359.876451}
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS53864') HTTP/1.1" 204 0
2026-03-29 18:35:59 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79634%27 HTTP/1.1" 200 None
2026-03-29 18:35:59 [auto1.de] INFO: Scrape type for EU79634: 0
2026-03-29 18:35:59 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR35143%27 HTTP/1.1" 200 None
2026-03-29 18:35:59 [auto1.de] INFO: Scrape type for RR35143: 2
2026-03-29 18:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19654a9a-8fae-5999-901c-6b6b923a2a58 with identifier: RR35143
2026-03-29 18:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19654a9a-8fae-5999-901c-6b6b923a2a58 with scrape type 2
2026-03-29 18:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19654a9a-8fae-5999-901c-6b6b923a2a58 with scrape type 2
2026-03-29 18:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19654a9a-8fae-5999-901c-6b6b923a2a58, identifier: RR35143
2026-03-29 18:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19654a9a-8fae-5999-901c-6b6b923a2a58 with identifier: RR35143
2026-03-29 18:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19654a9a-8fae-5999-901c-6b6b923a2a58 with identifier: RR35143
2026-03-29 18:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19654a9a-8fae-5999-901c-6b6b923a2a58 with identifier: RR35143 to the API
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:01:44Z',
'fuel_type': 'petrol',
'id': '19654a9a-8fae-5999-901c-6b6b923a2a58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR35143',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 152909,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-03',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2008}
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR35143%27 HTTP/1.1" 200 None
2026-03-29 18:36:00 [auto1.de] INFO: Saving data for RR35143: {'auction_closing_time': 1774882904.0, 'created_time': 1774521531.714036, 'last_price_update_time': 1774809360.324633}
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR35143') HTTP/1.1" 204 0
2026-03-29 18:36:00 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW28946%27 HTTP/1.1" 200 None
2026-03-29 18:36:00 [auto1.de] INFO: Scrape type for XW28946: 2
2026-03-29 18:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with identifier: XW28946
2026-03-29 18:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with scrape type 2
2026-03-29 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with scrape type 2
2026-03-29 18:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f5b8b62-6873-5f31-b225-10d311b0e2d9, identifier: XW28946
2026-03-29 18:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with identifier: XW28946
2026-03-29 18:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with identifier: XW28946
2026-03-29 18:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with identifier: XW28946 to the API
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-30T15:23:04Z',
'fuel_type': 'petrol',
'id': '7f5b8b62-6873-5f31-b225-10d311b0e2d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW28946',
'listing': 'auction',
'make': 'Audi',
'model': 'S5 Sportback',
'odometer': 183280,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-27',
'seller_name': None,
'title': 'Audi S5 Sportback 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2013}
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW28946%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Saving data for XW28946: {'auction_closing_time': 1774884184.0, 'created_time': 1773343442.905176, 'last_price_update_time': 1774809361.390223}
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW28946') HTTP/1.1" 204 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96980%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for KJ96980: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20956%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for SK20956: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA39123%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for SA39123: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE03555%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for GE03555: 2
2026-03-29 18:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46f65665-6969-5f21-832f-dc573bc57bd0 with identifier: GE03555
2026-03-29 18:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46f65665-6969-5f21-832f-dc573bc57bd0 with scrape type 2
2026-03-29 18:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46f65665-6969-5f21-832f-dc573bc57bd0 with scrape type 2
2026-03-29 18:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46f65665-6969-5f21-832f-dc573bc57bd0, identifier: GE03555
2026-03-29 18:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46f65665-6969-5f21-832f-dc573bc57bd0 with identifier: GE03555
2026-03-29 18:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46f65665-6969-5f21-832f-dc573bc57bd0 with identifier: GE03555
2026-03-29 18:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46f65665-6969-5f21-832f-dc573bc57bd0 with identifier: GE03555 to the API
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:44:50Z',
'fuel_type': 'petrol',
'id': '46f65665-6969-5f21-832f-dc573bc57bd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE03555',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 115531,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-21',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2019}
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE03555%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Saving data for GE03555: {'auction_closing_time': 1774885490.0, 'created_time': 1773133819.095419, 'last_price_update_time': 1774809361.947909}
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE03555') HTTP/1.1" 204 0
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM98964%27 HTTP/1.1" 200 None
2026-03-29 18:36:02 [auto1.de] INFO: Scrape type for LM98964: 2
2026-03-29 18:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with identifier: LM98964
2026-03-29 18:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with scrape type 2
2026-03-29 18:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with scrape type 2
2026-03-29 18:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a9b852c-e3fa-510a-8343-cfaba76a51c7, identifier: LM98964
2026-03-29 18:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with identifier: LM98964
2026-03-29 18:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with identifier: LM98964
2026-03-29 18:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with identifier: LM98964 to the API
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:10:26Z',
'fuel_type': 'petrol',
'id': '9a9b852c-e3fa-510a-8343-cfaba76a51c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM98964',
'listing': 'auction',
'make': 'Opel',
'model': 'Cascada',
'odometer': 81450,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-01',
'seller_name': None,
'title': 'Opel Cascada 1.4 Turbo Innovation ecoFlex',
'transmission': 'manual',
'trim': 'Innovation ecoFlex',
'year': 2014}
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM98964%27 HTTP/1.1" 200 None
2026-03-29 18:36:02 [auto1.de] INFO: Saving data for LM98964: {'auction_closing_time': 1774883426.0, 'created_time': 1773776027.311036, 'last_price_update_time': 1774809362.504414}
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM98964') HTTP/1.1" 204 0
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB40080%27 HTTP/1.1" 200 None
2026-03-29 18:36:02 [auto1.de] INFO: Scrape type for AB40080: 0
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ98180%27 HTTP/1.1" 200 None
2026-03-29 18:36:02 [auto1.de] INFO: Scrape type for BJ98180: 0
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY37454%27 HTTP/1.1" 200 None
2026-03-29 18:36:02 [auto1.de] INFO: Scrape type for PY37454: 2
2026-03-29 18:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ca81acb-c9ff-5d2d-9523-136f52758484 with identifier: PY37454
2026-03-29 18:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ca81acb-c9ff-5d2d-9523-136f52758484 with scrape type 2
2026-03-29 18:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ca81acb-c9ff-5d2d-9523-136f52758484 with scrape type 2
2026-03-29 18:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ca81acb-c9ff-5d2d-9523-136f52758484, identifier: PY37454
2026-03-29 18:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ca81acb-c9ff-5d2d-9523-136f52758484 with identifier: PY37454
2026-03-29 18:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ca81acb-c9ff-5d2d-9523-136f52758484 with identifier: PY37454
2026-03-29 18:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ca81acb-c9ff-5d2d-9523-136f52758484 with identifier: PY37454 to the API
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:32:19Z',
'fuel_type': 'diesel',
'id': '9ca81acb-c9ff-5d2d-9523-136f52758484',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY37454',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 170687,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-04',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.6 TDI Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2013}
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY37454%27 HTTP/1.1" 200 None
2026-03-29 18:36:03 [auto1.de] INFO: Saving data for PY37454: {'auction_closing_time': 1774884739.0, 'created_time': 1773741999.456181, 'last_price_update_time': 1774809363.057979}
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY37454') HTTP/1.1" 204 0
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ53370%27 HTTP/1.1" 200 None
2026-03-29 18:36:03 [auto1.de] INFO: Scrape type for RZ53370: 0
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN22226%27 HTTP/1.1" 200 None
2026-03-29 18:36:03 [auto1.de] INFO: Scrape type for PN22226: 2
2026-03-29 18:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d4533af-3406-5918-a6b3-59ccde7f674c with identifier: PN22226
2026-03-29 18:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d4533af-3406-5918-a6b3-59ccde7f674c with scrape type 2
2026-03-29 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d4533af-3406-5918-a6b3-59ccde7f674c with scrape type 2
2026-03-29 18:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d4533af-3406-5918-a6b3-59ccde7f674c, identifier: PN22226
2026-03-29 18:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d4533af-3406-5918-a6b3-59ccde7f674c with identifier: PN22226
2026-03-29 18:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d4533af-3406-5918-a6b3-59ccde7f674c with identifier: PN22226
2026-03-29 18:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d4533af-3406-5918-a6b3-59ccde7f674c with identifier: PN22226 to the API
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:58:27Z',
'fuel_type': 'petrol',
'id': '2d4533af-3406-5918-a6b3-59ccde7f674c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN22226',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 180303,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-10-04',
'seller_name': None,
'title': 'Volkswagen Golf V 2.0 TFSI GTI',
'transmission': 'manual',
'trim': 'GTI',
'year': 2006}
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN22226%27 HTTP/1.1" 200 None
2026-03-29 18:36:03 [auto1.de] INFO: Saving data for PN22226: {'auction_closing_time': 1774886307.0, 'created_time': 1774349879.172949, 'last_price_update_time': 1774809363.513519}
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN22226') HTTP/1.1" 204 0
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47160%27 HTTP/1.1" 200 None
2026-03-29 18:36:03 [auto1.de] INFO: Scrape type for YJ47160: 0
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU43225%27 HTTP/1.1" 200 None
2026-03-29 18:36:03 [auto1.de] INFO: Scrape type for GU43225: 2
2026-03-29 18:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with identifier: GU43225
2026-03-29 18:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with scrape type 2
2026-03-29 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with scrape type 2
2026-03-29 18:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6746d2a1-de9d-5b45-a9f4-cae3dd508e58, identifier: GU43225
2026-03-29 18:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with identifier: GU43225
2026-03-29 18:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with identifier: GU43225
2026-03-29 18:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with identifier: GU43225 to the API
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:59:30Z',
'fuel_type': 'diesel',
'id': '6746d2a1-de9d-5b45-a9f4-cae3dd508e58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU43225',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Kombi',
'odometer': 342306,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-07',
'seller_name': None,
'title': 'Volkswagen T6 Kombi 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU43225%27 HTTP/1.1" 200 None
2026-03-29 18:36:04 [auto1.de] INFO: Saving data for GU43225: {'auction_closing_time': 1774886370.0, 'created_time': 1773303802.705745, 'last_price_update_time': 1774809364.126155}
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU43225') HTTP/1.1" 204 0
2026-03-29 18:36:06 [scrapy.extensions.logstats] INFO: Crawled 70 pages (at 5 pages/min), scraped 442 items (at 59 items/min)
2026-03-29 18:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:36:34 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 6740 | hits on page: 40
2026-03-29 18:36:34 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73293%27 HTTP/1.1" 200 None
2026-03-29 18:36:34 [auto1.de] INFO: Scrape type for MR73293: 0
2026-03-29 18:36:34 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG40068%27 HTTP/1.1" 200 None
2026-03-29 18:36:34 [auto1.de] INFO: Scrape type for UG40068: 0
2026-03-29 18:36:34 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS31219%27 HTTP/1.1" 200 None
2026-03-29 18:36:34 [auto1.de] INFO: Scrape type for JS31219: 2
2026-03-29 18:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with identifier: JS31219
2026-03-29 18:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with scrape type 2
2026-03-29 18:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with scrape type 2
2026-03-29 18:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae55bdd6-1a7d-5d33-8f2a-b46dba209687, identifier: JS31219
2026-03-29 18:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with identifier: JS31219
2026-03-29 18:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with identifier: JS31219
2026-03-29 18:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with identifier: JS31219 to the API
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:53:51Z',
'fuel_type': 'diesel',
'id': 'ae55bdd6-1a7d-5d33-8f2a-b46dba209687',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS31219',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 93015,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-27',
'seller_name': None,
'title': 'Opel Meriva 1.7 CDTI 150 Jahre Opel',
'transmission': 'automatic',
'trim': '150 Jahre',
'year': 2012}
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS31219%27 HTTP/1.1" 200 None
2026-03-29 18:36:34 [auto1.de] INFO: Saving data for JS31219: {'auction_closing_time': 1774886031.0, 'created_time': 1773429031.571345, 'last_price_update_time': 1774809394.859451}
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS31219') HTTP/1.1" 204 0
2026-03-29 18:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:34 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-29 18:36:34 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC97155%27 HTTP/1.1" 200 None
2026-03-29 18:36:34 [auto1.de] INFO: Scrape type for BC97155: 0
2026-03-29 18:36:34 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78869%27 HTTP/1.1" 200 None
2026-03-29 18:36:34 [auto1.de] INFO: Scrape type for WG78869: 2
2026-03-29 18:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c245e6af-c309-5511-a47e-0cf99fc5d6e6 with identifier: WG78869
2026-03-29 18:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c245e6af-c309-5511-a47e-0cf99fc5d6e6 with scrape type 2
2026-03-29 18:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c245e6af-c309-5511-a47e-0cf99fc5d6e6 with scrape type 2
2026-03-29 18:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c245e6af-c309-5511-a47e-0cf99fc5d6e6, identifier: WG78869
2026-03-29 18:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c245e6af-c309-5511-a47e-0cf99fc5d6e6 with identifier: WG78869
2026-03-29 18:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c245e6af-c309-5511-a47e-0cf99fc5d6e6 with identifier: WG78869
2026-03-29 18:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c245e6af-c309-5511-a47e-0cf99fc5d6e6 with identifier: WG78869 to the API
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:39:54Z',
'fuel_type': 'diesel',
'id': 'c245e6af-c309-5511-a47e-0cf99fc5d6e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG78869',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 258605,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-05-11',
'seller_name': None,
'title': 'Volkswagen Sharan 1.9 TDI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 1999}
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78869%27 HTTP/1.1" 200 None
2026-03-29 18:36:35 [auto1.de] INFO: Saving data for WG78869: {'auction_closing_time': 1774885194.0, 'created_time': 1774607498.436062, 'last_price_update_time': 1774809395.327086}
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG78869') HTTP/1.1" 204 0
2026-03-29 18:36:35 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-29 18:36:35 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26076%27 HTTP/1.1" 200 None
2026-03-29 18:36:35 [auto1.de] INFO: Scrape type for TF26076: 2
2026-03-29 18:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b8283d1-3454-52ff-8ee7-13387781cc71 with identifier: TF26076
2026-03-29 18:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b8283d1-3454-52ff-8ee7-13387781cc71 with scrape type 2
2026-03-29 18:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b8283d1-3454-52ff-8ee7-13387781cc71 with scrape type 2
2026-03-29 18:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b8283d1-3454-52ff-8ee7-13387781cc71, identifier: TF26076
2026-03-29 18:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b8283d1-3454-52ff-8ee7-13387781cc71 with identifier: TF26076
2026-03-29 18:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b8283d1-3454-52ff-8ee7-13387781cc71 with identifier: TF26076
2026-03-29 18:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b8283d1-3454-52ff-8ee7-13387781cc71 with identifier: TF26076 to the API
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:29:37Z',
'fuel_type': 'hybrid',
'id': '6b8283d1-3454-52ff-8ee7-13387781cc71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF26076',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 37301,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-08',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.4 eHybrid Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2022}
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26076%27 HTTP/1.1" 200 None
2026-03-29 18:36:35 [auto1.de] INFO: Saving data for TF26076: {'auction_closing_time': 1774884577.0, 'created_time': 1773304061.515343, 'last_price_update_time': 1774809395.769886}
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF26076') HTTP/1.1" 204 0
2026-03-29 18:36:35 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR99017%27 HTTP/1.1" 200 None
2026-03-29 18:36:35 [auto1.de] INFO: Scrape type for NR99017: 2
2026-03-29 18:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cf9b14c-e924-55a3-b819-cde7586181d1 with identifier: NR99017
2026-03-29 18:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cf9b14c-e924-55a3-b819-cde7586181d1 with scrape type 2
2026-03-29 18:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cf9b14c-e924-55a3-b819-cde7586181d1 with scrape type 2
2026-03-29 18:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2cf9b14c-e924-55a3-b819-cde7586181d1, identifier: NR99017
2026-03-29 18:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2cf9b14c-e924-55a3-b819-cde7586181d1 with identifier: NR99017
2026-03-29 18:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2cf9b14c-e924-55a3-b819-cde7586181d1 with identifier: NR99017
2026-03-29 18:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2cf9b14c-e924-55a3-b819-cde7586181d1 with identifier: NR99017 to the API
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:48:45Z',
'fuel_type': 'diesel',
'id': '2cf9b14c-e924-55a3-b819-cde7586181d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR99017',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 326974,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-09',
'seller_name': None,
'title': 'Ford Transit 2.2 TDCi 300 L1 Tourneo Trend',
'transmission': 'manual',
'trim': '300 L1 Tourneo Trend',
'year': 2014}
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR99017%27 HTTP/1.1" 200 None
2026-03-29 18:36:36 [auto1.de] INFO: Saving data for NR99017: {'auction_closing_time': 1774885725.0, 'created_time': 1774118883.149503, 'last_price_update_time': 1774809396.306398}
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR99017') HTTP/1.1" 204 0
2026-03-29 18:36:36 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB50510%27 HTTP/1.1" 200 None
2026-03-29 18:36:36 [auto1.de] INFO: Scrape type for HB50510: 2
2026-03-29 18:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with identifier: HB50510
2026-03-29 18:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with scrape type 2
2026-03-29 18:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with scrape type 2
2026-03-29 18:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87059a7e-f606-5f61-8bbf-a97ea7b6f386, identifier: HB50510
2026-03-29 18:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with identifier: HB50510
2026-03-29 18:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with identifier: HB50510
2026-03-29 18:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with identifier: HB50510 to the API
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:21:04Z',
'fuel_type': 'petrol',
'id': '87059a7e-f606-5f61-8bbf-a97ea7b6f386',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB50510',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 125114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-23',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Sound BlueMotion',
'transmission': 'automatic',
'trim': 'Sound BlueMotion',
'year': 2017}
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB50510%27 HTTP/1.1" 200 None
2026-03-29 18:36:36 [auto1.de] INFO: Saving data for HB50510: {'auction_closing_time': 1774884064.0, 'created_time': 1774291665.779535, 'last_price_update_time': 1774809396.747141}
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB50510') HTTP/1.1" 204 0
2026-03-29 18:36:36 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG26326%27 HTTP/1.1" 200 None
2026-03-29 18:36:36 [auto1.de] INFO: Scrape type for VG26326: 2
2026-03-29 18:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2b12821-e98c-521d-9438-a452a39ba8ea with identifier: VG26326
2026-03-29 18:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2b12821-e98c-521d-9438-a452a39ba8ea with scrape type 2
2026-03-29 18:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2b12821-e98c-521d-9438-a452a39ba8ea with scrape type 2
2026-03-29 18:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2b12821-e98c-521d-9438-a452a39ba8ea, identifier: VG26326
2026-03-29 18:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2b12821-e98c-521d-9438-a452a39ba8ea with identifier: VG26326
2026-03-29 18:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2b12821-e98c-521d-9438-a452a39ba8ea with identifier: VG26326
2026-03-29 18:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2b12821-e98c-521d-9438-a452a39ba8ea with identifier: VG26326 to the API
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:09:50Z',
'fuel_type': 'petrol',
'id': 'd2b12821-e98c-521d-9438-a452a39ba8ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG26326',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 129395,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-08',
'seller_name': None,
'title': 'Opel Mokka 1.4 Turbo Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2016}
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG26326%27 HTTP/1.1" 200 None
2026-03-29 18:36:37 [auto1.de] INFO: Saving data for VG26326: {'auction_closing_time': 1774883390.0, 'created_time': 1773859845.04371, 'last_price_update_time': 1774809397.191737}
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG26326') HTTP/1.1" 204 0
2026-03-29 18:36:37 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM19192%27 HTTP/1.1" 200 None
2026-03-29 18:36:37 [auto1.de] INFO: Scrape type for WM19192: 0
2026-03-29 18:36:37 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG31593%27 HTTP/1.1" 200 None
2026-03-29 18:36:37 [auto1.de] INFO: Scrape type for VG31593: 2
2026-03-29 18:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb09a726-8673-56d7-901b-435312ad1eb7 with identifier: VG31593
2026-03-29 18:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb09a726-8673-56d7-901b-435312ad1eb7 with scrape type 2
2026-03-29 18:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb09a726-8673-56d7-901b-435312ad1eb7 with scrape type 2
2026-03-29 18:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb09a726-8673-56d7-901b-435312ad1eb7, identifier: VG31593
2026-03-29 18:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb09a726-8673-56d7-901b-435312ad1eb7 with identifier: VG31593
2026-03-29 18:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb09a726-8673-56d7-901b-435312ad1eb7 with identifier: VG31593
2026-03-29 18:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb09a726-8673-56d7-901b-435312ad1eb7 with identifier: VG31593 to the API
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:01:35Z',
'fuel_type': 'petrol',
'id': 'bb09a726-8673-56d7-901b-435312ad1eb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG31593',
'listing': 'auction',
'make': 'Fiat',
'model': 'Tipo',
'odometer': 62671,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-03',
'seller_name': None,
'title': 'Fiat Tipo 1.4 Turbo Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2017}
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG31593%27 HTTP/1.1" 200 None
2026-03-29 18:36:38 [auto1.de] INFO: Saving data for VG31593: {'auction_closing_time': 1774882895.0, 'created_time': 1773400548.816226, 'last_price_update_time': 1774809398.151604}
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG31593') HTTP/1.1" 204 0
2026-03-29 18:36:38 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-29 18:36:38 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE19276%27 HTTP/1.1" 200 None
2026-03-29 18:36:38 [auto1.de] INFO: Scrape type for EE19276: 2
2026-03-29 18:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with identifier: EE19276
2026-03-29 18:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with scrape type 2
2026-03-29 18:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with scrape type 2
2026-03-29 18:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6, identifier: EE19276
2026-03-29 18:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with identifier: EE19276
2026-03-29 18:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with identifier: EE19276
2026-03-29 18:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with identifier: EE19276 to the API
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 211,
'expiration_date': '2026-03-30T15:27:40Z',
'fuel_type': 'hybrid',
'id': 'bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE19276',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 32219,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-25',
'seller_name': None,
'title': 'Volvo XC40 1.5 T5 Recharge Plug-in Hybrid Inscription 2WD',
'transmission': 'automatic',
'trim': 'Inscription 2WD',
'year': 2020}
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE19276%27 HTTP/1.1" 200 None
2026-03-29 18:36:38 [auto1.de] INFO: Saving data for EE19276: {'auction_closing_time': 1774884460.0, 'created_time': 1773466752.636531, 'last_price_update_time': 1774809398.586267}
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE19276') HTTP/1.1" 204 0
2026-03-29 18:36:38 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT68593%27 HTTP/1.1" 200 None
2026-03-29 18:36:38 [auto1.de] INFO: Scrape type for VT68593: 2
2026-03-29 18:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de50f8cf-9396-5416-9012-dad0e7217281 with identifier: VT68593
2026-03-29 18:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de50f8cf-9396-5416-9012-dad0e7217281 with scrape type 2
2026-03-29 18:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de50f8cf-9396-5416-9012-dad0e7217281 with scrape type 2
2026-03-29 18:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de50f8cf-9396-5416-9012-dad0e7217281, identifier: VT68593
2026-03-29 18:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de50f8cf-9396-5416-9012-dad0e7217281 with identifier: VT68593
2026-03-29 18:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de50f8cf-9396-5416-9012-dad0e7217281 with identifier: VT68593
2026-03-29 18:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de50f8cf-9396-5416-9012-dad0e7217281 with identifier: VT68593 to the API
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:47:41Z',
'fuel_type': 'diesel',
'id': 'de50f8cf-9396-5416-9012-dad0e7217281',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT68593',
'listing': 'auction',
'make': 'Audi',
'model': 'A5',
'odometer': 190377,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-11',
'seller_name': None,
'title': 'Audi A5 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT68593%27 HTTP/1.1" 200 None
2026-03-29 18:36:38 [auto1.de] INFO: Saving data for VT68593: {'auction_closing_time': 1774885661.0, 'created_time': 1774032420.878973, 'last_price_update_time': 1774809398.983055}
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT68593') HTTP/1.1" 204 0
2026-03-29 18:36:38 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM92745%27 HTTP/1.1" 200 None
2026-03-29 18:36:39 [auto1.de] INFO: Scrape type for UM92745: 0
2026-03-29 18:36:39 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-29 18:36:39 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-29 18:36:39 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08912%27 HTTP/1.1" 200 None
2026-03-29 18:36:39 [auto1.de] INFO: Scrape type for YA08912: 2
2026-03-29 18:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with identifier: YA08912
2026-03-29 18:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with scrape type 2
2026-03-29 18:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with scrape type 2
2026-03-29 18:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b, identifier: YA08912
2026-03-29 18:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with identifier: YA08912
2026-03-29 18:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with identifier: YA08912
2026-03-29 18:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with identifier: YA08912 to the API
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:25:10Z',
'fuel_type': 'diesel',
'id': '8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA08912',
'listing': 'auction',
'make': 'Jeep',
'model': 'Grand Cherokee',
'odometer': 130337,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-26',
'seller_name': None,
'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
'transmission': 'automatic',
'trim': 'Overland',
'year': 2013}
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08912%27 HTTP/1.1" 200 None
2026-03-29 18:36:39 [auto1.de] INFO: Saving data for YA08912: {'auction_closing_time': 1774884310.0, 'created_time': 1773830607.538681, 'last_price_update_time': 1774809399.449039}
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA08912') HTTP/1.1" 204 0
2026-03-29 18:36:39 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT19745%27 HTTP/1.1" 200 None
2026-03-29 18:36:39 [auto1.de] INFO: Scrape type for ZT19745: 2
2026-03-29 18:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23c1c00f-e897-5d4d-a512-23f164f7b79c with identifier: ZT19745
2026-03-29 18:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23c1c00f-e897-5d4d-a512-23f164f7b79c with scrape type 2
2026-03-29 18:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23c1c00f-e897-5d4d-a512-23f164f7b79c with scrape type 2
2026-03-29 18:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23c1c00f-e897-5d4d-a512-23f164f7b79c, identifier: ZT19745
2026-03-29 18:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23c1c00f-e897-5d4d-a512-23f164f7b79c with identifier: ZT19745
2026-03-29 18:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23c1c00f-e897-5d4d-a512-23f164f7b79c with identifier: ZT19745
2026-03-29 18:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23c1c00f-e897-5d4d-a512-23f164f7b79c with identifier: ZT19745 to the API
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:59:13Z',
'fuel_type': 'diesel',
'id': '23c1c00f-e897-5d4d-a512-23f164f7b79c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT19745',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 241747,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-08',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT19745%27 HTTP/1.1" 200 None
2026-03-29 18:36:40 [auto1.de] INFO: Saving data for ZT19745: {'auction_closing_time': 1774886353.0, 'created_time': 1772729586.532447, 'last_price_update_time': 1774809400.01662}
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT19745') HTTP/1.1" 204 0
2026-03-29 18:36:40 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-29 18:36:40 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-29 18:36:40 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF43262%27 HTTP/1.1" 200 None
2026-03-29 18:36:40 [auto1.de] INFO: Scrape type for JF43262: 0
2026-03-29 18:36:40 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN67174%27 HTTP/1.1" 200 None
2026-03-29 18:36:40 [auto1.de] INFO: Scrape type for KN67174: 2
2026-03-29 18:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac with identifier: KN67174
2026-03-29 18:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac with scrape type 2
2026-03-29 18:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac with scrape type 2
2026-03-29 18:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac, identifier: KN67174
2026-03-29 18:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac with identifier: KN67174
2026-03-29 18:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac with identifier: KN67174
2026-03-29 18:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac with identifier: KN67174 to the API
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:55:45Z',
'fuel_type': 'petrol',
'id': '488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN67174',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 30709,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-19',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 Mild-Hybrid AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2023}
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN67174%27 HTTP/1.1" 200 None
2026-03-29 18:36:40 [auto1.de] INFO: Saving data for KN67174: {'auction_closing_time': 1774886145.0, 'created_time': 1774636288.00343, 'last_price_update_time': 1774809400.438335}
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN67174') HTTP/1.1" 204 0
2026-03-29 18:36:40 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-29 18:36:40 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72807%27 HTTP/1.1" 200 None
2026-03-29 18:36:40 [auto1.de] INFO: Scrape type for EX72807: 2
2026-03-29 18:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43318222-ef16-5cd0-a232-fd188c04160c with identifier: EX72807
2026-03-29 18:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43318222-ef16-5cd0-a232-fd188c04160c with scrape type 2
2026-03-29 18:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43318222-ef16-5cd0-a232-fd188c04160c with scrape type 2
2026-03-29 18:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43318222-ef16-5cd0-a232-fd188c04160c, identifier: EX72807
2026-03-29 18:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43318222-ef16-5cd0-a232-fd188c04160c with identifier: EX72807
2026-03-29 18:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43318222-ef16-5cd0-a232-fd188c04160c with identifier: EX72807
2026-03-29 18:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43318222-ef16-5cd0-a232-fd188c04160c with identifier: EX72807 to the API
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:06:51Z',
'fuel_type': 'diesel',
'id': '43318222-ef16-5cd0-a232-fd188c04160c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX72807',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 130569,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-07',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2015}
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72807%27 HTTP/1.1" 200 None
2026-03-29 18:36:40 [auto1.de] INFO: Saving data for EX72807: {'auction_closing_time': 1774883211.0, 'created_time': 1773469046.034686, 'last_price_update_time': 1774809400.883766}
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX72807') HTTP/1.1" 204 0
2026-03-29 18:36:40 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 6740 | hits on page: 40
2026-03-29 18:36:40 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL65156%27 HTTP/1.1" 200 None
2026-03-29 18:36:40 [auto1.de] INFO: Scrape type for TL65156: 0
2026-03-29 18:36:40 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP12836%27 HTTP/1.1" 200 None
2026-03-29 18:36:40 [auto1.de] INFO: Scrape type for WP12836: 2
2026-03-29 18:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0be48c5-5924-5b86-8fd7-3a8ee27ed12d with identifier: WP12836
2026-03-29 18:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0be48c5-5924-5b86-8fd7-3a8ee27ed12d with scrape type 2
2026-03-29 18:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0be48c5-5924-5b86-8fd7-3a8ee27ed12d with scrape type 2
2026-03-29 18:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0be48c5-5924-5b86-8fd7-3a8ee27ed12d, identifier: WP12836
2026-03-29 18:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0be48c5-5924-5b86-8fd7-3a8ee27ed12d with identifier: WP12836
2026-03-29 18:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0be48c5-5924-5b86-8fd7-3a8ee27ed12d with identifier: WP12836
2026-03-29 18:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0be48c5-5924-5b86-8fd7-3a8ee27ed12d with identifier: WP12836 to the API
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:18:39Z',
'fuel_type': 'diesel',
'id': 'e0be48c5-5924-5b86-8fd7-3a8ee27ed12d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP12836',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 94396,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-16',
'seller_name': None,
'title': 'Audi A5 Sportback 2.0 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP12836%27 HTTP/1.1" 200 None
2026-03-29 18:36:41 [auto1.de] INFO: Saving data for WP12836: {'auction_closing_time': 1774883919.0, 'created_time': 1774636319.587869, 'last_price_update_time': 1774809401.391532}
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP12836') HTTP/1.1" 204 0
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65179%27 HTTP/1.1" 200 None
2026-03-29 18:36:41 [auto1.de] INFO: Scrape type for AH65179: 0
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: US78573
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB50627%27 HTTP/1.1" 200 None
2026-03-29 18:36:41 [auto1.de] INFO: Scrape type for JB50627: 2
2026-03-29 18:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3a60d5d-d546-5d35-af3e-39a75b65a2fd with identifier: JB50627
2026-03-29 18:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3a60d5d-d546-5d35-af3e-39a75b65a2fd with scrape type 2
2026-03-29 18:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3a60d5d-d546-5d35-af3e-39a75b65a2fd with scrape type 2
2026-03-29 18:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3a60d5d-d546-5d35-af3e-39a75b65a2fd, identifier: JB50627
2026-03-29 18:36:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE62435%27 HTTP/1.1" 200 None
2026-03-29 18:36:41 [auto1.de] INFO: Scrape type for NE62435: 0
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84470%27 HTTP/1.1" 200 None
2026-03-29 18:36:41 [auto1.de] INFO: Scrape type for CK84470: 0
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-29 18:36:41 [auto1.de] INFO: Scrape type for GB59587: 2
2026-03-29 18:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12903823-e98d-5fff-a95d-ef898ad9f779 with identifier: GB59587
2026-03-29 18:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12903823-e98d-5fff-a95d-ef898ad9f779 with scrape type 2
2026-03-29 18:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12903823-e98d-5fff-a95d-ef898ad9f779 with scrape type 2
2026-03-29 18:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12903823-e98d-5fff-a95d-ef898ad9f779, identifier: GB59587
2026-03-29 18:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3a60d5d-d546-5d35-af3e-39a75b65a2fd with identifier: JB50627
2026-03-29 18:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3a60d5d-d546-5d35-af3e-39a75b65a2fd with identifier: JB50627
2026-03-29 18:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3a60d5d-d546-5d35-af3e-39a75b65a2fd with identifier: JB50627 to the API
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:21:20Z',
'fuel_type': 'diesel',
'id': 'a3a60d5d-d546-5d35-af3e-39a75b65a2fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB50627',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 202081,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-27',
'seller_name': None,
'title': 'Audi A1 2.0 TDI S line Sportpaket',
'transmission': 'manual',
'trim': 'S line Sportpaket',
'year': 2012}
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB50627%27 HTTP/1.1" 200 None
2026-03-29 18:36:41 [auto1.de] INFO: Saving data for JB50627: {'auction_closing_time': 1774884080.0, 'created_time': 1773467432.011045, 'last_price_update_time': 1774809401.983019}
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB50627') HTTP/1.1" 204 0
2026-03-29 18:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12903823-e98d-5fff-a95d-ef898ad9f779 with identifier: GB59587
2026-03-29 18:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12903823-e98d-5fff-a95d-ef898ad9f779 with identifier: GB59587
2026-03-29 18:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12903823-e98d-5fff-a95d-ef898ad9f779 with identifier: GB59587 to the API
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:29:55Z',
'fuel_type': 'diesel',
'id': '12903823-e98d-5fff-a95d-ef898ad9f779',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB59587',
'listing': 'auction',
'make': 'MINI',
'model': 'Clubman',
'odometer': 93177,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-11',
'seller_name': None,
'title': 'MINI Clubman Cooper SD',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-29 18:36:42 [auto1.de] INFO: Saving data for GB59587: {'auction_closing_time': 1774884595.0, 'created_time': 1774607699.442725, 'last_price_update_time': 1774809402.420237}
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB59587') HTTP/1.1" 204 0
2026-03-29 18:36:42 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-29 18:36:42 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-29 18:36:42 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10562%27 HTTP/1.1" 200 None
2026-03-29 18:36:42 [auto1.de] INFO: Scrape type for HR10562: 0
2026-03-29 18:36:42 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST57334%27 HTTP/1.1" 200 None
2026-03-29 18:36:42 [auto1.de] INFO: Scrape type for ST57334: 2
2026-03-29 18:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b112174-d592-554e-a407-4790f8c9a958 with identifier: ST57334
2026-03-29 18:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b112174-d592-554e-a407-4790f8c9a958 with scrape type 2
2026-03-29 18:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b112174-d592-554e-a407-4790f8c9a958 with scrape type 2
2026-03-29 18:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b112174-d592-554e-a407-4790f8c9a958, identifier: ST57334
2026-03-29 18:36:42 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-29 18:36:42 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-29 18:36:42 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM56481%27 HTTP/1.1" 200 None
2026-03-29 18:36:42 [auto1.de] INFO: Scrape type for FM56481: 2
2026-03-29 18:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67e91dfa-05b5-5d14-bad5-256387ac454b with identifier: FM56481
2026-03-29 18:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67e91dfa-05b5-5d14-bad5-256387ac454b with scrape type 2
2026-03-29 18:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67e91dfa-05b5-5d14-bad5-256387ac454b with scrape type 2
2026-03-29 18:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67e91dfa-05b5-5d14-bad5-256387ac454b, identifier: FM56481
2026-03-29 18:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b112174-d592-554e-a407-4790f8c9a958 with identifier: ST57334
2026-03-29 18:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b112174-d592-554e-a407-4790f8c9a958 with identifier: ST57334
2026-03-29 18:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b112174-d592-554e-a407-4790f8c9a958 with identifier: ST57334 to the API
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:30:47Z',
'fuel_type': 'diesel',
'id': '1b112174-d592-554e-a407-4790f8c9a958',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST57334',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 428121,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-02',
'seller_name': None,
'title': 'BMW 5er 530d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST57334%27 HTTP/1.1" 200 None
2026-03-29 18:36:43 [auto1.de] INFO: Saving data for ST57334: {'auction_closing_time': 1774884647.0, 'created_time': 1773302038.931624, 'last_price_update_time': 1774809403.00695}
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST57334') HTTP/1.1" 204 0
2026-03-29 18:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67e91dfa-05b5-5d14-bad5-256387ac454b with identifier: FM56481
2026-03-29 18:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67e91dfa-05b5-5d14-bad5-256387ac454b with identifier: FM56481
2026-03-29 18:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67e91dfa-05b5-5d14-bad5-256387ac454b with identifier: FM56481 to the API
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:54:35Z',
'fuel_type': 'diesel',
'id': '67e91dfa-05b5-5d14-bad5-256387ac454b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM56481',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 224861,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-23',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2015}
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM56481%27 HTTP/1.1" 200 None
2026-03-29 18:36:43 [auto1.de] INFO: Saving data for FM56481: {'auction_closing_time': 1774886075.0, 'created_time': 1774290713.601124, 'last_price_update_time': 1774809403.354582}
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM56481') HTTP/1.1" 204 0
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF39323%27 HTTP/1.1" 200 None
2026-03-29 18:36:43 [auto1.de] INFO: Scrape type for SF39323: 2
2026-03-29 18:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 516bf52b-7d1a-5824-8a78-514fd82ab9be with identifier: SF39323
2026-03-29 18:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 516bf52b-7d1a-5824-8a78-514fd82ab9be with scrape type 2
2026-03-29 18:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 516bf52b-7d1a-5824-8a78-514fd82ab9be with scrape type 2
2026-03-29 18:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 516bf52b-7d1a-5824-8a78-514fd82ab9be, identifier: SF39323
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA60360%27 HTTP/1.1" 200 None
2026-03-29 18:36:43 [auto1.de] INFO: Scrape type for UA60360: 0
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW80627%27 HTTP/1.1" 200 None
2026-03-29 18:36:43 [auto1.de] INFO: Scrape type for PW80627: 0
2026-03-29 18:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 516bf52b-7d1a-5824-8a78-514fd82ab9be with identifier: SF39323
2026-03-29 18:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 516bf52b-7d1a-5824-8a78-514fd82ab9be with identifier: SF39323
2026-03-29 18:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 516bf52b-7d1a-5824-8a78-514fd82ab9be with identifier: SF39323 to the API
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:46:53Z',
'fuel_type': 'diesel',
'id': '516bf52b-7d1a-5824-8a78-514fd82ab9be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF39323',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 214198,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-05-03',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2007}
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF39323%27 HTTP/1.1" 200 None
2026-03-29 18:36:43 [auto1.de] INFO: Saving data for SF39323: {'auction_closing_time': 1774885613.0, 'created_time': 1773341507.645434, 'last_price_update_time': 1774809403.836229}
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF39323') HTTP/1.1" 204 0
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29194%27 HTTP/1.1" 200 None
2026-03-29 18:36:43 [auto1.de] INFO: Scrape type for UF29194: 2
2026-03-29 18:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07eda542-d003-50c0-acf9-c56bfae8e648 with identifier: UF29194
2026-03-29 18:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07eda542-d003-50c0-acf9-c56bfae8e648 with scrape type 2
2026-03-29 18:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07eda542-d003-50c0-acf9-c56bfae8e648 with scrape type 2
2026-03-29 18:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07eda542-d003-50c0-acf9-c56bfae8e648, identifier: UF29194
2026-03-29 18:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07eda542-d003-50c0-acf9-c56bfae8e648 with identifier: UF29194
2026-03-29 18:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07eda542-d003-50c0-acf9-c56bfae8e648 with identifier: UF29194
2026-03-29 18:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07eda542-d003-50c0-acf9-c56bfae8e648 with identifier: UF29194 to the API
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:15:03Z',
'fuel_type': 'diesel',
'id': '07eda542-d003-50c0-acf9-c56bfae8e648',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF29194',
'listing': 'auction',
'make': 'Seat',
'model': 'Altea',
'odometer': 59601,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-16',
'seller_name': None,
'title': 'Seat Altea 1.6 TDI I-Tech Ecomotive',
'transmission': 'manual',
'trim': 'I-Tech Ecomotive',
'year': 2015}
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29194%27 HTTP/1.1" 200 None
2026-03-29 18:36:44 [auto1.de] INFO: Saving data for UF29194: {'auction_closing_time': 1774883703.0, 'created_time': 1773305086.134765, 'last_price_update_time': 1774809404.41101}
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF29194') HTTP/1.1" 204 0
2026-03-29 18:36:44 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN12872%27 HTTP/1.1" 200 None
2026-03-29 18:36:44 [auto1.de] INFO: Scrape type for RN12872: 0
2026-03-29 18:36:44 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-29 18:36:44 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-29 18:36:44 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP24686%27 HTTP/1.1" 200 None
2026-03-29 18:36:44 [auto1.de] INFO: Scrape type for NP24686: 2
2026-03-29 18:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90905aee-f780-51a9-a87d-3ea2591eaa0a with identifier: NP24686
2026-03-29 18:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90905aee-f780-51a9-a87d-3ea2591eaa0a with scrape type 2
2026-03-29 18:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90905aee-f780-51a9-a87d-3ea2591eaa0a with scrape type 2
2026-03-29 18:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90905aee-f780-51a9-a87d-3ea2591eaa0a, identifier: NP24686
2026-03-29 18:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90905aee-f780-51a9-a87d-3ea2591eaa0a with identifier: NP24686
2026-03-29 18:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90905aee-f780-51a9-a87d-3ea2591eaa0a with identifier: NP24686
2026-03-29 18:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90905aee-f780-51a9-a87d-3ea2591eaa0a with identifier: NP24686 to the API
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:02:04Z',
'fuel_type': 'diesel',
'id': '90905aee-f780-51a9-a87d-3ea2591eaa0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP24686',
'listing': 'auction',
'make': 'Audi',
'model': 'A4 Allroad',
'odometer': 250385,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-23',
'seller_name': None,
'title': 'Audi A4 Allroad 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP24686%27 HTTP/1.1" 200 None
2026-03-29 18:36:44 [auto1.de] INFO: Saving data for NP24686: {'auction_closing_time': 1774882924.0, 'created_time': 1773226159.690466, 'last_price_update_time': 1774809404.863171}
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP24686') HTTP/1.1" 204 0
2026-03-29 18:36:44 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-29 18:36:44 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-29 18:36:44 [auto1.de] INFO: Scrape type for NR67134: 2
2026-03-29 18:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with identifier: NR67134
2026-03-29 18:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with scrape type 2
2026-03-29 18:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with scrape type 2
2026-03-29 18:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abcf5d86-8e35-53fe-84a9-cfa0b17efef7, identifier: NR67134
2026-03-29 18:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with identifier: NR67134
2026-03-29 18:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with identifier: NR67134
2026-03-29 18:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with identifier: NR67134 to the API
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:01:37Z',
'fuel_type': 'petrol',
'id': 'abcf5d86-8e35-53fe-84a9-cfa0b17efef7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR67134',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 77732,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-10',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis passion',
'transmission': 'manual',
'trim': 'Basis passion',
'year': 2016}
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-29 18:36:45 [auto1.de] INFO: Saving data for NR67134: {'auction_closing_time': 1774882897.0, 'created_time': 1773830926.891913, 'last_price_update_time': 1774809405.349216}
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR67134') HTTP/1.1" 204 0
2026-03-29 18:36:45 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA40394%27 HTTP/1.1" 200 None
2026-03-29 18:36:45 [auto1.de] INFO: Scrape type for AA40394: 2
2026-03-29 18:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 296f25d4-8556-5d3b-9ea0-338e1f961791 with identifier: AA40394
2026-03-29 18:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 296f25d4-8556-5d3b-9ea0-338e1f961791 with scrape type 2
2026-03-29 18:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 296f25d4-8556-5d3b-9ea0-338e1f961791 with scrape type 2
2026-03-29 18:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 296f25d4-8556-5d3b-9ea0-338e1f961791, identifier: AA40394
2026-03-29 18:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 296f25d4-8556-5d3b-9ea0-338e1f961791 with identifier: AA40394
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-29 18:36:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 296f25d4-8556-5d3b-9ea0-338e1f961791 with identifier: AA40394
2026-03-29 18:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 296f25d4-8556-5d3b-9ea0-338e1f961791 with identifier: AA40394 to the API
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:49:21Z',
'fuel_type': 'diesel',
'id': '296f25d4-8556-5d3b-9ea0-338e1f961791',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA40394',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 116846,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-06',
'seller_name': None,
'title': 'Seat Ateca 2.0 TDI Xcellence 4Drive',
'transmission': 'automatic',
'trim': 'Xcellence 4Drive',
'year': 2018}
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA40394%27 HTTP/1.1" 200 None
2026-03-29 18:36:45 [auto1.de] INFO: Saving data for AA40394: {'auction_closing_time': 1774885761.0, 'created_time': 1773426662.397338, 'last_price_update_time': 1774809405.926103}
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA40394') HTTP/1.1" 204 0
2026-03-29 18:36:46 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM90118%27 HTTP/1.1" 200 None
2026-03-29 18:36:46 [auto1.de] INFO: Scrape type for WM90118: 0
2026-03-29 18:36:46 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD45301%27 HTTP/1.1" 200 None
2026-03-29 18:36:46 [auto1.de] INFO: Scrape type for CD45301: 0
2026-03-29 18:36:46 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-29 18:36:46 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-29 18:36:46 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD77905%27 HTTP/1.1" 200 None
2026-03-29 18:36:46 [auto1.de] INFO: Scrape type for WD77905: 2
2026-03-29 18:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07d51b98-8420-5bdb-879c-0e5f42d78048 with identifier: WD77905
2026-03-29 18:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07d51b98-8420-5bdb-879c-0e5f42d78048 with scrape type 2
2026-03-29 18:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07d51b98-8420-5bdb-879c-0e5f42d78048 with scrape type 2
2026-03-29 18:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07d51b98-8420-5bdb-879c-0e5f42d78048, identifier: WD77905
2026-03-29 18:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07d51b98-8420-5bdb-879c-0e5f42d78048 with identifier: WD77905
2026-03-29 18:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07d51b98-8420-5bdb-879c-0e5f42d78048 with identifier: WD77905
2026-03-29 18:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07d51b98-8420-5bdb-879c-0e5f42d78048 with identifier: WD77905 to the API
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 250,
'expiration_date': '2026-03-30T15:57:34Z',
'fuel_type': 'petrol',
'id': '07d51b98-8420-5bdb-879c-0e5f42d78048',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD77905',
'listing': 'auction',
'make': 'Porsche',
'model': '911',
'odometer': 111574,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1991-11-18',
'seller_name': None,
'title': 'Porsche 911 964 Carrera 4',
'transmission': 'manual',
'trim': 'Carrera 4',
'year': 1991}
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD77905%27 HTTP/1.1" 200 None
2026-03-29 18:36:46 [auto1.de] INFO: Saving data for WD77905: {'auction_closing_time': 1774886254.0, 'created_time': 1774377395.585769, 'last_price_update_time': 1774809406.549882}
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD77905') HTTP/1.1" 204 0
2026-03-29 18:36:46 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-29 18:36:46 [auto1.de] INFO: Found listing with ID: XN62659
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN62659%27 HTTP/1.1" 200 None
2026-03-29 18:36:46 [auto1.de] INFO: Scrape type for XN62659: 2
2026-03-29 18:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 643c420a-25fc-5e55-bca9-719cd38a97ef with identifier: XN62659
2026-03-29 18:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 643c420a-25fc-5e55-bca9-719cd38a97ef with scrape type 2
2026-03-29 18:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 643c420a-25fc-5e55-bca9-719cd38a97ef with scrape type 2
2026-03-29 18:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 643c420a-25fc-5e55-bca9-719cd38a97ef, identifier: XN62659
2026-03-29 18:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 643c420a-25fc-5e55-bca9-719cd38a97ef with identifier: XN62659
2026-03-29 18:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 643c420a-25fc-5e55-bca9-719cd38a97ef with identifier: XN62659
2026-03-29 18:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 643c420a-25fc-5e55-bca9-719cd38a97ef with identifier: XN62659 to the API
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:05:08Z',
'fuel_type': 'diesel',
'id': '643c420a-25fc-5e55-bca9-719cd38a97ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN62659',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 70879,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-30',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI Maxi Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Maxi Trendline BlueMotion',
'year': 2019}
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN62659%27 HTTP/1.1" 200 None
2026-03-29 18:36:46 [auto1.de] INFO: Saving data for XN62659: {'auction_closing_time': 1774883108.0, 'created_time': 1773467992.119272, 'last_price_update_time': 1774809406.94921}
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN62659') HTTP/1.1" 204 0
2026-03-29 18:36:46 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK58457%27 HTTP/1.1" 200 None
2026-03-29 18:36:46 [auto1.de] INFO: Scrape type for CK58457: 0
2026-03-29 18:36:46 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM35234%27 HTTP/1.1" 200 None
2026-03-29 18:36:46 [auto1.de] INFO: Scrape type for AM35234: 2
2026-03-29 18:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cc9e197-b56d-5192-be19-93ba901c6034 with identifier: AM35234
2026-03-29 18:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc9e197-b56d-5192-be19-93ba901c6034 with scrape type 2
2026-03-29 18:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cc9e197-b56d-5192-be19-93ba901c6034 with scrape type 2
2026-03-29 18:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cc9e197-b56d-5192-be19-93ba901c6034, identifier: AM35234
2026-03-29 18:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cc9e197-b56d-5192-be19-93ba901c6034 with identifier: AM35234
2026-03-29 18:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cc9e197-b56d-5192-be19-93ba901c6034 with identifier: AM35234
2026-03-29 18:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cc9e197-b56d-5192-be19-93ba901c6034 with identifier: AM35234 to the API
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:31:43Z',
'fuel_type': 'diesel',
'id': '4cc9e197-b56d-5192-be19-93ba901c6034',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM35234',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 233399,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-06',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2016}
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM35234%27 HTTP/1.1" 200 None
2026-03-29 18:36:47 [auto1.de] INFO: Saving data for AM35234: {'auction_closing_time': 1774884703.0, 'created_time': 1774522635.52179, 'last_price_update_time': 1774809407.366824}
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM35234') HTTP/1.1" 204 0
2026-03-29 18:36:47 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 6740 | hits on page: 40
2026-03-29 18:36:47 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-29 18:36:47 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW81308%27 HTTP/1.1" 200 None
2026-03-29 18:36:47 [auto1.de] INFO: Scrape type for HW81308: 0
2026-03-29 18:36:47 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64995%27 HTTP/1.1" 200 None
2026-03-29 18:36:47 [auto1.de] INFO: Scrape type for FT64995: 2
2026-03-29 18:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f126b95-5027-5a84-b75f-b2351277ebd4 with identifier: FT64995
2026-03-29 18:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f126b95-5027-5a84-b75f-b2351277ebd4 with scrape type 2
2026-03-29 18:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f126b95-5027-5a84-b75f-b2351277ebd4 with scrape type 2
2026-03-29 18:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f126b95-5027-5a84-b75f-b2351277ebd4, identifier: FT64995
2026-03-29 18:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f126b95-5027-5a84-b75f-b2351277ebd4 with identifier: FT64995
2026-03-29 18:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f126b95-5027-5a84-b75f-b2351277ebd4 with identifier: FT64995
2026-03-29 18:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f126b95-5027-5a84-b75f-b2351277ebd4 with identifier: FT64995 to the API
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:30:12Z',
'fuel_type': 'petrol',
'id': '8f126b95-5027-5a84-b75f-b2351277ebd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT64995',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 141860,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-06',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 1.4 TSI ACT Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2018}
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64995%27 HTTP/1.1" 200 None
2026-03-29 18:36:47 [auto1.de] INFO: Saving data for FT64995: {'auction_closing_time': 1774884612.0, 'created_time': 1773427432.40136, 'last_price_update_time': 1774809407.852662}
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT64995') HTTP/1.1" 204 0
2026-03-29 18:36:47 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-29 18:36:47 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-29 18:36:47 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81369%27 HTTP/1.1" 200 None
2026-03-29 18:36:47 [auto1.de] INFO: Scrape type for CC81369: 2
2026-03-29 18:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ade8a767-c193-5a42-8ddd-a038d1536bd4 with identifier: CC81369
2026-03-29 18:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ade8a767-c193-5a42-8ddd-a038d1536bd4 with scrape type 2
2026-03-29 18:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ade8a767-c193-5a42-8ddd-a038d1536bd4 with scrape type 2
2026-03-29 18:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ade8a767-c193-5a42-8ddd-a038d1536bd4, identifier: CC81369
2026-03-29 18:36:48 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-29 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY07773%27 HTTP/1.1" 200 None
2026-03-29 18:36:48 [auto1.de] INFO: Scrape type for NY07773: 2
2026-03-29 18:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d831275b-282c-5125-8313-4e3b3d532bee with identifier: NY07773
2026-03-29 18:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d831275b-282c-5125-8313-4e3b3d532bee with scrape type 2
2026-03-29 18:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d831275b-282c-5125-8313-4e3b3d532bee with scrape type 2
2026-03-29 18:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d831275b-282c-5125-8313-4e3b3d532bee, identifier: NY07773
2026-03-29 18:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ade8a767-c193-5a42-8ddd-a038d1536bd4 with identifier: CC81369
2026-03-29 18:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ade8a767-c193-5a42-8ddd-a038d1536bd4 with identifier: CC81369
2026-03-29 18:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ade8a767-c193-5a42-8ddd-a038d1536bd4 with identifier: CC81369 to the API
2026-03-29 18:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:11:08Z',
'fuel_type': 'diesel',
'id': 'ade8a767-c193-5a42-8ddd-a038d1536bd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC81369',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 135660,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-29',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi 340 L1 Trail',
'transmission': 'manual',
'trim': '340 L1 Trail',
'year': 2022}
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81369%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Saving data for CC81369: {'auction_closing_time': 1774883468.0, 'created_time': 1773427441.741455, 'last_price_update_time': 1774809409.136873}
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC81369') HTTP/1.1" 204 0
2026-03-29 18:36:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d831275b-282c-5125-8313-4e3b3d532bee with identifier: NY07773
2026-03-29 18:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d831275b-282c-5125-8313-4e3b3d532bee with identifier: NY07773
2026-03-29 18:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d831275b-282c-5125-8313-4e3b3d532bee with identifier: NY07773 to the API
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:33:23Z',
'fuel_type': 'diesel',
'id': 'd831275b-282c-5125-8313-4e3b3d532bee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY07773',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 77993,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-08',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2020}
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY07773%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Saving data for NY07773: {'auction_closing_time': 1774884803.0, 'created_time': 1773775491.261199, 'last_price_update_time': 1774809409.500034}
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY07773') HTTP/1.1" 204 0
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN57570%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Scrape type for DN57570: 0
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD33755%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Scrape type for PD33755: 2
2026-03-29 18:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with identifier: PD33755
2026-03-29 18:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with scrape type 2
2026-03-29 18:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with scrape type 2
2026-03-29 18:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc787f5f-1bb5-5093-a3d6-9f28304ec9a9, identifier: PD33755
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX03008%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Scrape type for TX03008: 0
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ76690%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Scrape type for RJ76690: 0
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC27977%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Scrape type for MC27977: 0
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU22690%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Scrape type for AU22690: 0
2026-03-29 18:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with identifier: PD33755
2026-03-29 18:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with identifier: PD33755
2026-03-29 18:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with identifier: PD33755 to the API
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:49:42Z',
'fuel_type': 'diesel',
'id': 'fc787f5f-1bb5-5093-a3d6-9f28304ec9a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD33755',
'listing': 'auction',
'make': 'Volvo',
'model': 'V90',
'odometer': 199225,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-27',
'seller_name': None,
'title': 'Volvo V90 2.0 D4 R-Design',
'transmission': 'automatic',
'trim': 'R-Design',
'year': 2018}
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD33755%27 HTTP/1.1" 200 None
2026-03-29 18:36:50 [auto1.de] INFO: Saving data for PD33755: {'auction_closing_time': 1774885782.0, 'created_time': 1773429093.606501, 'last_price_update_time': 1774809410.028755}
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD33755') HTTP/1.1" 204 0
2026-03-29 18:36:50 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP88862%27 HTTP/1.1" 200 None
2026-03-29 18:36:50 [auto1.de] INFO: Scrape type for RP88862: 0
2026-03-29 18:36:50 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-29 18:36:50 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ55484%27 HTTP/1.1" 200 None
2026-03-29 18:36:50 [auto1.de] INFO: Scrape type for HJ55484: 2
2026-03-29 18:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a4352be-c350-58e6-a2e7-0dd00772eb46 with identifier: HJ55484
2026-03-29 18:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a4352be-c350-58e6-a2e7-0dd00772eb46 with scrape type 2
2026-03-29 18:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a4352be-c350-58e6-a2e7-0dd00772eb46 with scrape type 2
2026-03-29 18:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a4352be-c350-58e6-a2e7-0dd00772eb46, identifier: HJ55484
2026-03-29 18:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a4352be-c350-58e6-a2e7-0dd00772eb46 with identifier: HJ55484
2026-03-29 18:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a4352be-c350-58e6-a2e7-0dd00772eb46 with identifier: HJ55484
2026-03-29 18:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a4352be-c350-58e6-a2e7-0dd00772eb46 with identifier: HJ55484 to the API
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:52:02Z',
'fuel_type': 'diesel',
'id': '2a4352be-c350-58e6-a2e7-0dd00772eb46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ55484',
'listing': 'auction',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 283137,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-16',
'seller_name': None,
'title': 'Skoda Karoq 2.0 TDI Style 4x4',
'transmission': 'manual',
'trim': 'Style 4x4',
'year': 2019}
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ55484%27 HTTP/1.1" 200 None
2026-03-29 18:36:50 [auto1.de] INFO: Saving data for HJ55484: {'auction_closing_time': 1774885922.0, 'created_time': 1774350130.575712, 'last_price_update_time': 1774809410.596317}
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ55484') HTTP/1.1" 204 0
2026-03-29 18:36:50 [auto1.de] INFO: Found listing with ID: WD73510
2026-03-29 18:36:50 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-29 18:36:50 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK33721%27 HTTP/1.1" 200 None
2026-03-29 18:36:50 [auto1.de] INFO: Scrape type for BK33721: 2
2026-03-29 18:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 412071c1-bba9-5b08-a0d7-17f78cac9a27 with identifier: BK33721
2026-03-29 18:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 412071c1-bba9-5b08-a0d7-17f78cac9a27 with scrape type 2
2026-03-29 18:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 412071c1-bba9-5b08-a0d7-17f78cac9a27 with scrape type 2
2026-03-29 18:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 412071c1-bba9-5b08-a0d7-17f78cac9a27, identifier: BK33721
2026-03-29 18:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 412071c1-bba9-5b08-a0d7-17f78cac9a27 with identifier: BK33721
2026-03-29 18:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 412071c1-bba9-5b08-a0d7-17f78cac9a27 with identifier: BK33721
2026-03-29 18:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 412071c1-bba9-5b08-a0d7-17f78cac9a27 with identifier: BK33721 to the API
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:50:17Z',
'fuel_type': 'diesel',
'id': '412071c1-bba9-5b08-a0d7-17f78cac9a27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK33721',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 211079,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-13',
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2016}
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK33721%27 HTTP/1.1" 200 None
2026-03-29 18:36:51 [auto1.de] INFO: Saving data for BK33721: {'auction_closing_time': 1774885817.0, 'created_time': 1773302587.986018, 'last_price_update_time': 1774809411.042939}
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK33721') HTTP/1.1" 204 0
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00838%27 HTTP/1.1" 200 None
2026-03-29 18:36:51 [auto1.de] INFO: Scrape type for ZT00838: 2
2026-03-29 18:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d2d3ce8-d539-5ed0-b526-b18f142188d8 with identifier: ZT00838
2026-03-29 18:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d2d3ce8-d539-5ed0-b526-b18f142188d8 with scrape type 2
2026-03-29 18:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d2d3ce8-d539-5ed0-b526-b18f142188d8 with scrape type 2
2026-03-29 18:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d2d3ce8-d539-5ed0-b526-b18f142188d8, identifier: ZT00838
2026-03-29 18:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d2d3ce8-d539-5ed0-b526-b18f142188d8 with identifier: ZT00838
2026-03-29 18:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d2d3ce8-d539-5ed0-b526-b18f142188d8 with identifier: ZT00838
2026-03-29 18:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d2d3ce8-d539-5ed0-b526-b18f142188d8 with identifier: ZT00838 to the API
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:03:22Z',
'fuel_type': 'diesel',
'id': '6d2d3ce8-d539-5ed0-b526-b18f142188d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT00838',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 177313,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-17',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI BlueEfficiency',
'transmission': 'automatic',
'trim': 'BlueEfficiency',
'year': 2013}
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00838%27 HTTP/1.1" 200 None
2026-03-29 18:36:51 [auto1.de] INFO: Saving data for ZT00838: {'auction_closing_time': 1774883002.0, 'created_time': 1774521727.821875, 'last_price_update_time': 1774809411.463797}
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT00838') HTTP/1.1" 204 0
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC03067%27 HTTP/1.1" 200 None
2026-03-29 18:36:51 [auto1.de] INFO: Scrape type for GC03067: 2
2026-03-29 18:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dde58bb-a540-5568-9bfc-591bcadb7d5f with identifier: GC03067
2026-03-29 18:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dde58bb-a540-5568-9bfc-591bcadb7d5f with scrape type 2
2026-03-29 18:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dde58bb-a540-5568-9bfc-591bcadb7d5f with scrape type 2
2026-03-29 18:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2dde58bb-a540-5568-9bfc-591bcadb7d5f, identifier: GC03067
2026-03-29 18:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2dde58bb-a540-5568-9bfc-591bcadb7d5f with identifier: GC03067
2026-03-29 18:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2dde58bb-a540-5568-9bfc-591bcadb7d5f with identifier: GC03067
2026-03-29 18:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2dde58bb-a540-5568-9bfc-591bcadb7d5f with identifier: GC03067 to the API
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:10:59Z',
'fuel_type': 'diesel',
'id': '2dde58bb-a540-5568-9bfc-591bcadb7d5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC03067',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 196755,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-10',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Laurin & Klement',
'transmission': 'automatic',
'trim': 'Laurin & Klement',
'year': 2021}
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC03067%27 HTTP/1.1" 200 None
2026-03-29 18:36:51 [auto1.de] INFO: Saving data for GC03067: {'auction_closing_time': 1774883459.0, 'created_time': 1773859347.042169, 'last_price_update_time': 1774809411.91266}
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC03067') HTTP/1.1" 204 0
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR03591%27 HTTP/1.1" 200 None
2026-03-29 18:36:52 [auto1.de] INFO: Scrape type for UR03591: 0
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW48006%27 HTTP/1.1" 200 None
2026-03-29 18:36:52 [auto1.de] INFO: Scrape type for LW48006: 2
2026-03-29 18:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be57fe57-1e38-5e4b-b705-2522a61a118c with identifier: LW48006
2026-03-29 18:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be57fe57-1e38-5e4b-b705-2522a61a118c with scrape type 2
2026-03-29 18:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be57fe57-1e38-5e4b-b705-2522a61a118c with scrape type 2
2026-03-29 18:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be57fe57-1e38-5e4b-b705-2522a61a118c, identifier: LW48006
2026-03-29 18:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be57fe57-1e38-5e4b-b705-2522a61a118c with identifier: LW48006
2026-03-29 18:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be57fe57-1e38-5e4b-b705-2522a61a118c with identifier: LW48006
2026-03-29 18:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be57fe57-1e38-5e4b-b705-2522a61a118c with identifier: LW48006 to the API
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 292,
'expiration_date': '2026-03-30T15:31:13Z',
'fuel_type': 'hybrid',
'id': 'be57fe57-1e38-5e4b-b705-2522a61a118c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW48006',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 128424,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-28',
'seller_name': None,
'title': 'BMW 5er 530e xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2022}
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW48006%27 HTTP/1.1" 200 None
2026-03-29 18:36:52 [auto1.de] INFO: Saving data for LW48006: {'auction_closing_time': 1774884673.0, 'created_time': 1774510239.333895, 'last_price_update_time': 1774809412.498575}
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW48006') HTTP/1.1" 204 0
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU86214%27 HTTP/1.1" 200 None
2026-03-29 18:36:52 [auto1.de] INFO: Scrape type for MU86214: 0
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL45063%27 HTTP/1.1" 200 None
2026-03-29 18:36:52 [auto1.de] INFO: Scrape type for VL45063: 2
2026-03-29 18:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d with identifier: VL45063
2026-03-29 18:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d with scrape type 2
2026-03-29 18:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d with scrape type 2
2026-03-29 18:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d, identifier: VL45063
2026-03-29 18:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d with identifier: VL45063
2026-03-29 18:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d with identifier: VL45063
2026-03-29 18:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d with identifier: VL45063 to the API
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:27:10Z',
'fuel_type': 'diesel',
'id': 'ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL45063',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 222273,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-22',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2012}
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL45063%27 HTTP/1.1" 200 None
2026-03-29 18:36:52 [auto1.de] INFO: Saving data for VL45063: {'auction_closing_time': 1774884430.0, 'created_time': 1774636362.664369, 'last_price_update_time': 1774809412.954379}
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL45063') HTTP/1.1" 204 0
2026-03-29 18:36:53 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-29 18:36:53 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE80125%27 HTTP/1.1" 200 None
2026-03-29 18:36:53 [auto1.de] INFO: Scrape type for HE80125: 0
2026-03-29 18:36:53 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-29 18:36:53 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-29 18:36:53 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-29 18:36:53 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX88340%27 HTTP/1.1" 200 None
2026-03-29 18:36:53 [auto1.de] INFO: Scrape type for FX88340: 2
2026-03-29 18:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: affa8d52-2496-5d6f-9d30-d541e849270e with identifier: FX88340
2026-03-29 18:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item affa8d52-2496-5d6f-9d30-d541e849270e with scrape type 2
2026-03-29 18:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item affa8d52-2496-5d6f-9d30-d541e849270e with scrape type 2
2026-03-29 18:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: affa8d52-2496-5d6f-9d30-d541e849270e, identifier: FX88340
2026-03-29 18:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: affa8d52-2496-5d6f-9d30-d541e849270e with identifier: FX88340
2026-03-29 18:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: affa8d52-2496-5d6f-9d30-d541e849270e with identifier: FX88340
2026-03-29 18:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: affa8d52-2496-5d6f-9d30-d541e849270e with identifier: FX88340 to the API
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:17:52Z',
'fuel_type': 'diesel',
'id': 'affa8d52-2496-5d6f-9d30-d541e849270e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX88340',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 232965,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-07',
'seller_name': None,
'title': 'Volkswagen Touran 1.6 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2013}
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX88340%27 HTTP/1.1" 200 None
2026-03-29 18:36:53 [auto1.de] INFO: Saving data for FX88340: {'auction_closing_time': 1774883872.0, 'created_time': 1773303813.950314, 'last_price_update_time': 1774809413.53983}
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX88340') HTTP/1.1" 204 0
2026-03-29 18:36:53 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-29 18:36:53 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-29 18:36:53 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-29 18:36:53 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45065%27 HTTP/1.1" 200 None
2026-03-29 18:36:53 [auto1.de] INFO: Scrape type for SZ45065: 0
2026-03-29 18:36:53 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-29 18:36:53 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF33717%27 HTTP/1.1" 200 None
2026-03-29 18:36:53 [auto1.de] INFO: Scrape type for DF33717: 2
2026-03-29 18:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15b31b3d-8574-519b-9c6b-ac57280a7aba with identifier: DF33717
2026-03-29 18:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15b31b3d-8574-519b-9c6b-ac57280a7aba with scrape type 2
2026-03-29 18:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15b31b3d-8574-519b-9c6b-ac57280a7aba with scrape type 2
2026-03-29 18:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15b31b3d-8574-519b-9c6b-ac57280a7aba, identifier: DF33717
2026-03-29 18:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15b31b3d-8574-519b-9c6b-ac57280a7aba with identifier: DF33717
2026-03-29 18:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15b31b3d-8574-519b-9c6b-ac57280a7aba with identifier: DF33717
2026-03-29 18:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15b31b3d-8574-519b-9c6b-ac57280a7aba with identifier: DF33717 to the API
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:20:07Z',
'fuel_type': 'petrol',
'id': '15b31b3d-8574-519b-9c6b-ac57280a7aba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF33717',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 15693,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-17',
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2018}
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF33717%27 HTTP/1.1" 200 None
2026-03-29 18:36:54 [auto1.de] INFO: Saving data for DF33717: {'auction_closing_time': 1774884007.0, 'created_time': 1774117862.39839, 'last_price_update_time': 1774809414.014484}
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF33717') HTTP/1.1" 204 0
2026-03-29 18:36:54 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ96114%27 HTTP/1.1" 200 None
2026-03-29 18:36:54 [auto1.de] INFO: Scrape type for RJ96114: 2
2026-03-29 18:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c783bb02-14be-539e-91af-d66b874db7ea with identifier: RJ96114
2026-03-29 18:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c783bb02-14be-539e-91af-d66b874db7ea with scrape type 2
2026-03-29 18:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c783bb02-14be-539e-91af-d66b874db7ea with scrape type 2
2026-03-29 18:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c783bb02-14be-539e-91af-d66b874db7ea, identifier: RJ96114
2026-03-29 18:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c783bb02-14be-539e-91af-d66b874db7ea with identifier: RJ96114
2026-03-29 18:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c783bb02-14be-539e-91af-d66b874db7ea with identifier: RJ96114
2026-03-29 18:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c783bb02-14be-539e-91af-d66b874db7ea with identifier: RJ96114 to the API
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:12:11Z',
'fuel_type': 'diesel',
'id': 'c783bb02-14be-539e-91af-d66b874db7ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ96114',
'listing': 'auction',
'make': 'Kia',
'model': 'Optima',
'odometer': 97249,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-17',
'seller_name': None,
'title': 'Kia Optima 1.6 CRDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2019}
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ96114%27 HTTP/1.1" 200 None
2026-03-29 18:36:54 [auto1.de] INFO: Saving data for RJ96114: {'auction_closing_time': 1774883531.0, 'created_time': 1774348870.351697, 'last_price_update_time': 1774809414.59275}
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ96114') HTTP/1.1" 204 0
2026-03-29 18:36:54 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 6740 | hits on page: 40
2026-03-29 18:36:54 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR18256%27 HTTP/1.1" 200 None
2026-03-29 18:36:54 [auto1.de] INFO: Scrape type for XR18256: 0
2026-03-29 18:36:54 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-29 18:36:54 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA19754%27 HTTP/1.1" 200 None
2026-03-29 18:36:54 [auto1.de] INFO: Scrape type for PA19754: 0
2026-03-29 18:36:54 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP68485%27 HTTP/1.1" 200 None
2026-03-29 18:36:54 [auto1.de] INFO: Scrape type for MP68485: 2
2026-03-29 18:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8ac424c-007c-5e91-b969-bde01a549264 with identifier: MP68485
2026-03-29 18:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8ac424c-007c-5e91-b969-bde01a549264 with scrape type 2
2026-03-29 18:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8ac424c-007c-5e91-b969-bde01a549264 with scrape type 2
2026-03-29 18:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8ac424c-007c-5e91-b969-bde01a549264, identifier: MP68485
2026-03-29 18:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8ac424c-007c-5e91-b969-bde01a549264 with identifier: MP68485
2026-03-29 18:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8ac424c-007c-5e91-b969-bde01a549264 with identifier: MP68485
2026-03-29 18:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8ac424c-007c-5e91-b969-bde01a549264 with identifier: MP68485 to the API
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 286,
'expiration_date': '2026-03-30T15:45:15Z',
'fuel_type': 'diesel',
'id': 'c8ac424c-007c-5e91-b969-bde01a549264',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP68485',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 191271,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-14',
'seller_name': None,
'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2018}
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP68485%27 HTTP/1.1" 200 None
2026-03-29 18:36:55 [auto1.de] INFO: Saving data for MP68485: {'auction_closing_time': 1774885515.0, 'created_time': 1773224073.49372, 'last_price_update_time': 1774809415.049547}
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP68485') HTTP/1.1" 204 0
2026-03-29 18:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27590%27 HTTP/1.1" 200 None
2026-03-29 18:36:55 [auto1.de] INFO: Scrape type for PE27590: 2
2026-03-29 18:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with identifier: PE27590
2026-03-29 18:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with scrape type 2
2026-03-29 18:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with scrape type 2
2026-03-29 18:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9f8e31a-4bf3-56de-b32f-523fd7d4d402, identifier: PE27590
2026-03-29 18:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with identifier: PE27590
2026-03-29 18:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with identifier: PE27590
2026-03-29 18:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with identifier: PE27590 to the API
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:43:33Z',
'fuel_type': 'diesel',
'id': 'e9f8e31a-4bf3-56de-b32f-523fd7d4d402',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE27590',
'listing': 'auction',
'make': 'Kia',
'model': 'Carens',
'odometer': 134934,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-19',
'seller_name': None,
'title': 'Kia Carens 1.7 CRDi UEFA Euro 2016',
'transmission': 'manual',
'trim': 'UEFA Euro 2016',
'year': 2016}
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27590%27 HTTP/1.1" 200 None
2026-03-29 18:36:55 [auto1.de] INFO: Saving data for PE27590: {'auction_closing_time': 1774885413.0, 'created_time': 1773775233.496432, 'last_price_update_time': 1774809415.515835}
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE27590') HTTP/1.1" 204 0
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ53185%27 HTTP/1.1" 200 None
2026-03-29 18:36:55 [auto1.de] INFO: Scrape type for BZ53185: 0
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR34750%27 HTTP/1.1" 200 None
2026-03-29 18:36:55 [auto1.de] INFO: Scrape type for KR34750: 2
2026-03-29 18:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with identifier: KR34750
2026-03-29 18:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with scrape type 2
2026-03-29 18:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with scrape type 2
2026-03-29 18:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46, identifier: KR34750
2026-03-29 18:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with identifier: KR34750
2026-03-29 18:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with identifier: KR34750
2026-03-29 18:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with identifier: KR34750 to the API
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:19:59Z',
'fuel_type': 'petrol',
'id': '396db2f4-8d9a-5b2b-ba57-f984ed2e0c46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR34750',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 167835,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-31',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2018}
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR34750%27 HTTP/1.1" 200 None
2026-03-29 18:36:56 [auto1.de] INFO: Saving data for KR34750: {'auction_closing_time': 1774883999.0, 'created_time': 1773427340.341182, 'last_price_update_time': 1774809416.106988}
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR34750') HTTP/1.1" 204 0
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC40686%27 HTTP/1.1" 200 None
2026-03-29 18:36:56 [auto1.de] INFO: Scrape type for FC40686: 0
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: US02373
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02373%27 HTTP/1.1" 200 None
2026-03-29 18:36:56 [auto1.de] INFO: Scrape type for US02373: 0
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK90635%27 HTTP/1.1" 200 None
2026-03-29 18:36:56 [auto1.de] INFO: Scrape type for WK90635: 0
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67074%27 HTTP/1.1" 200 None
2026-03-29 18:36:56 [auto1.de] INFO: Scrape type for XY67074: 2
2026-03-29 18:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48de0a42-a8d8-561e-896d-17fc885f5f7b with identifier: XY67074
2026-03-29 18:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48de0a42-a8d8-561e-896d-17fc885f5f7b with scrape type 2
2026-03-29 18:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48de0a42-a8d8-561e-896d-17fc885f5f7b with scrape type 2
2026-03-29 18:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48de0a42-a8d8-561e-896d-17fc885f5f7b, identifier: XY67074
2026-03-29 18:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48de0a42-a8d8-561e-896d-17fc885f5f7b with identifier: XY67074
2026-03-29 18:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48de0a42-a8d8-561e-896d-17fc885f5f7b with identifier: XY67074
2026-03-29 18:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48de0a42-a8d8-561e-896d-17fc885f5f7b with identifier: XY67074 to the API
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:58:32Z',
'fuel_type': 'diesel',
'id': '48de0a42-a8d8-561e-896d-17fc885f5f7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY67074',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 74831,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-11',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TDI IQ.DRIVE',
'transmission': 'automatic',
'trim': 'IQ.DRIVE',
'year': 2019}
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67074%27 HTTP/1.1" 200 None
2026-03-29 18:36:56 [auto1.de] INFO: Saving data for XY67074: {'auction_closing_time': 1774886312.0, 'created_time': 1774636271.056754, 'last_price_update_time': 1774809416.576413}
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY67074') HTTP/1.1" 204 0
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22458%27 HTTP/1.1" 200 None
2026-03-29 18:36:56 [auto1.de] INFO: Scrape type for ZW22458: 0
2026-03-29 18:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:36:57 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 6740 | hits on page: 40
2026-03-29 18:36:57 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT00440%27 HTTP/1.1" 200 None
2026-03-29 18:36:57 [auto1.de] INFO: Scrape type for XT00440: 2
2026-03-29 18:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1451e1b7-7aa0-5e12-b7ed-2adb52534f89 with identifier: XT00440
2026-03-29 18:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1451e1b7-7aa0-5e12-b7ed-2adb52534f89 with scrape type 2
2026-03-29 18:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1451e1b7-7aa0-5e12-b7ed-2adb52534f89 with scrape type 2
2026-03-29 18:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1451e1b7-7aa0-5e12-b7ed-2adb52534f89, identifier: XT00440
2026-03-29 18:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1451e1b7-7aa0-5e12-b7ed-2adb52534f89 with identifier: XT00440
2026-03-29 18:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1451e1b7-7aa0-5e12-b7ed-2adb52534f89 with identifier: XT00440
2026-03-29 18:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1451e1b7-7aa0-5e12-b7ed-2adb52534f89 with identifier: XT00440 to the API
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:27:32Z',
'fuel_type': 'diesel',
'id': '1451e1b7-7aa0-5e12-b7ed-2adb52534f89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT00440',
'listing': 'auction',
'make': 'Volvo',
'model': 'V60 Cross Country',
'odometer': 145271,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-28',
'seller_name': None,
'title': 'Volvo V60 Cross Country 2.0 D4 Plus',
'transmission': 'automatic',
'trim': 'Plus',
'year': 2018}
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT00440%27 HTTP/1.1" 200 None
2026-03-29 18:36:58 [auto1.de] INFO: Saving data for XT00440: {'auction_closing_time': 1774884452.0, 'created_time': 1774522460.119664, 'last_price_update_time': 1774809418.09378}
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT00440') HTTP/1.1" 204 0
2026-03-29 18:36:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:58 [auto1.de] INFO: Found listing with ID: EK13927
2026-03-29 18:36:58 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-29 18:36:58 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-29 18:36:58 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP85983%27 HTTP/1.1" 200 None
2026-03-29 18:36:58 [auto1.de] INFO: Scrape type for DP85983: 0
2026-03-29 18:36:58 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA95549%27 HTTP/1.1" 200 None
2026-03-29 18:36:58 [auto1.de] INFO: Scrape type for KA95549: 0
2026-03-29 18:36:58 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-29 18:36:58 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL51973%27 HTTP/1.1" 200 None
2026-03-29 18:36:58 [auto1.de] INFO: Scrape type for DL51973: 2
2026-03-29 18:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 555db34b-10da-5740-8367-a7dd8e258314 with identifier: DL51973
2026-03-29 18:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 555db34b-10da-5740-8367-a7dd8e258314 with scrape type 2
2026-03-29 18:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 555db34b-10da-5740-8367-a7dd8e258314 with scrape type 2
2026-03-29 18:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 555db34b-10da-5740-8367-a7dd8e258314, identifier: DL51973
2026-03-29 18:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 555db34b-10da-5740-8367-a7dd8e258314 with identifier: DL51973
2026-03-29 18:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 555db34b-10da-5740-8367-a7dd8e258314 with identifier: DL51973
2026-03-29 18:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 555db34b-10da-5740-8367-a7dd8e258314 with identifier: DL51973 to the API
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:15:53Z',
'fuel_type': 'diesel',
'id': '555db34b-10da-5740-8367-a7dd8e258314',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL51973',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 149221,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-02',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 300 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2022}
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL51973%27 HTTP/1.1" 200 None
2026-03-29 18:36:58 [auto1.de] INFO: Saving data for DL51973: {'auction_closing_time': 1774883753.0, 'created_time': 1773945616.111751, 'last_price_update_time': 1774809418.532165}
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL51973') HTTP/1.1" 204 0
2026-03-29 18:36:58 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG27437%27 HTTP/1.1" 200 None
2026-03-29 18:36:58 [auto1.de] INFO: Scrape type for CG27437: 2
2026-03-29 18:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f75f6a61-3768-5130-89b4-e9aea0cb319b with identifier: CG27437
2026-03-29 18:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f75f6a61-3768-5130-89b4-e9aea0cb319b with scrape type 2
2026-03-29 18:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f75f6a61-3768-5130-89b4-e9aea0cb319b with scrape type 2
2026-03-29 18:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f75f6a61-3768-5130-89b4-e9aea0cb319b, identifier: CG27437
2026-03-29 18:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f75f6a61-3768-5130-89b4-e9aea0cb319b with identifier: CG27437
2026-03-29 18:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f75f6a61-3768-5130-89b4-e9aea0cb319b with identifier: CG27437
2026-03-29 18:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f75f6a61-3768-5130-89b4-e9aea0cb319b with identifier: CG27437 to the API
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:01:35Z',
'fuel_type': 'petrol',
'id': 'f75f6a61-3768-5130-89b4-e9aea0cb319b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG27437',
'listing': 'auction',
'make': 'Citroen',
'model': 'C8',
'odometer': 235391,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-23',
'seller_name': None,
'title': 'Citroen C8 2.0 Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2006}
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG27437%27 HTTP/1.1" 200 None
2026-03-29 18:36:58 [auto1.de] INFO: Saving data for CG27437: {'auction_closing_time': 1774882895.0, 'created_time': 1774118381.392202, 'last_price_update_time': 1774809418.984052}
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG27437') HTTP/1.1" 204 0
2026-03-29 18:36:59 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-29 18:36:59 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-29 18:36:59 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW13122%27 HTTP/1.1" 200 None
2026-03-29 18:36:59 [auto1.de] INFO: Scrape type for FW13122: 0
2026-03-29 18:36:59 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-29 18:36:59 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91712%27 HTTP/1.1" 200 None
2026-03-29 18:36:59 [auto1.de] INFO: Scrape type for UE91712: 0
2026-03-29 18:36:59 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW23111%27 HTTP/1.1" 200 None
2026-03-29 18:36:59 [auto1.de] INFO: Scrape type for SW23111: 0
2026-03-29 18:36:59 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM91715%27 HTTP/1.1" 200 None
2026-03-29 18:36:59 [auto1.de] INFO: Scrape type for RM91715: 2
2026-03-29 18:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with identifier: RM91715
2026-03-29 18:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with scrape type 2
2026-03-29 18:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with scrape type 2
2026-03-29 18:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5, identifier: RM91715
2026-03-29 18:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with identifier: RM91715
2026-03-29 18:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with identifier: RM91715
2026-03-29 18:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with identifier: RM91715 to the API
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:35:26Z',
'fuel_type': 'petrol',
'id': '94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM91715',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 154178,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-18',
'seller_name': None,
'title': 'Ford Focus 1.6 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2009}
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM91715%27 HTTP/1.1" 200 None
2026-03-29 18:36:59 [auto1.de] INFO: Saving data for RM91715: {'auction_closing_time': 1774884926.0, 'created_time': 1773772301.289923, 'last_price_update_time': 1774809419.491159}
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM91715') HTTP/1.1" 204 0
2026-03-29 18:36:59 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ30367%27 HTTP/1.1" 200 None
2026-03-29 18:36:59 [auto1.de] INFO: Scrape type for VJ30367: 2
2026-03-29 18:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f2fff70-2fd9-5ab4-9025-64876178bbdc with identifier: VJ30367
2026-03-29 18:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f2fff70-2fd9-5ab4-9025-64876178bbdc with scrape type 2
2026-03-29 18:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f2fff70-2fd9-5ab4-9025-64876178bbdc with scrape type 2
2026-03-29 18:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f2fff70-2fd9-5ab4-9025-64876178bbdc, identifier: VJ30367
2026-03-29 18:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f2fff70-2fd9-5ab4-9025-64876178bbdc with identifier: VJ30367
2026-03-29 18:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f2fff70-2fd9-5ab4-9025-64876178bbdc with identifier: VJ30367
2026-03-29 18:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f2fff70-2fd9-5ab4-9025-64876178bbdc with identifier: VJ30367 to the API
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:14:59Z',
'fuel_type': 'diesel',
'id': '6f2fff70-2fd9-5ab4-9025-64876178bbdc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ30367',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 158168,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-20',
'seller_name': None,
'title': 'Peugeot 308 1.5 Blue-HDi Active Business',
'transmission': 'manual',
'trim': 'Active Business',
'year': 2021}
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ30367%27 HTTP/1.1" 200 None
2026-03-29 18:37:00 [auto1.de] INFO: Saving data for VJ30367: {'auction_closing_time': 1774883699.0, 'created_time': 1774293750.358969, 'last_price_update_time': 1774809420.083922}
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ30367') HTTP/1.1" 204 0
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC27569%27 HTTP/1.1" 200 None
2026-03-29 18:37:00 [auto1.de] INFO: Scrape type for BC27569: 0
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT94626%27 HTTP/1.1" 200 None
2026-03-29 18:37:00 [auto1.de] INFO: Scrape type for JT94626: 2
2026-03-29 18:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac696a5-0f5d-5b48-a71b-7b7370cea606 with identifier: JT94626
2026-03-29 18:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac696a5-0f5d-5b48-a71b-7b7370cea606 with scrape type 2
2026-03-29 18:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aac696a5-0f5d-5b48-a71b-7b7370cea606 with scrape type 2
2026-03-29 18:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aac696a5-0f5d-5b48-a71b-7b7370cea606, identifier: JT94626
2026-03-29 18:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aac696a5-0f5d-5b48-a71b-7b7370cea606 with identifier: JT94626
2026-03-29 18:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aac696a5-0f5d-5b48-a71b-7b7370cea606 with identifier: JT94626
2026-03-29 18:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aac696a5-0f5d-5b48-a71b-7b7370cea606 with identifier: JT94626 to the API
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:38:07Z',
'fuel_type': 'petrol',
'id': 'aac696a5-0f5d-5b48-a71b-7b7370cea606',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT94626',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLK-Klasse',
'odometer': 129958,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-23',
'seller_name': None,
'title': 'Mercedes-Benz GLK-Klasse GLK 280 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2012}
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT94626%27 HTTP/1.1" 200 None
2026-03-29 18:37:00 [auto1.de] INFO: Saving data for JT94626: {'auction_closing_time': 1774885087.0, 'created_time': 1774607685.605237, 'last_price_update_time': 1774809420.581982}
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT94626') HTTP/1.1" 204 0
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS86006%27 HTTP/1.1" 200 None
2026-03-29 18:37:00 [auto1.de] INFO: Scrape type for KS86006: 0
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82914%27 HTTP/1.1" 200 None
2026-03-29 18:37:00 [auto1.de] INFO: Scrape type for MH82914: 0
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ08427%27 HTTP/1.1" 200 None
2026-03-29 18:37:00 [auto1.de] INFO: Scrape type for UZ08427: 0
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF60599%27 HTTP/1.1" 200 None
2026-03-29 18:37:00 [auto1.de] INFO: Scrape type for BF60599: 0
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG83893%27 HTTP/1.1" 200 None
2026-03-29 18:37:00 [auto1.de] INFO: Scrape type for YG83893: 0
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ12441%27 HTTP/1.1" 200 None
2026-03-29 18:37:00 [auto1.de] INFO: Scrape type for WJ12441: 2
2026-03-29 18:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aa33add-c523-5d9f-b634-ff71d39e443d with identifier: WJ12441
2026-03-29 18:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aa33add-c523-5d9f-b634-ff71d39e443d with scrape type 2
2026-03-29 18:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6aa33add-c523-5d9f-b634-ff71d39e443d with scrape type 2
2026-03-29 18:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6aa33add-c523-5d9f-b634-ff71d39e443d, identifier: WJ12441
2026-03-29 18:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6aa33add-c523-5d9f-b634-ff71d39e443d with identifier: WJ12441
2026-03-29 18:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6aa33add-c523-5d9f-b634-ff71d39e443d with identifier: WJ12441
2026-03-29 18:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6aa33add-c523-5d9f-b634-ff71d39e443d with identifier: WJ12441 to the API
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 374,
'expiration_date': '2026-03-30T15:16:28Z',
'fuel_type': 'petrol',
'id': '6aa33add-c523-5d9f-b634-ff71d39e443d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ12441',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 29731,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-05',
'seller_name': None,
'title': 'BMW 4er M440i Gran Coupe Mild-Hybrid xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2022}
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ12441%27 HTTP/1.1" 200 None
2026-03-29 18:37:01 [auto1.de] INFO: Saving data for WJ12441: {'auction_closing_time': 1774883788.0, 'created_time': 1773305269.13445, 'last_price_update_time': 1774809421.136416}
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ12441') HTTP/1.1" 204 0
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-29 18:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:01 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS82829%27 HTTP/1.1" 200 None
2026-03-29 18:37:01 [auto1.de] INFO: Scrape type for NS82829: 0
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN23227%27 HTTP/1.1" 200 None
2026-03-29 18:37:01 [auto1.de] INFO: Scrape type for EN23227: 2
2026-03-29 18:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7fdc29f-84d4-502d-ba1b-2715ea68fff5 with identifier: EN23227
2026-03-29 18:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7fdc29f-84d4-502d-ba1b-2715ea68fff5 with scrape type 2
2026-03-29 18:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7fdc29f-84d4-502d-ba1b-2715ea68fff5 with scrape type 2
2026-03-29 18:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7fdc29f-84d4-502d-ba1b-2715ea68fff5, identifier: EN23227
2026-03-29 18:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7fdc29f-84d4-502d-ba1b-2715ea68fff5 with identifier: EN23227
2026-03-29 18:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7fdc29f-84d4-502d-ba1b-2715ea68fff5 with identifier: EN23227
2026-03-29 18:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7fdc29f-84d4-502d-ba1b-2715ea68fff5 with identifier: EN23227 to the API
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:23:13Z',
'fuel_type': 'diesel',
'id': 'f7fdc29f-84d4-502d-ba1b-2715ea68fff5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN23227',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Captiva',
'odometer': 227738,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-08',
'seller_name': None,
'title': 'Chevrolet Captiva 2.0 Diesel D LT 4WD',
'transmission': 'automatic',
'trim': 'D LT 4WD',
'year': 2008}
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN23227%27 HTTP/1.1" 200 None
2026-03-29 18:37:01 [auto1.de] INFO: Saving data for EN23227: {'auction_closing_time': 1774884193.0, 'created_time': 1774521295.552773, 'last_price_update_time': 1774809421.782928}
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN23227') HTTP/1.1" 204 0
2026-03-29 18:37:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN49518%27 HTTP/1.1" 200 None
2026-03-29 18:37:01 [auto1.de] INFO: Scrape type for DN49518: 2
2026-03-29 18:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25d993b7-e3a1-5b3f-a847-cbcecf935967 with identifier: DN49518
2026-03-29 18:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25d993b7-e3a1-5b3f-a847-cbcecf935967 with scrape type 2
2026-03-29 18:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25d993b7-e3a1-5b3f-a847-cbcecf935967 with scrape type 2
2026-03-29 18:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25d993b7-e3a1-5b3f-a847-cbcecf935967, identifier: DN49518
2026-03-29 18:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25d993b7-e3a1-5b3f-a847-cbcecf935967 with identifier: DN49518
2026-03-29 18:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25d993b7-e3a1-5b3f-a847-cbcecf935967 with identifier: DN49518
2026-03-29 18:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25d993b7-e3a1-5b3f-a847-cbcecf935967 with identifier: DN49518 to the API
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:15:51Z',
'fuel_type': 'petrol',
'id': '25d993b7-e3a1-5b3f-a847-cbcecf935967',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN49518',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 130853,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-31',
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Laureate',
'transmission': 'manual',
'trim': 'Laureate',
'year': 2013}
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN49518%27 HTTP/1.1" 200 None
2026-03-29 18:37:02 [auto1.de] INFO: Saving data for DN49518: {'auction_closing_time': 1774883751.0, 'created_time': 1774636272.491414, 'last_price_update_time': 1774809422.189068}
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN49518') HTTP/1.1" 204 0
2026-03-29 18:37:02 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-29 18:37:02 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-29 18:37:02 [auto1.de] INFO: Found listing with ID: US46384
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US46384%27 HTTP/1.1" 200 None
2026-03-29 18:37:02 [auto1.de] INFO: Scrape type for US46384: 2
2026-03-29 18:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with identifier: US46384
2026-03-29 18:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with scrape type 2
2026-03-29 18:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with scrape type 2
2026-03-29 18:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c68b3be-eb31-58f4-a344-c9ce042e75b8, identifier: US46384
2026-03-29 18:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with identifier: US46384
2026-03-29 18:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with identifier: US46384
2026-03-29 18:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with identifier: US46384 to the API
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:57:54Z',
'fuel_type': 'petrol',
'id': '7c68b3be-eb31-58f4-a344-c9ce042e75b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US46384',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 84954,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-31',
'seller_name': None,
'title': 'BMW X3 xDrive 20i Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2017}
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US46384%27 HTTP/1.1" 200 None
2026-03-29 18:37:02 [auto1.de] INFO: Saving data for US46384: {'auction_closing_time': 1774886274.0, 'created_time': 1773307201.119595, 'last_price_update_time': 1774809422.675436}
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US46384') HTTP/1.1" 204 0
2026-03-29 18:37:02 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-29 18:37:02 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-29 18:37:02 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-29 18:37:02 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-29 18:37:02 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-29 18:37:02 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85584%27 HTTP/1.1" 200 None
2026-03-29 18:37:02 [auto1.de] INFO: Scrape type for XB85584: 2
2026-03-29 18:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60ef623d-3a90-541b-8018-5c676ee4d2ce with identifier: XB85584
2026-03-29 18:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ef623d-3a90-541b-8018-5c676ee4d2ce with scrape type 2
2026-03-29 18:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60ef623d-3a90-541b-8018-5c676ee4d2ce with scrape type 2
2026-03-29 18:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60ef623d-3a90-541b-8018-5c676ee4d2ce, identifier: XB85584
2026-03-29 18:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60ef623d-3a90-541b-8018-5c676ee4d2ce with identifier: XB85584
2026-03-29 18:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60ef623d-3a90-541b-8018-5c676ee4d2ce with identifier: XB85584
2026-03-29 18:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60ef623d-3a90-541b-8018-5c676ee4d2ce with identifier: XB85584 to the API
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:09:32Z',
'fuel_type': 'petrol',
'id': '60ef623d-3a90-541b-8018-5c676ee4d2ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB85584',
'listing': 'auction',
'make': 'Seat',
'model': 'Mii',
'odometer': 201312,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-22',
'seller_name': None,
'title': 'Seat Mii 1.0 Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2014}
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85584%27 HTTP/1.1" 200 None
2026-03-29 18:37:03 [auto1.de] INFO: Saving data for XB85584: {'auction_closing_time': 1774883372.0, 'created_time': 1774607822.817247, 'last_price_update_time': 1774809423.23279}
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB85584') HTTP/1.1" 204 0
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA04600%27 HTTP/1.1" 200 None
2026-03-29 18:37:03 [auto1.de] INFO: Scrape type for RA04600: 0
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG55591%27 HTTP/1.1" 200 None
2026-03-29 18:37:03 [auto1.de] INFO: Scrape type for JG55591: 0
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN16879%27 HTTP/1.1" 200 None
2026-03-29 18:37:03 [auto1.de] INFO: Scrape type for BN16879: 2
2026-03-29 18:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e84b357c-5975-53f1-9428-e9c9406e7413 with identifier: BN16879
2026-03-29 18:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e84b357c-5975-53f1-9428-e9c9406e7413 with scrape type 2
2026-03-29 18:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e84b357c-5975-53f1-9428-e9c9406e7413 with scrape type 2
2026-03-29 18:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e84b357c-5975-53f1-9428-e9c9406e7413, identifier: BN16879
2026-03-29 18:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e84b357c-5975-53f1-9428-e9c9406e7413 with identifier: BN16879
2026-03-29 18:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e84b357c-5975-53f1-9428-e9c9406e7413 with identifier: BN16879
2026-03-29 18:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e84b357c-5975-53f1-9428-e9c9406e7413 with identifier: BN16879 to the API
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:05:06Z',
'fuel_type': 'diesel',
'id': 'e84b357c-5975-53f1-9428-e9c9406e7413',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN16879',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 189540,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-23',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2014}
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN16879%27 HTTP/1.1" 200 None
2026-03-29 18:37:03 [auto1.de] INFO: Saving data for BN16879: {'auction_closing_time': 1774883106.0, 'created_time': 1774292828.516682, 'last_price_update_time': 1774809423.760302}
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN16879') HTTP/1.1" 204 0
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ55553%27 HTTP/1.1" 200 None
2026-03-29 18:37:03 [auto1.de] INFO: Scrape type for PJ55553: 0
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR53064%27 HTTP/1.1" 200 None
2026-03-29 18:37:03 [auto1.de] INFO: Scrape type for WR53064: 0
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH66607%27 HTTP/1.1" 200 None
2026-03-29 18:37:03 [auto1.de] INFO: Scrape type for YH66607: 2
2026-03-29 18:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc7854a1-9a34-5262-ab8e-f74c486c3ad9 with identifier: YH66607
2026-03-29 18:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc7854a1-9a34-5262-ab8e-f74c486c3ad9 with scrape type 2
2026-03-29 18:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc7854a1-9a34-5262-ab8e-f74c486c3ad9 with scrape type 2
2026-03-29 18:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc7854a1-9a34-5262-ab8e-f74c486c3ad9, identifier: YH66607
2026-03-29 18:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc7854a1-9a34-5262-ab8e-f74c486c3ad9 with identifier: YH66607
2026-03-29 18:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc7854a1-9a34-5262-ab8e-f74c486c3ad9 with identifier: YH66607
2026-03-29 18:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc7854a1-9a34-5262-ab8e-f74c486c3ad9 with identifier: YH66607 to the API
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:12:57Z',
'fuel_type': 'diesel',
'id': 'dc7854a1-9a34-5262-ab8e-f74c486c3ad9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH66607',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 116096,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-20',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2017}
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH66607%27 HTTP/1.1" 200 None
2026-03-29 18:37:04 [auto1.de] INFO: Saving data for YH66607: {'auction_closing_time': 1774883577.0, 'created_time': 1774636310.22971, 'last_price_update_time': 1774809424.183592}
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH66607') HTTP/1.1" 204 0
2026-03-29 18:37:04 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-29 18:37:04 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-29 18:37:04 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-29 18:37:04 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-29 18:37:04 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC56654%27 HTTP/1.1" 200 None
2026-03-29 18:37:04 [auto1.de] INFO: Scrape type for MC56654: 2
2026-03-29 18:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with identifier: MC56654
2026-03-29 18:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with scrape type 2
2026-03-29 18:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with scrape type 2
2026-03-29 18:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf, identifier: MC56654
2026-03-29 18:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with identifier: MC56654
2026-03-29 18:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with identifier: MC56654
2026-03-29 18:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with identifier: MC56654 to the API
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:27:14Z',
'fuel_type': 'petrol',
'id': '14d0a9af-cc96-503d-9d3a-9fe700bd2ecf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC56654',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 49058,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-12',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.0 TSI Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2022}
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC56654%27 HTTP/1.1" 200 None
2026-03-29 18:37:04 [auto1.de] INFO: Saving data for MC56654: {'auction_closing_time': 1774884434.0, 'created_time': 1773775223.190521, 'last_price_update_time': 1774809424.768761}
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC56654') HTTP/1.1" 204 0
2026-03-29 18:37:04 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU29174%27 HTTP/1.1" 200 None
2026-03-29 18:37:04 [auto1.de] INFO: Scrape type for VU29174: 0
2026-03-29 18:37:04 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN95717%27 HTTP/1.1" 200 None
2026-03-29 18:37:04 [auto1.de] INFO: Scrape type for SN95717: 0
2026-03-29 18:37:04 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD12559%27 HTTP/1.1" 200 None
2026-03-29 18:37:04 [auto1.de] INFO: Scrape type for BD12559: 2
2026-03-29 18:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e13ac1d5-2b60-5704-b8fc-7a2602846219 with identifier: BD12559
2026-03-29 18:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e13ac1d5-2b60-5704-b8fc-7a2602846219 with scrape type 2
2026-03-29 18:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e13ac1d5-2b60-5704-b8fc-7a2602846219 with scrape type 2
2026-03-29 18:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e13ac1d5-2b60-5704-b8fc-7a2602846219, identifier: BD12559
2026-03-29 18:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e13ac1d5-2b60-5704-b8fc-7a2602846219 with identifier: BD12559
2026-03-29 18:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e13ac1d5-2b60-5704-b8fc-7a2602846219 with identifier: BD12559
2026-03-29 18:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e13ac1d5-2b60-5704-b8fc-7a2602846219 with identifier: BD12559 to the API
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:52:58Z',
'fuel_type': 'diesel',
'id': 'e13ac1d5-2b60-5704-b8fc-7a2602846219',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD12559',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 146014,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-06',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi ST',
'transmission': 'automatic',
'trim': 'ST',
'year': 2017}
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD12559%27 HTTP/1.1" 200 None
2026-03-29 18:37:05 [auto1.de] INFO: Saving data for BD12559: {'auction_closing_time': 1774885978.0, 'created_time': 1773860716.854447, 'last_price_update_time': 1774809425.251986}
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD12559') HTTP/1.1" 204 0
2026-03-29 18:37:05 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-29 18:37:05 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY56514%27 HTTP/1.1" 200 None
2026-03-29 18:37:05 [auto1.de] INFO: Scrape type for CY56514: 2
2026-03-29 18:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with identifier: CY56514
2026-03-29 18:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with scrape type 2
2026-03-29 18:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with scrape type 2
2026-03-29 18:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57e52fdd-5b2a-59c8-abec-7ab9df597f4e, identifier: CY56514
2026-03-29 18:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with identifier: CY56514
2026-03-29 18:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with identifier: CY56514
2026-03-29 18:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with identifier: CY56514 to the API
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:39:04Z',
'fuel_type': 'diesel',
'id': '57e52fdd-5b2a-59c8-abec-7ab9df597f4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY56514',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 221238,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-18',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2014}
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY56514%27 HTTP/1.1" 200 None
2026-03-29 18:37:05 [auto1.de] INFO: Saving data for CY56514: {'auction_closing_time': 1774885144.0, 'created_time': 1773776238.820337, 'last_price_update_time': 1774809425.681665}
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY56514') HTTP/1.1" 204 0
2026-03-29 18:37:05 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-29 18:37:05 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK43665%27 HTTP/1.1" 200 None
2026-03-29 18:37:05 [auto1.de] INFO: Scrape type for DK43665: 0
2026-03-29 18:37:05 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-29 18:37:05 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY95441%27 HTTP/1.1" 200 None
2026-03-29 18:37:05 [auto1.de] INFO: Scrape type for UY95441: 0
2026-03-29 18:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:05 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:05 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC10304%27 HTTP/1.1" 200 None
2026-03-29 18:37:05 [auto1.de] INFO: Scrape type for SC10304: 2
2026-03-29 18:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9cb1bfe-f731-5341-8703-533cfdf0ce58 with identifier: SC10304
2026-03-29 18:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9cb1bfe-f731-5341-8703-533cfdf0ce58 with scrape type 2
2026-03-29 18:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9cb1bfe-f731-5341-8703-533cfdf0ce58 with scrape type 2
2026-03-29 18:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9cb1bfe-f731-5341-8703-533cfdf0ce58, identifier: SC10304
2026-03-29 18:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9cb1bfe-f731-5341-8703-533cfdf0ce58 with identifier: SC10304
2026-03-29 18:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9cb1bfe-f731-5341-8703-533cfdf0ce58 with identifier: SC10304
2026-03-29 18:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9cb1bfe-f731-5341-8703-533cfdf0ce58 with identifier: SC10304 to the API
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:51:12Z',
'fuel_type': 'petrol',
'id': 'e9cb1bfe-f731-5341-8703-533cfdf0ce58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC10304',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 41600,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-09',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 220 4Matic Urban',
'transmission': 'automatic',
'trim': '4Matic Urban',
'year': 2018}
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC10304%27 HTTP/1.1" 200 None
2026-03-29 18:37:06 [auto1.de] INFO: Saving data for SC10304: {'auction_closing_time': 1774885872.0, 'created_time': 1774607753.585845, 'last_price_update_time': 1774809426.411697}
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC10304') HTTP/1.1" 204 0
2026-03-29 18:37:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:06 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ88582%27 HTTP/1.1" 200 None
2026-03-29 18:37:06 [auto1.de] INFO: Scrape type for HZ88582: 2
2026-03-29 18:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb940b5b-3f0d-5733-94c5-107d086c65f2 with identifier: HZ88582
2026-03-29 18:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb940b5b-3f0d-5733-94c5-107d086c65f2 with scrape type 2
2026-03-29 18:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb940b5b-3f0d-5733-94c5-107d086c65f2 with scrape type 2
2026-03-29 18:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb940b5b-3f0d-5733-94c5-107d086c65f2, identifier: HZ88582
2026-03-29 18:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb940b5b-3f0d-5733-94c5-107d086c65f2 with identifier: HZ88582
2026-03-29 18:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb940b5b-3f0d-5733-94c5-107d086c65f2 with identifier: HZ88582
2026-03-29 18:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb940b5b-3f0d-5733-94c5-107d086c65f2 with identifier: HZ88582 to the API
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-30T15:50:56Z',
'fuel_type': 'petrol',
'id': 'fb940b5b-3f0d-5733-94c5-107d086c65f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ88582',
'listing': 'auction',
'make': 'Dacia',
'model': 'Logan MCV',
'odometer': 119716,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-08',
'seller_name': None,
'title': 'Dacia Logan MCV 1.0 SCe Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2019}
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ88582%27 HTTP/1.1" 200 None
2026-03-29 18:37:06 [auto1.de] INFO: Saving data for HZ88582: {'auction_closing_time': 1774885856.0, 'created_time': 1774521253.893274, 'last_price_update_time': 1774809426.913812}
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ88582') HTTP/1.1" 204 0
2026-03-29 18:37:06 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX83628%27 HTTP/1.1" 200 None
2026-03-29 18:37:06 [auto1.de] INFO: Scrape type for XX83628: 2
2026-03-29 18:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71677453-e954-5857-8232-c903da3363c8 with identifier: XX83628
2026-03-29 18:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71677453-e954-5857-8232-c903da3363c8 with scrape type 2
2026-03-29 18:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71677453-e954-5857-8232-c903da3363c8 with scrape type 2
2026-03-29 18:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71677453-e954-5857-8232-c903da3363c8, identifier: XX83628
2026-03-29 18:37:07 [scrapy.extensions.logstats] INFO: Crawled 77 pages (at 7 pages/min), scraped 503 items (at 61 items/min)
2026-03-29 18:37:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71677453-e954-5857-8232-c903da3363c8 with identifier: XX83628
2026-03-29 18:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71677453-e954-5857-8232-c903da3363c8 with identifier: XX83628
2026-03-29 18:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71677453-e954-5857-8232-c903da3363c8 with identifier: XX83628 to the API
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 67,
'expiration_date': '2026-03-30T15:10:54Z',
'fuel_type': 'petrol',
'id': '71677453-e954-5857-8232-c903da3363c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX83628',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 120611,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-15',
'seller_name': None,
'title': 'Hyundai i10 1.1 Edition+',
'transmission': 'manual',
'trim': 'Edition+',
'year': 2009}
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX83628%27 HTTP/1.1" 200 None
2026-03-29 18:37:07 [auto1.de] INFO: Saving data for XX83628: {'auction_closing_time': 1774883454.0, 'created_time': 1774608337.976488, 'last_price_update_time': 1774809427.707984}
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX83628') HTTP/1.1" 204 0
2026-03-29 18:37:07 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-29 18:37:07 [auto1.de] INFO: Found listing with ID: US51436
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US51436%27 HTTP/1.1" 200 None
2026-03-29 18:37:07 [auto1.de] INFO: Scrape type for US51436: 0
2026-03-29 18:37:07 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-29 18:37:07 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-29 18:37:07 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13341%27 HTTP/1.1" 200 None
2026-03-29 18:37:07 [auto1.de] INFO: Scrape type for DU13341: 2
2026-03-29 18:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 024715b1-48ce-5f67-9e2a-0cc581d891d5 with identifier: DU13341
2026-03-29 18:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 024715b1-48ce-5f67-9e2a-0cc581d891d5 with scrape type 2
2026-03-29 18:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 024715b1-48ce-5f67-9e2a-0cc581d891d5 with scrape type 2
2026-03-29 18:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 024715b1-48ce-5f67-9e2a-0cc581d891d5, identifier: DU13341
2026-03-29 18:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 024715b1-48ce-5f67-9e2a-0cc581d891d5 with identifier: DU13341
2026-03-29 18:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 024715b1-48ce-5f67-9e2a-0cc581d891d5 with identifier: DU13341
2026-03-29 18:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 024715b1-48ce-5f67-9e2a-0cc581d891d5 with identifier: DU13341 to the API
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:29:20Z',
'fuel_type': 'diesel',
'id': '024715b1-48ce-5f67-9e2a-0cc581d891d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU13341',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 89534,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-20',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Xcellence',
'transmission': 'automatic',
'trim': 'Xcellence',
'year': 2019}
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13341%27 HTTP/1.1" 200 None
2026-03-29 18:37:08 [auto1.de] INFO: Saving data for DU13341: {'auction_closing_time': 1774884560.0, 'created_time': 1774607734.573263, 'last_price_update_time': 1774809428.169258}
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU13341') HTTP/1.1" 204 0
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: FP14792
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY82930%27 HTTP/1.1" 200 None
2026-03-29 18:37:08 [auto1.de] INFO: Scrape type for TY82930: 2
2026-03-29 18:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2de1ce19-0924-50d8-bbd5-650c94288ed5 with identifier: TY82930
2026-03-29 18:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de1ce19-0924-50d8-bbd5-650c94288ed5 with scrape type 2
2026-03-29 18:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2de1ce19-0924-50d8-bbd5-650c94288ed5 with scrape type 2
2026-03-29 18:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2de1ce19-0924-50d8-bbd5-650c94288ed5, identifier: TY82930
2026-03-29 18:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2de1ce19-0924-50d8-bbd5-650c94288ed5 with identifier: TY82930
2026-03-29 18:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2de1ce19-0924-50d8-bbd5-650c94288ed5 with identifier: TY82930
2026-03-29 18:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2de1ce19-0924-50d8-bbd5-650c94288ed5 with identifier: TY82930 to the API
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 290,
'expiration_date': '2026-03-30T15:57:58Z',
'fuel_type': 'petrol',
'id': '2de1ce19-0924-50d8-bbd5-650c94288ed5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY82930',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 107220,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-21',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
'transmission': 'automatic',
'trim': 'GTI TCR',
'year': 2019}
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY82930%27 HTTP/1.1" 200 None
2026-03-29 18:37:08 [auto1.de] INFO: Saving data for TY82930: {'auction_closing_time': 1774886278.0, 'created_time': 1773658612.037912, 'last_price_update_time': 1774809428.669558}
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY82930') HTTP/1.1" 204 0
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB22696%27 HTTP/1.1" 200 None
2026-03-29 18:37:08 [auto1.de] INFO: Scrape type for EB22696: 0
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35007%27 HTTP/1.1" 200 None
2026-03-29 18:37:08 [auto1.de] INFO: Scrape type for NC35007: 2
2026-03-29 18:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d37f7090-8fc8-5390-9fb5-6098960ed969 with identifier: NC35007
2026-03-29 18:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d37f7090-8fc8-5390-9fb5-6098960ed969 with scrape type 2
2026-03-29 18:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d37f7090-8fc8-5390-9fb5-6098960ed969 with scrape type 2
2026-03-29 18:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d37f7090-8fc8-5390-9fb5-6098960ed969, identifier: NC35007
2026-03-29 18:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d37f7090-8fc8-5390-9fb5-6098960ed969 with identifier: NC35007
2026-03-29 18:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d37f7090-8fc8-5390-9fb5-6098960ed969 with identifier: NC35007
2026-03-29 18:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d37f7090-8fc8-5390-9fb5-6098960ed969 with identifier: NC35007 to the API
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:40:24Z',
'fuel_type': 'petrol',
'id': 'd37f7090-8fc8-5390-9fb5-6098960ed969',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC35007',
'listing': 'auction',
'make': 'Seat',
'model': 'Altea',
'odometer': 74073,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-10',
'seller_name': None,
'title': 'Seat Altea 1.4 TSI Style Copa',
'transmission': 'manual',
'trim': 'Style Copa',
'year': 2013}
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35007%27 HTTP/1.1" 200 None
2026-03-29 18:37:09 [auto1.de] INFO: Saving data for NC35007: {'auction_closing_time': 1774885224.0, 'created_time': 1773466753.331596, 'last_price_update_time': 1774809429.27142}
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC35007') HTTP/1.1" 204 0
2026-03-29 18:37:09 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT04304%27 HTTP/1.1" 200 None
2026-03-29 18:37:09 [auto1.de] INFO: Scrape type for YT04304: 2
2026-03-29 18:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 014c542a-9e88-59b8-83a5-bf76c553ee3e with identifier: YT04304
2026-03-29 18:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 014c542a-9e88-59b8-83a5-bf76c553ee3e with scrape type 2
2026-03-29 18:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 014c542a-9e88-59b8-83a5-bf76c553ee3e with scrape type 2
2026-03-29 18:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 014c542a-9e88-59b8-83a5-bf76c553ee3e, identifier: YT04304
2026-03-29 18:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 014c542a-9e88-59b8-83a5-bf76c553ee3e with identifier: YT04304
2026-03-29 18:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 014c542a-9e88-59b8-83a5-bf76c553ee3e with identifier: YT04304
2026-03-29 18:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 014c542a-9e88-59b8-83a5-bf76c553ee3e with identifier: YT04304 to the API
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:17:15Z',
'fuel_type': 'diesel',
'id': '014c542a-9e88-59b8-83a5-bf76c553ee3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT04304',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 153410,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-12',
'seller_name': None,
'title': 'BMW 1er 116d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2018}
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT04304%27 HTTP/1.1" 200 None
2026-03-29 18:37:09 [auto1.de] INFO: Saving data for YT04304: {'auction_closing_time': 1774883835.0, 'created_time': 1773304367.687804, 'last_price_update_time': 1774809429.74658}
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT04304') HTTP/1.1" 204 0
2026-03-29 18:37:09 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-29 18:37:09 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB73401%27 HTTP/1.1" 200 None
2026-03-29 18:37:09 [auto1.de] INFO: Scrape type for BB73401: 0
2026-03-29 18:37:09 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW44796%27 HTTP/1.1" 200 None
2026-03-29 18:37:09 [auto1.de] INFO: Scrape type for SW44796: 0
2026-03-29 18:37:09 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-29 18:37:09 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48150%27 HTTP/1.1" 200 None
2026-03-29 18:37:09 [auto1.de] INFO: Scrape type for WP48150: 2
2026-03-29 18:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with identifier: WP48150
2026-03-29 18:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with scrape type 2
2026-03-29 18:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with scrape type 2
2026-03-29 18:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c, identifier: WP48150
2026-03-29 18:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with identifier: WP48150
2026-03-29 18:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with identifier: WP48150
2026-03-29 18:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with identifier: WP48150 to the API
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:41:23Z',
'fuel_type': 'petrol',
'id': '1982e3b9-ef4e-545d-a53b-6cc527e6af8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP48150',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 37123,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-04',
'seller_name': None,
'title': 'Renault Twingo 1.0 SCe Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2018}
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48150%27 HTTP/1.1" 200 None
2026-03-29 18:37:10 [auto1.de] INFO: Saving data for WP48150: {'auction_closing_time': 1774885283.0, 'created_time': 1774608101.901565, 'last_price_update_time': 1774809430.251251}
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP48150') HTTP/1.1" 204 0
2026-03-29 18:37:10 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-29 18:37:10 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM92815%27 HTTP/1.1" 200 None
2026-03-29 18:37:10 [auto1.de] INFO: Scrape type for XM92815: 0
2026-03-29 18:37:10 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16975%27 HTTP/1.1" 200 None
2026-03-29 18:37:10 [auto1.de] INFO: Scrape type for GE16975: 2
2026-03-29 18:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a67609b7-36df-53c9-9052-25e72866b3ea with identifier: GE16975
2026-03-29 18:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a67609b7-36df-53c9-9052-25e72866b3ea with scrape type 2
2026-03-29 18:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a67609b7-36df-53c9-9052-25e72866b3ea with scrape type 2
2026-03-29 18:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a67609b7-36df-53c9-9052-25e72866b3ea, identifier: GE16975
2026-03-29 18:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a67609b7-36df-53c9-9052-25e72866b3ea with identifier: GE16975
2026-03-29 18:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a67609b7-36df-53c9-9052-25e72866b3ea with identifier: GE16975
2026-03-29 18:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a67609b7-36df-53c9-9052-25e72866b3ea with identifier: GE16975 to the API
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:09:22Z',
'fuel_type': 'diesel',
'id': 'a67609b7-36df-53c9-9052-25e72866b3ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE16975',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 214100,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-21',
'seller_name': None,
'title': 'Volkswagen Touran 1.6 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2011}
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16975%27 HTTP/1.1" 200 None
2026-03-29 18:37:10 [auto1.de] INFO: Saving data for GE16975: {'auction_closing_time': 1774883362.0, 'created_time': 1773945809.138602, 'last_price_update_time': 1774809430.685317}
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE16975') HTTP/1.1" 204 0
2026-03-29 18:37:10 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-29 18:37:10 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP27245%27 HTTP/1.1" 200 None
2026-03-29 18:37:10 [auto1.de] INFO: Scrape type for KP27245: 2
2026-03-29 18:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612708e7-8aa9-5dc5-a611-84b01b85751b with identifier: KP27245
2026-03-29 18:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612708e7-8aa9-5dc5-a611-84b01b85751b with scrape type 2
2026-03-29 18:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612708e7-8aa9-5dc5-a611-84b01b85751b with scrape type 2
2026-03-29 18:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 612708e7-8aa9-5dc5-a611-84b01b85751b, identifier: KP27245
2026-03-29 18:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 612708e7-8aa9-5dc5-a611-84b01b85751b with identifier: KP27245
2026-03-29 18:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 612708e7-8aa9-5dc5-a611-84b01b85751b with identifier: KP27245
2026-03-29 18:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 612708e7-8aa9-5dc5-a611-84b01b85751b with identifier: KP27245 to the API
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:59:26Z',
'fuel_type': 'diesel',
'id': '612708e7-8aa9-5dc5-a611-84b01b85751b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP27245',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 105065,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-16',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2017}
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP27245%27 HTTP/1.1" 200 None
2026-03-29 18:37:11 [auto1.de] INFO: Saving data for KP27245: {'auction_closing_time': 1774886366.0, 'created_time': 1774607680.520626, 'last_price_update_time': 1774809431.246772}
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP27245') HTTP/1.1" 204 0
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH25051%27 HTTP/1.1" 200 None
2026-03-29 18:37:11 [auto1.de] INFO: Scrape type for CH25051: 0
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL21879%27 HTTP/1.1" 200 None
2026-03-29 18:37:11 [auto1.de] INFO: Scrape type for VL21879: 0
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: FJ40863
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ40863%27 HTTP/1.1" 200 None
2026-03-29 18:37:11 [auto1.de] INFO: Scrape type for FJ40863: 2
2026-03-29 18:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d67901e-7237-5d95-b2b7-ffd60a9d3a67 with identifier: FJ40863
2026-03-29 18:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d67901e-7237-5d95-b2b7-ffd60a9d3a67 with scrape type 2
2026-03-29 18:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d67901e-7237-5d95-b2b7-ffd60a9d3a67 with scrape type 2
2026-03-29 18:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d67901e-7237-5d95-b2b7-ffd60a9d3a67, identifier: FJ40863
2026-03-29 18:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d67901e-7237-5d95-b2b7-ffd60a9d3a67 with identifier: FJ40863
2026-03-29 18:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d67901e-7237-5d95-b2b7-ffd60a9d3a67 with identifier: FJ40863
2026-03-29 18:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d67901e-7237-5d95-b2b7-ffd60a9d3a67 with identifier: FJ40863 to the API
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 88,
'expiration_date': '2026-03-30T15:02:24Z',
'fuel_type': 'diesel',
'id': '0d67901e-7237-5d95-b2b7-ffd60a9d3a67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ40863',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Sprinter',
'odometer': 305210,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-12',
'seller_name': None,
'title': 'Mercedes-Benz Sprinter 309 CDI',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ40863%27 HTTP/1.1" 200 None
2026-03-29 18:37:11 [auto1.de] INFO: Saving data for FJ40863: {'auction_closing_time': 1774882944.0, 'created_time': 1774722802.292301, 'last_price_update_time': 1774809431.706075}
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ40863') HTTP/1.1" 204 0
2026-03-29 18:37:11 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX44500%27 HTTP/1.1" 200 None
2026-03-29 18:37:11 [auto1.de] INFO: Scrape type for UX44500: 0
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM46431%27 HTTP/1.1" 200 None
2026-03-29 18:37:11 [auto1.de] INFO: Scrape type for YM46431: 2
2026-03-29 18:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with identifier: YM46431
2026-03-29 18:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with scrape type 2
2026-03-29 18:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with scrape type 2
2026-03-29 18:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7, identifier: YM46431
2026-03-29 18:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with identifier: YM46431
2026-03-29 18:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with identifier: YM46431
2026-03-29 18:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with identifier: YM46431 to the API
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:53:08Z',
'fuel_type': 'diesel',
'id': '9729b520-1d3e-5d9c-a5a3-3a73e6f381d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM46431',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 97376,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-05',
'seller_name': None,
'title': 'Renault Trafic 2.0 dCi L2H1 3,0t (8/9 Sitze) Life',
'transmission': 'manual',
'trim': 'L2H1 3,0t (8/9 Sitze) Life',
'year': 2020}
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM46431%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Saving data for YM46431: {'auction_closing_time': 1774885988.0, 'created_time': 1773467120.923954, 'last_price_update_time': 1774809432.311806}
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM46431') HTTP/1.1" 204 0
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY93616%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Scrape type for DY93616: 0
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55610%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Scrape type for BC55610: 0
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH78241%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Scrape type for YH78241: 2
2026-03-29 18:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 239053f6-93a7-5268-9789-3b3e4aa4fb22 with identifier: YH78241
2026-03-29 18:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 239053f6-93a7-5268-9789-3b3e4aa4fb22 with scrape type 2
2026-03-29 18:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 239053f6-93a7-5268-9789-3b3e4aa4fb22 with scrape type 2
2026-03-29 18:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 239053f6-93a7-5268-9789-3b3e4aa4fb22, identifier: YH78241
2026-03-29 18:37:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 239053f6-93a7-5268-9789-3b3e4aa4fb22 with identifier: YH78241
2026-03-29 18:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 239053f6-93a7-5268-9789-3b3e4aa4fb22 with identifier: YH78241
2026-03-29 18:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 239053f6-93a7-5268-9789-3b3e4aa4fb22 with identifier: YH78241 to the API
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:59:50Z',
'fuel_type': 'diesel',
'id': '239053f6-93a7-5268-9789-3b3e4aa4fb22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH78241',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 279421,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-28',
'seller_name': None,
'title': 'BMW 3er 330d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2012}
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH78241%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Saving data for YH78241: {'auction_closing_time': 1774886390.0, 'created_time': 1774521310.149287, 'last_price_update_time': 1774809432.754958}
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH78241') HTTP/1.1" 204 0
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH00472%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Scrape type for XH00472: 0
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH36335%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Scrape type for VH36335: 0
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH98635%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Scrape type for EH98635: 0
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC31400%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Scrape type for NC31400: 2
2026-03-29 18:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e064e9b9-666e-59fc-83ef-82a202ea0e1b with identifier: NC31400
2026-03-29 18:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e064e9b9-666e-59fc-83ef-82a202ea0e1b with scrape type 2
2026-03-29 18:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e064e9b9-666e-59fc-83ef-82a202ea0e1b with scrape type 2
2026-03-29 18:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e064e9b9-666e-59fc-83ef-82a202ea0e1b, identifier: NC31400
2026-03-29 18:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e064e9b9-666e-59fc-83ef-82a202ea0e1b with identifier: NC31400
2026-03-29 18:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e064e9b9-666e-59fc-83ef-82a202ea0e1b with identifier: NC31400
2026-03-29 18:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e064e9b9-666e-59fc-83ef-82a202ea0e1b with identifier: NC31400 to the API
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 145,
'expiration_date': '2026-03-30T15:24:23Z',
'fuel_type': 'petrol',
'id': 'e064e9b9-666e-59fc-83ef-82a202ea0e1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC31400',
'listing': 'auction',
'make': 'Abarth',
'model': '595',
'odometer': 59138,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-26',
'seller_name': None,
'title': 'Abarth 595 1.4 Turbo',
'transmission': 'manual',
'trim': '',
'year': 2019}
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC31400%27 HTTP/1.1" 200 None
2026-03-29 18:37:13 [auto1.de] INFO: Saving data for NC31400: {'auction_closing_time': 1774884263.0, 'created_time': 1773399757.254423, 'last_price_update_time': 1774809433.215937}
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC31400') HTTP/1.1" 204 0
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK07133%27 HTTP/1.1" 200 None
2026-03-29 18:37:13 [auto1.de] INFO: Scrape type for CK07133: 2
2026-03-29 18:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2983a78-277c-5fd4-a391-68b07ebff38e with identifier: CK07133
2026-03-29 18:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2983a78-277c-5fd4-a391-68b07ebff38e with scrape type 2
2026-03-29 18:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2983a78-277c-5fd4-a391-68b07ebff38e with scrape type 2
2026-03-29 18:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2983a78-277c-5fd4-a391-68b07ebff38e, identifier: CK07133
2026-03-29 18:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2983a78-277c-5fd4-a391-68b07ebff38e with identifier: CK07133
2026-03-29 18:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2983a78-277c-5fd4-a391-68b07ebff38e with identifier: CK07133
2026-03-29 18:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2983a78-277c-5fd4-a391-68b07ebff38e with identifier: CK07133 to the API
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:20:36Z',
'fuel_type': 'petrol',
'id': 'c2983a78-277c-5fd4-a391-68b07ebff38e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK07133',
'listing': 'auction',
'make': 'Fiat',
'model': 'Tipo',
'odometer': 121435,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-26',
'seller_name': None,
'title': 'Fiat Tipo 1.4 Turbo S-Design',
'transmission': 'manual',
'trim': 'S-Design',
'year': 2019}
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK07133%27 HTTP/1.1" 200 None
2026-03-29 18:37:13 [auto1.de] INFO: Saving data for CK07133: {'auction_closing_time': 1774884036.0, 'created_time': 1774607865.653676, 'last_price_update_time': 1774809433.690981}
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK07133') HTTP/1.1" 204 0
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR31209%27 HTTP/1.1" 200 None
2026-03-29 18:37:13 [auto1.de] INFO: Scrape type for YR31209: 0
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK30866%27 HTTP/1.1" 200 None
2026-03-29 18:37:13 [auto1.de] INFO: Scrape type for ZK30866: 2
2026-03-29 18:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with identifier: ZK30866
2026-03-29 18:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with scrape type 2
2026-03-29 18:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with scrape type 2
2026-03-29 18:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08, identifier: ZK30866
2026-03-29 18:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with identifier: ZK30866
2026-03-29 18:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with identifier: ZK30866
2026-03-29 18:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with identifier: ZK30866 to the API
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 305,
'expiration_date': '2026-03-30T15:53:02Z',
'fuel_type': 'petrol',
'id': '0b023f2a-c1e8-51e6-8a83-aa8e03e50f08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK30866',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 97552,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-09-12',
'seller_name': None,
'title': 'BMW 3er 335i',
'transmission': 'automatic',
'trim': '',
'year': 2007}
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK30866%27 HTTP/1.1" 200 None
2026-03-29 18:37:14 [auto1.de] INFO: Saving data for ZK30866: {'auction_closing_time': 1774885982.0, 'created_time': 1773686588.289577, 'last_price_update_time': 1774809434.307323}
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK30866') HTTP/1.1" 204 0
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA06109%27 HTTP/1.1" 200 None
2026-03-29 18:37:14 [auto1.de] INFO: Scrape type for SA06109: 2
2026-03-29 18:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 698628e7-16f0-58dc-a7c7-d9cd3790794b with identifier: SA06109
2026-03-29 18:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 698628e7-16f0-58dc-a7c7-d9cd3790794b with scrape type 2
2026-03-29 18:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 698628e7-16f0-58dc-a7c7-d9cd3790794b with scrape type 2
2026-03-29 18:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 698628e7-16f0-58dc-a7c7-d9cd3790794b, identifier: SA06109
2026-03-29 18:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 698628e7-16f0-58dc-a7c7-d9cd3790794b with identifier: SA06109
2026-03-29 18:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 698628e7-16f0-58dc-a7c7-d9cd3790794b with identifier: SA06109
2026-03-29 18:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 698628e7-16f0-58dc-a7c7-d9cd3790794b with identifier: SA06109 to the API
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:42:00Z',
'fuel_type': 'diesel',
'id': '698628e7-16f0-58dc-a7c7-d9cd3790794b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA06109',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLS-Klasse',
'odometer': 180130,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-10',
'seller_name': None,
'title': 'Mercedes-Benz CLS-Klasse CLS 350 d Shooting Brake BlueEfficiency',
'transmission': 'automatic',
'trim': 'BlueEfficiency',
'year': 2013}
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA06109%27 HTTP/1.1" 200 None
2026-03-29 18:37:14 [auto1.de] INFO: Saving data for SA06109: {'auction_closing_time': 1774885320.0, 'created_time': 1773379830.726534, 'last_price_update_time': 1774809434.760547}
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA06109') HTTP/1.1" 204 0
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN56098%27 HTTP/1.1" 200 None
2026-03-29 18:37:14 [auto1.de] INFO: Scrape type for CN56098: 0
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB85775%27 HTTP/1.1" 200 None
2026-03-29 18:37:14 [auto1.de] INFO: Scrape type for GB85775: 0
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA96509%27 HTTP/1.1" 200 None
2026-03-29 18:37:14 [auto1.de] INFO: Scrape type for VA96509: 2
2026-03-29 18:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8 with identifier: VA96509
2026-03-29 18:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8 with scrape type 2
2026-03-29 18:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8 with scrape type 2
2026-03-29 18:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8, identifier: VA96509
2026-03-29 18:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8 with identifier: VA96509
2026-03-29 18:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8 with identifier: VA96509
2026-03-29 18:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8 with identifier: VA96509 to the API
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:10:08Z',
'fuel_type': 'petrol',
'id': 'd705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA96509',
'listing': 'auction',
'make': 'Nissan',
'model': 'Tiida',
'odometer': 112413,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-27',
'seller_name': None,
'title': 'Nissan Tiida 1.6 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2010}
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA96509%27 HTTP/1.1" 200 None
2026-03-29 18:37:15 [auto1.de] INFO: Saving data for VA96509: {'auction_closing_time': 1774883408.0, 'created_time': 1774089136.462645, 'last_price_update_time': 1774809435.211744}
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA96509') HTTP/1.1" 204 0
2026-03-29 18:37:15 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-29 18:37:15 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX02497%27 HTTP/1.1" 200 None
2026-03-29 18:37:15 [auto1.de] INFO: Scrape type for PX02497: 0
2026-03-29 18:37:15 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV46830%27 HTTP/1.1" 200 None
2026-03-29 18:37:15 [auto1.de] INFO: Scrape type for LV46830: 2
2026-03-29 18:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with identifier: LV46830
2026-03-29 18:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with scrape type 2
2026-03-29 18:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with scrape type 2
2026-03-29 18:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff, identifier: LV46830
2026-03-29 18:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with identifier: LV46830
2026-03-29 18:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with identifier: LV46830
2026-03-29 18:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with identifier: LV46830 to the API
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:41:29Z',
'fuel_type': 'petrol',
'id': '776ee6ce-a36f-5af4-b35f-51c5d3d387ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV46830',
'listing': 'auction',
'make': 'BMW',
'model': 'Z4',
'odometer': 83825,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-07',
'seller_name': None,
'title': 'BMW Z4 M40i',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV46830%27 HTTP/1.1" 200 None
2026-03-29 18:37:15 [auto1.de] INFO: Saving data for LV46830: {'auction_closing_time': 1774885289.0, 'created_time': 1774607910.572714, 'last_price_update_time': 1774809435.769641}
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV46830') HTTP/1.1" 204 0
2026-03-29 18:37:15 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-29 18:37:15 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG35295%27 HTTP/1.1" 200 None
2026-03-29 18:37:15 [auto1.de] INFO: Scrape type for GG35295: 2
2026-03-29 18:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 124b1db6-dc95-505c-8d3b-c871addd4150 with identifier: GG35295
2026-03-29 18:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 124b1db6-dc95-505c-8d3b-c871addd4150 with scrape type 2
2026-03-29 18:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 124b1db6-dc95-505c-8d3b-c871addd4150 with scrape type 2
2026-03-29 18:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 124b1db6-dc95-505c-8d3b-c871addd4150, identifier: GG35295
2026-03-29 18:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 124b1db6-dc95-505c-8d3b-c871addd4150 with identifier: GG35295
2026-03-29 18:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 124b1db6-dc95-505c-8d3b-c871addd4150 with identifier: GG35295
2026-03-29 18:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 124b1db6-dc95-505c-8d3b-c871addd4150 with identifier: GG35295 to the API
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 250,
'expiration_date': '2026-03-30T15:53:41Z',
'fuel_type': 'diesel',
'id': '124b1db6-dc95-505c-8d3b-c871addd4150',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG35295',
'listing': 'auction',
'make': 'Jeep',
'model': 'Grand Cherokee',
'odometer': 90402,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-29',
'seller_name': None,
'title': 'Jeep Grand Cherokee 3.0 CRD Trailhawk',
'transmission': 'automatic',
'trim': 'Trailhawk',
'year': 2018}
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG35295%27 HTTP/1.1" 200 None
2026-03-29 18:37:16 [auto1.de] INFO: Saving data for GG35295: {'auction_closing_time': 1774886021.0, 'created_time': 1774521156.456089, 'last_price_update_time': 1774809436.183516}
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG35295') HTTP/1.1" 204 0
2026-03-29 18:37:16 [auto1.de] INFO: Found listing with ID: HU76899
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU76899%27 HTTP/1.1" 200 None
2026-03-29 18:37:16 [auto1.de] INFO: Scrape type for HU76899: 2
2026-03-29 18:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52c5b24b-37ea-5fe9-ad64-6ef927a677ee with identifier: HU76899
2026-03-29 18:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52c5b24b-37ea-5fe9-ad64-6ef927a677ee with scrape type 2
2026-03-29 18:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52c5b24b-37ea-5fe9-ad64-6ef927a677ee with scrape type 2
2026-03-29 18:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52c5b24b-37ea-5fe9-ad64-6ef927a677ee, identifier: HU76899
2026-03-29 18:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52c5b24b-37ea-5fe9-ad64-6ef927a677ee with identifier: HU76899
2026-03-29 18:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52c5b24b-37ea-5fe9-ad64-6ef927a677ee with identifier: HU76899
2026-03-29 18:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52c5b24b-37ea-5fe9-ad64-6ef927a677ee with identifier: HU76899 to the API
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:18:19Z',
'fuel_type': 'petrol',
'id': '52c5b24b-37ea-5fe9-ad64-6ef927a677ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU76899',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 22413,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-22',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.5 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2023}
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU76899%27 HTTP/1.1" 200 None
2026-03-29 18:37:16 [auto1.de] INFO: Saving data for HU76899: {'auction_closing_time': 1774883899.0, 'created_time': 1774722801.549894, 'last_price_update_time': 1774809436.639838}
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU76899') HTTP/1.1" 204 0
2026-03-29 18:37:16 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-29 18:37:16 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-29 18:37:16 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-29 18:37:16 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU24928%27 HTTP/1.1" 200 None
2026-03-29 18:37:16 [auto1.de] INFO: Scrape type for AU24928: 2
2026-03-29 18:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5e13eef-5664-50f8-bdfc-5969f3249f90 with identifier: AU24928
2026-03-29 18:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5e13eef-5664-50f8-bdfc-5969f3249f90 with scrape type 2
2026-03-29 18:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5e13eef-5664-50f8-bdfc-5969f3249f90 with scrape type 2
2026-03-29 18:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5e13eef-5664-50f8-bdfc-5969f3249f90, identifier: AU24928
2026-03-29 18:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5e13eef-5664-50f8-bdfc-5969f3249f90 with identifier: AU24928
2026-03-29 18:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5e13eef-5664-50f8-bdfc-5969f3249f90 with identifier: AU24928
2026-03-29 18:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5e13eef-5664-50f8-bdfc-5969f3249f90 with identifier: AU24928 to the API
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:06:33Z',
'fuel_type': 'petrol',
'id': 'a5e13eef-5664-50f8-bdfc-5969f3249f90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU24928',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 132756,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-20',
'seller_name': None,
'title': 'Volkswagen Caddy 1.4 TSI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2017}
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU24928%27 HTTP/1.1" 200 None
2026-03-29 18:37:17 [auto1.de] INFO: Saving data for AU24928: {'auction_closing_time': 1774883193.0, 'created_time': 1773466810.388461, 'last_price_update_time': 1774809437.127965}
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU24928') HTTP/1.1" 204 0
2026-03-29 18:37:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:17 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-29 18:37:17 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-29 18:37:17 [auto1.de] INFO: Scrape type for NB74696: 0
2026-03-29 18:37:17 [auto1.de] INFO: Found listing with ID: ZY67532
2026-03-29 18:37:17 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM85964%27 HTTP/1.1" 200 None
2026-03-29 18:37:17 [auto1.de] INFO: Scrape type for XM85964: 0
2026-03-29 18:37:17 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-29 18:37:17 [auto1.de] INFO: Scrape type for EV07676: 2
2026-03-29 18:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f214e540-ee7b-5b55-b8b9-18af76159a0e with identifier: EV07676
2026-03-29 18:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f214e540-ee7b-5b55-b8b9-18af76159a0e with scrape type 2
2026-03-29 18:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f214e540-ee7b-5b55-b8b9-18af76159a0e with scrape type 2
2026-03-29 18:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f214e540-ee7b-5b55-b8b9-18af76159a0e, identifier: EV07676
2026-03-29 18:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f214e540-ee7b-5b55-b8b9-18af76159a0e with identifier: EV07676
2026-03-29 18:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f214e540-ee7b-5b55-b8b9-18af76159a0e with identifier: EV07676
2026-03-29 18:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f214e540-ee7b-5b55-b8b9-18af76159a0e with identifier: EV07676 to the API
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 330,
'expiration_date': '2026-03-30T15:42:24Z',
'fuel_type': 'diesel',
'id': 'f214e540-ee7b-5b55-b8b9-18af76159a0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV07676',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 146263,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-24',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 400 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2021}
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-29 18:37:17 [auto1.de] INFO: Saving data for EV07676: {'auction_closing_time': 1774885344.0, 'created_time': 1773859666.558048, 'last_price_update_time': 1774809437.604003}
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV07676') HTTP/1.1" 204 0
2026-03-29 18:37:17 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-29 18:37:17 [auto1.de] INFO: Scrape type for TT79830: 2
2026-03-29 18:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e04542-d2c8-52f1-a0e2-68ba5702e980 with identifier: TT79830
2026-03-29 18:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e04542-d2c8-52f1-a0e2-68ba5702e980 with scrape type 2
2026-03-29 18:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2e04542-d2c8-52f1-a0e2-68ba5702e980 with scrape type 2
2026-03-29 18:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2e04542-d2c8-52f1-a0e2-68ba5702e980, identifier: TT79830
2026-03-29 18:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2e04542-d2c8-52f1-a0e2-68ba5702e980 with identifier: TT79830
2026-03-29 18:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2e04542-d2c8-52f1-a0e2-68ba5702e980 with identifier: TT79830
2026-03-29 18:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2e04542-d2c8-52f1-a0e2-68ba5702e980 with identifier: TT79830 to the API
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:49:28Z',
'fuel_type': 'petrol',
'id': 'e2e04542-d2c8-52f1-a0e2-68ba5702e980',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT79830',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 98225,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-22',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 160 Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2010}
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-29 18:37:18 [auto1.de] INFO: Saving data for TT79830: {'auction_closing_time': 1774885768.0, 'created_time': 1773467974.405456, 'last_price_update_time': 1774809438.169576}
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT79830') HTTP/1.1" 204 0
2026-03-29 18:37:18 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW20402%27 HTTP/1.1" 200 None
2026-03-29 18:37:18 [auto1.de] INFO: Scrape type for DW20402: 0
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ76765%27 HTTP/1.1" 200 None
2026-03-29 18:37:18 [auto1.de] INFO: Scrape type for BJ76765: 0
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: RU04475
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ05854%27 HTTP/1.1" 200 None
2026-03-29 18:37:18 [auto1.de] INFO: Scrape type for RJ05854: 2
2026-03-29 18:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed86ad48-c4c3-5949-b718-5af2115b333b with identifier: RJ05854
2026-03-29 18:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed86ad48-c4c3-5949-b718-5af2115b333b with scrape type 2
2026-03-29 18:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed86ad48-c4c3-5949-b718-5af2115b333b with scrape type 2
2026-03-29 18:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed86ad48-c4c3-5949-b718-5af2115b333b, identifier: RJ05854
2026-03-29 18:37:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed86ad48-c4c3-5949-b718-5af2115b333b with identifier: RJ05854
2026-03-29 18:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed86ad48-c4c3-5949-b718-5af2115b333b with identifier: RJ05854
2026-03-29 18:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed86ad48-c4c3-5949-b718-5af2115b333b with identifier: RJ05854 to the API
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:59:52Z',
'fuel_type': 'petrol',
'id': 'ed86ad48-c4c3-5949-b718-5af2115b333b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ05854',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 139140,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-28',
'seller_name': None,
'title': 'Opel Astra 1.0 Turbo Edition Start/Stop',
'transmission': 'manual',
'trim': 'Edition Start/Stop',
'year': 2016}
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ05854%27 HTTP/1.1" 200 None
2026-03-29 18:37:18 [auto1.de] INFO: Saving data for RJ05854: {'auction_closing_time': 1774886392.0, 'created_time': 1773662083.307689, 'last_price_update_time': 1774809438.69494}
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ05854') HTTP/1.1" 204 0
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ09190%27 HTTP/1.1" 200 None
2026-03-29 18:37:18 [auto1.de] INFO: Scrape type for LZ09190: 2
2026-03-29 18:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf74005e-8341-5543-ac74-cc35eac3da6c with identifier: LZ09190
2026-03-29 18:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf74005e-8341-5543-ac74-cc35eac3da6c with scrape type 2
2026-03-29 18:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf74005e-8341-5543-ac74-cc35eac3da6c with scrape type 2
2026-03-29 18:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf74005e-8341-5543-ac74-cc35eac3da6c, identifier: LZ09190
2026-03-29 18:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf74005e-8341-5543-ac74-cc35eac3da6c with identifier: LZ09190
2026-03-29 18:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf74005e-8341-5543-ac74-cc35eac3da6c with identifier: LZ09190
2026-03-29 18:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf74005e-8341-5543-ac74-cc35eac3da6c with identifier: LZ09190 to the API
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 271,
'expiration_date': '2026-03-30T15:46:49Z',
'fuel_type': 'petrol',
'id': 'cf74005e-8341-5543-ac74-cc35eac3da6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ09190',
'listing': 'auction',
'make': 'Jeep',
'model': 'Wrangler Unlimited',
'odometer': 102704,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-16',
'seller_name': None,
'title': 'Jeep Wrangler Unlimited 2.0 TGDi Sahara',
'transmission': 'automatic',
'trim': 'Sahara',
'year': 2021}
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ09190%27 HTTP/1.1" 200 None
2026-03-29 18:37:19 [auto1.de] INFO: Saving data for LZ09190: {'auction_closing_time': 1774885609.0, 'created_time': 1773830088.489627, 'last_price_update_time': 1774809439.238102}
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ09190') HTTP/1.1" 204 0
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06034%27 HTTP/1.1" 200 None
2026-03-29 18:37:19 [auto1.de] INFO: Scrape type for AU06034: 0
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM64010%27 HTTP/1.1" 200 None
2026-03-29 18:37:19 [auto1.de] INFO: Scrape type for LM64010: 0
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU34226%27 HTTP/1.1" 200 None
2026-03-29 18:37:19 [auto1.de] INFO: Scrape type for BU34226: 0
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB30141%27 HTTP/1.1" 200 None
2026-03-29 18:37:19 [auto1.de] INFO: Scrape type for DB30141: 0
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG01306%27 HTTP/1.1" 200 None
2026-03-29 18:37:19 [auto1.de] INFO: Scrape type for KG01306: 0
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW76676%27 HTTP/1.1" 200 None
2026-03-29 18:37:19 [auto1.de] INFO: Scrape type for GW76676: 2
2026-03-29 18:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce9c10b4-f803-5e3a-b658-9228ab327344 with identifier: GW76676
2026-03-29 18:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce9c10b4-f803-5e3a-b658-9228ab327344 with scrape type 2
2026-03-29 18:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce9c10b4-f803-5e3a-b658-9228ab327344 with scrape type 2
2026-03-29 18:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce9c10b4-f803-5e3a-b658-9228ab327344, identifier: GW76676
2026-03-29 18:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce9c10b4-f803-5e3a-b658-9228ab327344 with identifier: GW76676
2026-03-29 18:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce9c10b4-f803-5e3a-b658-9228ab327344 with identifier: GW76676
2026-03-29 18:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce9c10b4-f803-5e3a-b658-9228ab327344 with identifier: GW76676 to the API
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:29:01Z',
'fuel_type': 'petrol',
'id': 'ce9c10b4-f803-5e3a-b658-9228ab327344',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW76676',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 128247,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-04-22',
'seller_name': None,
'title': 'Opel Astra 1.8 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2007}
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW76676%27 HTTP/1.1" 200 None
2026-03-29 18:37:19 [auto1.de] INFO: Saving data for GW76676: {'auction_closing_time': 1774884541.0, 'created_time': 1774032510.565219, 'last_price_update_time': 1774809439.769422}
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW76676') HTTP/1.1" 204 0
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ56847%27 HTTP/1.1" 200 None
2026-03-29 18:37:19 [auto1.de] INFO: Scrape type for NZ56847: 2
2026-03-29 18:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4efbd51-0d30-54a2-b9dc-5d1c475a817a with identifier: NZ56847
2026-03-29 18:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4efbd51-0d30-54a2-b9dc-5d1c475a817a with scrape type 2
2026-03-29 18:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4efbd51-0d30-54a2-b9dc-5d1c475a817a with scrape type 2
2026-03-29 18:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4efbd51-0d30-54a2-b9dc-5d1c475a817a, identifier: NZ56847
2026-03-29 18:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4efbd51-0d30-54a2-b9dc-5d1c475a817a with identifier: NZ56847
2026-03-29 18:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4efbd51-0d30-54a2-b9dc-5d1c475a817a with identifier: NZ56847
2026-03-29 18:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4efbd51-0d30-54a2-b9dc-5d1c475a817a with identifier: NZ56847 to the API
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:36:09Z',
'fuel_type': 'diesel',
'id': 'c4efbd51-0d30-54a2-b9dc-5d1c475a817a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ56847',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 205615,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-04',
'seller_name': None,
'title': 'Audi A5 Sportback 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2016}
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ56847%27 HTTP/1.1" 200 None
2026-03-29 18:37:20 [auto1.de] INFO: Saving data for NZ56847: {'auction_closing_time': 1774884969.0, 'created_time': 1774522455.588947, 'last_price_update_time': 1774809440.269817}
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ56847') HTTP/1.1" 204 0
2026-03-29 18:37:20 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-29 18:37:20 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-29 18:37:20 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-29 18:37:20 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS80969%27 HTTP/1.1" 200 None
2026-03-29 18:37:20 [auto1.de] INFO: Scrape type for VS80969: 2
2026-03-29 18:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e873d094-6967-5652-b3b9-68ce20f5e07b with identifier: VS80969
2026-03-29 18:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e873d094-6967-5652-b3b9-68ce20f5e07b with scrape type 2
2026-03-29 18:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e873d094-6967-5652-b3b9-68ce20f5e07b with scrape type 2
2026-03-29 18:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e873d094-6967-5652-b3b9-68ce20f5e07b, identifier: VS80969
2026-03-29 18:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e873d094-6967-5652-b3b9-68ce20f5e07b with identifier: VS80969
2026-03-29 18:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e873d094-6967-5652-b3b9-68ce20f5e07b with identifier: VS80969
2026-03-29 18:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e873d094-6967-5652-b3b9-68ce20f5e07b with identifier: VS80969 to the API
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:29:45Z',
'fuel_type': 'petrol',
'id': 'e873d094-6967-5652-b3b9-68ce20f5e07b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS80969',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 98651,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-09',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI Advanced 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Advanced 4Motion BlueMotion',
'year': 2017}
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS80969%27 HTTP/1.1" 200 None
2026-03-29 18:37:20 [auto1.de] INFO: Saving data for VS80969: {'auction_closing_time': 1774884585.0, 'created_time': 1774522349.335637, 'last_price_update_time': 1774809440.674766}
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS80969') HTTP/1.1" 204 0
2026-03-29 18:37:20 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-29 18:37:20 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-29 18:37:20 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-29 18:37:20 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-29 18:37:20 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-29 18:37:20 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE37655%27 HTTP/1.1" 200 None
2026-03-29 18:37:20 [auto1.de] INFO: Scrape type for GE37655: 2
2026-03-29 18:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: badceaec-0e01-5c5e-9127-6ea619c9275e with identifier: GE37655
2026-03-29 18:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item badceaec-0e01-5c5e-9127-6ea619c9275e with scrape type 2
2026-03-29 18:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item badceaec-0e01-5c5e-9127-6ea619c9275e with scrape type 2
2026-03-29 18:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: badceaec-0e01-5c5e-9127-6ea619c9275e, identifier: GE37655
2026-03-29 18:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: badceaec-0e01-5c5e-9127-6ea619c9275e with identifier: GE37655
2026-03-29 18:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: badceaec-0e01-5c5e-9127-6ea619c9275e with identifier: GE37655
2026-03-29 18:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: badceaec-0e01-5c5e-9127-6ea619c9275e with identifier: GE37655 to the API
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:04:38Z',
'fuel_type': 'petrol',
'id': 'badceaec-0e01-5c5e-9127-6ea619c9275e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE37655',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 131003,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-15',
'seller_name': None,
'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex 4x4',
'transmission': 'manual',
'trim': 'Innovation ecoFlex 4x4',
'year': 2014}
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE37655%27 HTTP/1.1" 200 None
2026-03-29 18:37:21 [auto1.de] INFO: Saving data for GE37655: {'auction_closing_time': 1774883078.0, 'created_time': 1774607708.263554, 'last_price_update_time': 1774809441.126746}
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE37655') HTTP/1.1" 204 0
2026-03-29 18:37:21 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-29 18:37:21 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS36397%27 HTTP/1.1" 200 None
2026-03-29 18:37:21 [auto1.de] INFO: Scrape type for LS36397: 2
2026-03-29 18:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25a82215-c99f-5e78-b533-ee6f3f56b44c with identifier: LS36397
2026-03-29 18:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25a82215-c99f-5e78-b533-ee6f3f56b44c with scrape type 2
2026-03-29 18:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25a82215-c99f-5e78-b533-ee6f3f56b44c with scrape type 2
2026-03-29 18:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25a82215-c99f-5e78-b533-ee6f3f56b44c, identifier: LS36397
2026-03-29 18:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25a82215-c99f-5e78-b533-ee6f3f56b44c with identifier: LS36397
2026-03-29 18:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25a82215-c99f-5e78-b533-ee6f3f56b44c with identifier: LS36397
2026-03-29 18:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25a82215-c99f-5e78-b533-ee6f3f56b44c with identifier: LS36397 to the API
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:19:35Z',
'fuel_type': 'diesel',
'id': '25a82215-c99f-5e78-b533-ee6f3f56b44c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS36397',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 116947,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-28',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2015}
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS36397%27 HTTP/1.1" 200 None
2026-03-29 18:37:21 [auto1.de] INFO: Saving data for LS36397: {'auction_closing_time': 1774883975.0, 'created_time': 1773399028.614564, 'last_price_update_time': 1774809441.662046}
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS36397') HTTP/1.1" 204 0
2026-03-29 18:37:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:21 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:21 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-29 18:37:21 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF67152%27 HTTP/1.1" 200 None
2026-03-29 18:37:21 [auto1.de] INFO: Scrape type for PF67152: 2
2026-03-29 18:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3915990-984b-54de-bca3-12bde127017a with identifier: PF67152
2026-03-29 18:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3915990-984b-54de-bca3-12bde127017a with scrape type 2
2026-03-29 18:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3915990-984b-54de-bca3-12bde127017a with scrape type 2
2026-03-29 18:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3915990-984b-54de-bca3-12bde127017a, identifier: PF67152
2026-03-29 18:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3915990-984b-54de-bca3-12bde127017a with identifier: PF67152
2026-03-29 18:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3915990-984b-54de-bca3-12bde127017a with identifier: PF67152
2026-03-29 18:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3915990-984b-54de-bca3-12bde127017a with identifier: PF67152 to the API
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:10Z',
'fuel_type': 'diesel',
'id': 'd3915990-984b-54de-bca3-12bde127017a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF67152',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 257745,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-19',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2016}
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF67152%27 HTTP/1.1" 200 None
2026-03-29 18:37:22 [auto1.de] INFO: Saving data for PF67152: {'auction_closing_time': 1774882990.0, 'created_time': 1774294233.663818, 'last_price_update_time': 1774809442.266782}
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF67152') HTTP/1.1" 204 0
2026-03-29 18:37:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:22 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-29 18:37:22 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-29 18:37:22 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT58518%27 HTTP/1.1" 200 None
2026-03-29 18:37:22 [auto1.de] INFO: Scrape type for YT58518: 0
2026-03-29 18:37:22 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN98053%27 HTTP/1.1" 200 None
2026-03-29 18:37:22 [auto1.de] INFO: Scrape type for RN98053: 2
2026-03-29 18:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 504ea1ca-1802-5737-a8cf-9251b5c33504 with identifier: RN98053
2026-03-29 18:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 504ea1ca-1802-5737-a8cf-9251b5c33504 with scrape type 2
2026-03-29 18:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 504ea1ca-1802-5737-a8cf-9251b5c33504 with scrape type 2
2026-03-29 18:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 504ea1ca-1802-5737-a8cf-9251b5c33504, identifier: RN98053
2026-03-29 18:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 504ea1ca-1802-5737-a8cf-9251b5c33504 with identifier: RN98053
2026-03-29 18:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 504ea1ca-1802-5737-a8cf-9251b5c33504 with identifier: RN98053
2026-03-29 18:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 504ea1ca-1802-5737-a8cf-9251b5c33504 with identifier: RN98053 to the API
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:07:00Z',
'fuel_type': 'diesel',
'id': '504ea1ca-1802-5737-a8cf-9251b5c33504',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN98053',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 199256,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-28',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2015}
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN98053%27 HTTP/1.1" 200 None
2026-03-29 18:37:22 [auto1.de] INFO: Saving data for RN98053: {'auction_closing_time': 1774883220.0, 'created_time': 1774521260.985282, 'last_price_update_time': 1774809442.706895}
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN98053') HTTP/1.1" 204 0
2026-03-29 18:37:22 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT73600%27 HTTP/1.1" 200 None
2026-03-29 18:37:22 [auto1.de] INFO: Scrape type for CT73600: 0
2026-03-29 18:37:22 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX89038%27 HTTP/1.1" 200 None
2026-03-29 18:37:22 [auto1.de] INFO: Scrape type for GX89038: 0
2026-03-29 18:37:22 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72791%27 HTTP/1.1" 200 None
2026-03-29 18:37:22 [auto1.de] INFO: Scrape type for CK72791: 0
2026-03-29 18:37:22 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR25495%27 HTTP/1.1" 200 None
2026-03-29 18:37:22 [auto1.de] INFO: Scrape type for XR25495: 2
2026-03-29 18:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddcfbe53-7ab9-52f5-98e8-24264328adad with identifier: XR25495
2026-03-29 18:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddcfbe53-7ab9-52f5-98e8-24264328adad with scrape type 2
2026-03-29 18:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddcfbe53-7ab9-52f5-98e8-24264328adad with scrape type 2
2026-03-29 18:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ddcfbe53-7ab9-52f5-98e8-24264328adad, identifier: XR25495
2026-03-29 18:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ddcfbe53-7ab9-52f5-98e8-24264328adad with identifier: XR25495
2026-03-29 18:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ddcfbe53-7ab9-52f5-98e8-24264328adad with identifier: XR25495
2026-03-29 18:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ddcfbe53-7ab9-52f5-98e8-24264328adad with identifier: XR25495 to the API
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:17:13Z',
'fuel_type': 'petrol',
'id': 'ddcfbe53-7ab9-52f5-98e8-24264328adad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR25495',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 217507,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-21',
'seller_name': None,
'title': 'Volkswagen Sharan 1.4 TSI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2011}
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR25495%27 HTTP/1.1" 200 None
2026-03-29 18:37:23 [auto1.de] INFO: Saving data for XR25495: {'auction_closing_time': 1774883833.0, 'created_time': 1774636314.915874, 'last_price_update_time': 1774809443.189709}
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR25495') HTTP/1.1" 204 0
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB36683%27 HTTP/1.1" 200 None
2026-03-29 18:37:23 [auto1.de] INFO: Scrape type for MB36683: 2
2026-03-29 18:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b3942e3-179c-5a20-be04-a6124833a0fc with identifier: MB36683
2026-03-29 18:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b3942e3-179c-5a20-be04-a6124833a0fc with scrape type 2
2026-03-29 18:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b3942e3-179c-5a20-be04-a6124833a0fc with scrape type 2
2026-03-29 18:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b3942e3-179c-5a20-be04-a6124833a0fc, identifier: MB36683
2026-03-29 18:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b3942e3-179c-5a20-be04-a6124833a0fc with identifier: MB36683
2026-03-29 18:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b3942e3-179c-5a20-be04-a6124833a0fc with identifier: MB36683
2026-03-29 18:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b3942e3-179c-5a20-be04-a6124833a0fc with identifier: MB36683 to the API
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 530,
'expiration_date': '2026-03-30T15:11:32Z',
'fuel_type': 'petrol',
'id': '8b3942e3-179c-5a20-be04-a6124833a0fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB36683',
'listing': 'auction',
'make': 'BMW',
'model': '8er',
'odometer': 61140,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-16',
'seller_name': None,
'title': 'BMW 8er M850i Gran Coupe xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2021}
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB36683%27 HTTP/1.1" 200 None
2026-03-29 18:37:23 [auto1.de] INFO: Saving data for MB36683: {'auction_closing_time': 1774883492.0, 'created_time': 1773772269.797104, 'last_price_update_time': 1774809443.733457}
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB36683') HTTP/1.1" 204 0
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK97582%27 HTTP/1.1" 200 None
2026-03-29 18:37:23 [auto1.de] INFO: Scrape type for AK97582: 2
2026-03-29 18:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with identifier: AK97582
2026-03-29 18:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with scrape type 2
2026-03-29 18:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with scrape type 2
2026-03-29 18:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a96c028-88df-5a2b-ad32-08e90bfc63a7, identifier: AK97582
2026-03-29 18:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with identifier: AK97582
2026-03-29 18:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with identifier: AK97582
2026-03-29 18:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with identifier: AK97582 to the API
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:36:53Z',
'fuel_type': 'diesel',
'id': '3a96c028-88df-5a2b-ad32-08e90bfc63a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK97582',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 171299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-07',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
'transmission': 'manual',
'trim': 'GTD BlueMotion Tech',
'year': 2016}
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK97582%27 HTTP/1.1" 200 None
2026-03-29 18:37:24 [auto1.de] INFO: Saving data for AK97582: {'auction_closing_time': 1774885013.0, 'created_time': 1773400040.589577, 'last_price_update_time': 1774809444.212435}
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK97582') HTTP/1.1" 204 0
2026-03-29 18:37:24 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW79987%27 HTTP/1.1" 200 None
2026-03-29 18:37:24 [auto1.de] INFO: Scrape type for KW79987: 0
2026-03-29 18:37:24 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM72901%27 HTTP/1.1" 200 None
2026-03-29 18:37:24 [auto1.de] INFO: Scrape type for CM72901: 2
2026-03-29 18:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26265610-a3a5-57d7-af23-6a7033a17a58 with identifier: CM72901
2026-03-29 18:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26265610-a3a5-57d7-af23-6a7033a17a58 with scrape type 2
2026-03-29 18:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26265610-a3a5-57d7-af23-6a7033a17a58 with scrape type 2
2026-03-29 18:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26265610-a3a5-57d7-af23-6a7033a17a58, identifier: CM72901
2026-03-29 18:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26265610-a3a5-57d7-af23-6a7033a17a58 with identifier: CM72901
2026-03-29 18:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26265610-a3a5-57d7-af23-6a7033a17a58 with identifier: CM72901
2026-03-29 18:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26265610-a3a5-57d7-af23-6a7033a17a58 with identifier: CM72901 to the API
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:59Z',
'fuel_type': 'petrol',
'id': '26265610-a3a5-57d7-af23-6a7033a17a58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM72901',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 22668,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-16',
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TFSI ACT S line',
'transmission': 'manual',
'trim': 'ACT S line',
'year': 2021}
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM72901%27 HTTP/1.1" 200 None
2026-03-29 18:37:24 [auto1.de] INFO: Saving data for CM72901: {'auction_closing_time': 1774883039.0, 'created_time': 1773305916.665395, 'last_price_update_time': 1774809444.72261}
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM72901') HTTP/1.1" 204 0
2026-03-29 18:37:24 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-29 18:37:24 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY42515%27 HTTP/1.1" 200 None
2026-03-29 18:37:24 [auto1.de] INFO: Scrape type for RY42515: 0
2026-03-29 18:37:24 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX09216%27 HTTP/1.1" 200 None
2026-03-29 18:37:24 [auto1.de] INFO: Scrape type for BX09216: 0
2026-03-29 18:37:24 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-29 18:37:24 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-29 18:37:24 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-29 18:37:24 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC48990%27 HTTP/1.1" 200 None
2026-03-29 18:37:24 [auto1.de] INFO: Scrape type for SC48990: 0
2026-03-29 18:37:24 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF45936%27 HTTP/1.1" 200 None
2026-03-29 18:37:24 [auto1.de] INFO: Scrape type for ZF45936: 0
2026-03-29 18:37:24 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV39961%27 HTTP/1.1" 200 None
2026-03-29 18:37:24 [auto1.de] INFO: Scrape type for EV39961: 2
2026-03-29 18:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35dd651d-25d2-52be-913b-63460085253b with identifier: EV39961
2026-03-29 18:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35dd651d-25d2-52be-913b-63460085253b with scrape type 2
2026-03-29 18:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35dd651d-25d2-52be-913b-63460085253b with scrape type 2
2026-03-29 18:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35dd651d-25d2-52be-913b-63460085253b, identifier: EV39961
2026-03-29 18:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35dd651d-25d2-52be-913b-63460085253b with identifier: EV39961
2026-03-29 18:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35dd651d-25d2-52be-913b-63460085253b with identifier: EV39961
2026-03-29 18:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35dd651d-25d2-52be-913b-63460085253b with identifier: EV39961 to the API
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:45:06Z',
'fuel_type': 'diesel',
'id': '35dd651d-25d2-52be-913b-63460085253b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV39961',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 278053,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-18',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2009}
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV39961%27 HTTP/1.1" 200 None
2026-03-29 18:37:25 [auto1.de] INFO: Saving data for EV39961: {'auction_closing_time': 1774885506.0, 'created_time': 1773308136.069192, 'last_price_update_time': 1774809445.254954}
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV39961') HTTP/1.1" 204 0
2026-03-29 18:37:25 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-29 18:37:25 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-29 18:37:25 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-29 18:37:25 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14526%27 HTTP/1.1" 200 None
2026-03-29 18:37:25 [auto1.de] INFO: Scrape type for GK14526: 0
2026-03-29 18:37:25 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW62166%27 HTTP/1.1" 200 None
2026-03-29 18:37:25 [auto1.de] INFO: Scrape type for MW62166: 2
2026-03-29 18:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 321b1cf2-2975-555c-b977-9137d4923e9f with identifier: MW62166
2026-03-29 18:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 321b1cf2-2975-555c-b977-9137d4923e9f with scrape type 2
2026-03-29 18:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 321b1cf2-2975-555c-b977-9137d4923e9f with scrape type 2
2026-03-29 18:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 321b1cf2-2975-555c-b977-9137d4923e9f, identifier: MW62166
2026-03-29 18:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 321b1cf2-2975-555c-b977-9137d4923e9f with identifier: MW62166
2026-03-29 18:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 321b1cf2-2975-555c-b977-9137d4923e9f with identifier: MW62166
2026-03-29 18:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 321b1cf2-2975-555c-b977-9137d4923e9f with identifier: MW62166 to the API
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:44:59Z',
'fuel_type': 'petrol',
'id': '321b1cf2-2975-555c-b977-9137d4923e9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW62166',
'listing': 'auction',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 85435,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-19',
'seller_name': None,
'title': 'Seat Tarraco 1.5 TSI ACT Xcellence',
'transmission': 'manual',
'trim': 'Xcellence',
'year': 2020}
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW62166%27 HTTP/1.1" 200 None
2026-03-29 18:37:25 [auto1.de] INFO: Saving data for MW62166: {'auction_closing_time': 1774885499.0, 'created_time': 1773859537.83337, 'last_price_update_time': 1774809445.824862}
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW62166') HTTP/1.1" 204 0
2026-03-29 18:37:25 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-29 18:37:25 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-29 18:37:25 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP70009%27 HTTP/1.1" 200 None
2026-03-29 18:37:25 [auto1.de] INFO: Scrape type for TP70009: 0
2026-03-29 18:37:25 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-29 18:37:25 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC45462%27 HTTP/1.1" 200 None
2026-03-29 18:37:25 [auto1.de] INFO: Scrape type for SC45462: 0
2026-03-29 18:37:25 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10701%27 HTTP/1.1" 200 None
2026-03-29 18:37:25 [auto1.de] INFO: Scrape type for VY10701: 0
2026-03-29 18:37:25 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74169%27 HTTP/1.1" 200 None
2026-03-29 18:37:25 [auto1.de] INFO: Scrape type for DJ74169: 2
2026-03-29 18:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with identifier: DJ74169
2026-03-29 18:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with scrape type 2
2026-03-29 18:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with scrape type 2
2026-03-29 18:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1, identifier: DJ74169
2026-03-29 18:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with identifier: DJ74169
2026-03-29 18:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with identifier: DJ74169
2026-03-29 18:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with identifier: DJ74169 to the API
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:41:12Z',
'fuel_type': 'petrol',
'id': 'ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ74169',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 153965,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-27',
'seller_name': None,
'title': 'Peugeot 207 1.4 VTi Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2011}
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74169%27 HTTP/1.1" 200 None
2026-03-29 18:37:26 [auto1.de] INFO: Saving data for DJ74169: {'auction_closing_time': 1774885272.0, 'created_time': 1773859441.602751, 'last_price_update_time': 1774809446.322247}
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ74169') HTTP/1.1" 204 0
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF42457%27 HTTP/1.1" 200 None
2026-03-29 18:37:26 [auto1.de] INFO: Scrape type for AF42457: 2
2026-03-29 18:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with identifier: AF42457
2026-03-29 18:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with scrape type 2
2026-03-29 18:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with scrape type 2
2026-03-29 18:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97, identifier: AF42457
2026-03-29 18:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with identifier: AF42457
2026-03-29 18:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with identifier: AF42457
2026-03-29 18:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with identifier: AF42457 to the API
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:54:56Z',
'fuel_type': 'diesel',
'id': '04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF42457',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 269135,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-20',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI DPF Energy',
'transmission': 'manual',
'trim': 'Energy',
'year': 2014}
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF42457%27 HTTP/1.1" 200 None
2026-03-29 18:37:26 [auto1.de] INFO: Saving data for AF42457: {'auction_closing_time': 1774886096.0, 'created_time': 1774349774.413642, 'last_price_update_time': 1774809446.922872}
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF42457') HTTP/1.1" 204 0
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ52896%27 HTTP/1.1" 200 None
2026-03-29 18:37:26 [auto1.de] INFO: Scrape type for DZ52896: 0
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD28287%27 HTTP/1.1" 200 None
2026-03-29 18:37:26 [auto1.de] INFO: Scrape type for AD28287: 2
2026-03-29 18:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with identifier: AD28287
2026-03-29 18:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with scrape type 2
2026-03-29 18:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with scrape type 2
2026-03-29 18:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f, identifier: AD28287
2026-03-29 18:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with identifier: AD28287
2026-03-29 18:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with identifier: AD28287
2026-03-29 18:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with identifier: AD28287 to the API
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:20:33Z',
'fuel_type': 'petrol',
'id': '7cbfd7db-0a6b-5148-bba3-21b5b7aec72f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD28287',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 104648,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-09',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
'transmission': 'automatic',
'trim': 'BlueEfficiency Style',
'year': 2015}
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD28287%27 HTTP/1.1" 200 None
2026-03-29 18:37:27 [auto1.de] INFO: Saving data for AD28287: {'auction_closing_time': 1774884033.0, 'created_time': 1773775671.866236, 'last_price_update_time': 1774809447.455318}
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD28287') HTTP/1.1" 204 0
2026-03-29 18:37:27 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:27 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN14580%27 HTTP/1.1" 200 None
2026-03-29 18:37:27 [auto1.de] INFO: Scrape type for TN14580: 2
2026-03-29 18:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2091fc1-4213-5c12-ad43-254edc496c33 with identifier: TN14580
2026-03-29 18:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2091fc1-4213-5c12-ad43-254edc496c33 with scrape type 2
2026-03-29 18:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2091fc1-4213-5c12-ad43-254edc496c33 with scrape type 2
2026-03-29 18:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2091fc1-4213-5c12-ad43-254edc496c33, identifier: TN14580
2026-03-29 18:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2091fc1-4213-5c12-ad43-254edc496c33 with identifier: TN14580
2026-03-29 18:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2091fc1-4213-5c12-ad43-254edc496c33 with identifier: TN14580
2026-03-29 18:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2091fc1-4213-5c12-ad43-254edc496c33 with identifier: TN14580 to the API
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:13:13Z',
'fuel_type': 'diesel',
'id': 'd2091fc1-4213-5c12-ad43-254edc496c33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN14580',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 197243,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-01',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2015}
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN14580%27 HTTP/1.1" 200 None
2026-03-29 18:37:27 [auto1.de] INFO: Saving data for TN14580: {'auction_closing_time': 1774883593.0, 'created_time': 1774263125.266287, 'last_price_update_time': 1774809447.965068}
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN14580') HTTP/1.1" 204 0
2026-03-29 18:37:27 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY25163%27 HTTP/1.1" 200 None
2026-03-29 18:37:28 [auto1.de] INFO: Scrape type for FY25163: 2
2026-03-29 18:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99d96466-3930-51a6-b1be-0dc52f8c6537 with identifier: FY25163
2026-03-29 18:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99d96466-3930-51a6-b1be-0dc52f8c6537 with scrape type 2
2026-03-29 18:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99d96466-3930-51a6-b1be-0dc52f8c6537 with scrape type 2
2026-03-29 18:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99d96466-3930-51a6-b1be-0dc52f8c6537, identifier: FY25163
2026-03-29 18:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99d96466-3930-51a6-b1be-0dc52f8c6537 with identifier: FY25163
2026-03-29 18:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99d96466-3930-51a6-b1be-0dc52f8c6537 with identifier: FY25163
2026-03-29 18:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99d96466-3930-51a6-b1be-0dc52f8c6537 with identifier: FY25163 to the API
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:55:06Z',
'fuel_type': 'petrol',
'id': '99d96466-3930-51a6-b1be-0dc52f8c6537',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY25163',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 274078,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-10-26',
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2004}
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY25163%27 HTTP/1.1" 200 None
2026-03-29 18:37:28 [auto1.de] INFO: Saving data for FY25163: {'auction_closing_time': 1774886106.0, 'created_time': 1774265056.555747, 'last_price_update_time': 1774809448.40734}
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY25163') HTTP/1.1" 204 0
2026-03-29 18:37:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:28 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-29 18:37:28 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY44699%27 HTTP/1.1" 200 None
2026-03-29 18:37:28 [auto1.de] INFO: Scrape type for PY44699: 2
2026-03-29 18:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 474b78af-e5ba-54c8-800f-6af4b57192ec with identifier: PY44699
2026-03-29 18:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 474b78af-e5ba-54c8-800f-6af4b57192ec with scrape type 2
2026-03-29 18:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 474b78af-e5ba-54c8-800f-6af4b57192ec with scrape type 2
2026-03-29 18:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 474b78af-e5ba-54c8-800f-6af4b57192ec, identifier: PY44699
2026-03-29 18:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 474b78af-e5ba-54c8-800f-6af4b57192ec with identifier: PY44699
2026-03-29 18:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 474b78af-e5ba-54c8-800f-6af4b57192ec with identifier: PY44699
2026-03-29 18:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 474b78af-e5ba-54c8-800f-6af4b57192ec with identifier: PY44699 to the API
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:47:16Z',
'fuel_type': 'diesel',
'id': '474b78af-e5ba-54c8-800f-6af4b57192ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY44699',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Courier',
'odometer': 23314,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-26',
'seller_name': None,
'title': 'Ford Transit Courier 1.5 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2020}
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY44699%27 HTTP/1.1" 200 None
2026-03-29 18:37:28 [auto1.de] INFO: Saving data for PY44699: {'auction_closing_time': 1774885636.0, 'created_time': 1773341709.910902, 'last_price_update_time': 1774809448.894593}
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY44699') HTTP/1.1" 204 0
2026-03-29 18:37:28 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59823%27 HTTP/1.1" 200 None
2026-03-29 18:37:28 [auto1.de] INFO: Scrape type for NL59823: 0
2026-03-29 18:37:28 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-29 18:37:28 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-29 18:37:28 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC26693%27 HTTP/1.1" 200 None
2026-03-29 18:37:28 [auto1.de] INFO: Scrape type for SC26693: 0
2026-03-29 18:37:28 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-29 18:37:28 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB74339%27 HTTP/1.1" 200 None
2026-03-29 18:37:28 [auto1.de] INFO: Scrape type for GB74339: 2
2026-03-29 18:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with identifier: GB74339
2026-03-29 18:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with scrape type 2
2026-03-29 18:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with scrape type 2
2026-03-29 18:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d, identifier: GB74339
2026-03-29 18:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with identifier: GB74339
2026-03-29 18:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with identifier: GB74339
2026-03-29 18:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with identifier: GB74339 to the API
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:09:46Z',
'fuel_type': 'petrol',
'id': '3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB74339',
'listing': 'auction',
'make': 'Kia',
'model': 'Stonic',
'odometer': 48990,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-16',
'seller_name': None,
'title': 'Kia Stonic 1.0 TGDI Platinum Edition',
'transmission': 'manual',
'trim': 'Platinum Edition',
'year': 2018}
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB74339%27 HTTP/1.1" 200 None
2026-03-29 18:37:29 [auto1.de] INFO: Saving data for GB74339: {'auction_closing_time': 1774883386.0, 'created_time': 1774607860.637799, 'last_price_update_time': 1774809449.645973}
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB74339') HTTP/1.1" 204 0
2026-03-29 18:37:29 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-29 18:37:29 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG94369%27 HTTP/1.1" 200 None
2026-03-29 18:37:29 [auto1.de] INFO: Scrape type for NG94369: 0
2026-03-29 18:37:29 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-29 18:37:29 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR53020%27 HTTP/1.1" 200 None
2026-03-29 18:37:29 [auto1.de] INFO: Scrape type for AR53020: 2
2026-03-29 18:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32dbe053-06ff-56fa-aa4b-843394f9b659 with identifier: AR53020
2026-03-29 18:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32dbe053-06ff-56fa-aa4b-843394f9b659 with scrape type 2
2026-03-29 18:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32dbe053-06ff-56fa-aa4b-843394f9b659 with scrape type 2
2026-03-29 18:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32dbe053-06ff-56fa-aa4b-843394f9b659, identifier: AR53020
2026-03-29 18:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32dbe053-06ff-56fa-aa4b-843394f9b659 with identifier: AR53020
2026-03-29 18:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32dbe053-06ff-56fa-aa4b-843394f9b659 with identifier: AR53020
2026-03-29 18:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32dbe053-06ff-56fa-aa4b-843394f9b659 with identifier: AR53020 to the API
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 286,
'expiration_date': '2026-03-30T15:16:56Z',
'fuel_type': 'diesel',
'id': '32dbe053-06ff-56fa-aa4b-843394f9b659',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR53020',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 127760,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-22',
'seller_name': None,
'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR53020%27 HTTP/1.1" 200 None
2026-03-29 18:37:30 [auto1.de] INFO: Saving data for AR53020: {'auction_closing_time': 1774883816.0, 'created_time': 1773427561.411427, 'last_price_update_time': 1774809450.24157}
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR53020') HTTP/1.1" 204 0
2026-03-29 18:37:30 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY91699%27 HTTP/1.1" 200 None
2026-03-29 18:37:30 [auto1.de] INFO: Scrape type for WY91699: 2
2026-03-29 18:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2509d74f-8f1e-53b2-bb45-a01d12da881a with identifier: WY91699
2026-03-29 18:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2509d74f-8f1e-53b2-bb45-a01d12da881a with scrape type 2
2026-03-29 18:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2509d74f-8f1e-53b2-bb45-a01d12da881a with scrape type 2
2026-03-29 18:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2509d74f-8f1e-53b2-bb45-a01d12da881a, identifier: WY91699
2026-03-29 18:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2509d74f-8f1e-53b2-bb45-a01d12da881a with identifier: WY91699
2026-03-29 18:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2509d74f-8f1e-53b2-bb45-a01d12da881a with identifier: WY91699
2026-03-29 18:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2509d74f-8f1e-53b2-bb45-a01d12da881a with identifier: WY91699 to the API
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:26:22Z',
'fuel_type': 'diesel',
'id': '2509d74f-8f1e-53b2-bb45-a01d12da881a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY91699',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 279012,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-22',
'seller_name': None,
'title': 'BMW 3er 320d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2018}
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY91699%27 HTTP/1.1" 200 None
2026-03-29 18:37:30 [auto1.de] INFO: Saving data for WY91699: {'auction_closing_time': 1774884382.0, 'created_time': 1774292227.344446, 'last_price_update_time': 1774809450.69439}
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY91699') HTTP/1.1" 204 0
2026-03-29 18:37:30 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-29 18:37:30 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG94589%27 HTTP/1.1" 200 None
2026-03-29 18:37:30 [auto1.de] INFO: Scrape type for HG94589: 2
2026-03-29 18:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dccaca07-a3e0-52e5-b312-6e612b630897 with identifier: HG94589
2026-03-29 18:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dccaca07-a3e0-52e5-b312-6e612b630897 with scrape type 2
2026-03-29 18:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dccaca07-a3e0-52e5-b312-6e612b630897 with scrape type 2
2026-03-29 18:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dccaca07-a3e0-52e5-b312-6e612b630897, identifier: HG94589
2026-03-29 18:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dccaca07-a3e0-52e5-b312-6e612b630897 with identifier: HG94589
2026-03-29 18:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dccaca07-a3e0-52e5-b312-6e612b630897 with identifier: HG94589
2026-03-29 18:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dccaca07-a3e0-52e5-b312-6e612b630897 with identifier: HG94589 to the API
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:08:33Z',
'fuel_type': 'diesel',
'id': 'dccaca07-a3e0-52e5-b312-6e612b630897',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG94589',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 273631,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-14',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI DPF Energy',
'transmission': 'manual',
'trim': 'Energy',
'year': 2014}
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG94589%27 HTTP/1.1" 200 None
2026-03-29 18:37:31 [auto1.de] INFO: Saving data for HG94589: {'auction_closing_time': 1774883313.0, 'created_time': 1773945851.309351, 'last_price_update_time': 1774809451.471831}
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG94589') HTTP/1.1" 204 0
2026-03-29 18:37:31 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-29 18:37:31 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-29 18:37:31 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-29 18:37:31 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89812%27 HTTP/1.1" 200 None
2026-03-29 18:37:31 [auto1.de] INFO: Scrape type for LM89812: 2
2026-03-29 18:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with identifier: LM89812
2026-03-29 18:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with scrape type 2
2026-03-29 18:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with scrape type 2
2026-03-29 18:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09, identifier: LM89812
2026-03-29 18:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with identifier: LM89812
2026-03-29 18:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with identifier: LM89812
2026-03-29 18:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with identifier: LM89812 to the API
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:33:15Z',
'fuel_type': 'diesel',
'id': '8b7c7c3b-1990-537a-8d75-d46f7fda4b09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM89812',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 247375,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-12',
'seller_name': None,
'title': 'Volkswagen Golf V 1.9 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2006}
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89812%27 HTTP/1.1" 200 None
2026-03-29 18:37:31 [auto1.de] INFO: Saving data for LM89812: {'auction_closing_time': 1774884795.0, 'created_time': 1774608333.388092, 'last_price_update_time': 1774809451.944785}
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM89812') HTTP/1.1" 204 0
2026-03-29 18:37:32 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-29 18:37:32 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-29 18:37:32 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-29 18:37:32 [auto1.de] INFO: Scrape type for PA88457: 2
2026-03-29 18:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a24cda0c-a7b8-5c54-87f4-2082439417f9 with identifier: PA88457
2026-03-29 18:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a24cda0c-a7b8-5c54-87f4-2082439417f9 with scrape type 2
2026-03-29 18:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a24cda0c-a7b8-5c54-87f4-2082439417f9 with scrape type 2
2026-03-29 18:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a24cda0c-a7b8-5c54-87f4-2082439417f9, identifier: PA88457
2026-03-29 18:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a24cda0c-a7b8-5c54-87f4-2082439417f9 with identifier: PA88457
2026-03-29 18:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a24cda0c-a7b8-5c54-87f4-2082439417f9 with identifier: PA88457
2026-03-29 18:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a24cda0c-a7b8-5c54-87f4-2082439417f9 with identifier: PA88457 to the API
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:35:09Z',
'fuel_type': 'petrol',
'id': 'a24cda0c-a7b8-5c54-87f4-2082439417f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA88457',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 99627,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-17',
'seller_name': None,
'title': 'Kia Sportage 1.6 GDI FIFA World Cup Edition 2WD',
'transmission': 'manual',
'trim': 'FIFA World Cup Edition 2WD',
'year': 2014}
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-29 18:37:32 [auto1.de] INFO: Saving data for PA88457: {'auction_closing_time': 1774884909.0, 'created_time': 1773427388.413136, 'last_price_update_time': 1774809452.546058}
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA88457') HTTP/1.1" 204 0
2026-03-29 18:37:32 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE52715%27 HTTP/1.1" 200 None
2026-03-29 18:37:32 [auto1.de] INFO: Scrape type for NE52715: 0
2026-03-29 18:37:32 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-29 18:37:32 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN51512%27 HTTP/1.1" 200 None
2026-03-29 18:37:32 [auto1.de] INFO: Scrape type for XN51512: 2
2026-03-29 18:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b82473b4-4037-5be2-b3d5-3d5392bfd397 with identifier: XN51512
2026-03-29 18:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b82473b4-4037-5be2-b3d5-3d5392bfd397 with scrape type 2
2026-03-29 18:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b82473b4-4037-5be2-b3d5-3d5392bfd397 with scrape type 2
2026-03-29 18:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b82473b4-4037-5be2-b3d5-3d5392bfd397, identifier: XN51512
2026-03-29 18:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b82473b4-4037-5be2-b3d5-3d5392bfd397 with identifier: XN51512
2026-03-29 18:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b82473b4-4037-5be2-b3d5-3d5392bfd397 with identifier: XN51512
2026-03-29 18:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b82473b4-4037-5be2-b3d5-3d5392bfd397 with identifier: XN51512 to the API
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:07:12Z',
'fuel_type': 'diesel',
'id': 'b82473b4-4037-5be2-b3d5-3d5392bfd397',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN51512',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 260433,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-25',
'seller_name': None,
'title': 'Ford Focus 1.5 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2017}
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN51512%27 HTTP/1.1" 200 None
2026-03-29 18:37:33 [auto1.de] INFO: Saving data for XN51512: {'auction_closing_time': 1774883232.0, 'created_time': 1772728754.130929, 'last_price_update_time': 1774809453.047367}
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN51512') HTTP/1.1" 204 0
2026-03-29 18:37:33 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD06025%27 HTTP/1.1" 200 None
2026-03-29 18:37:33 [auto1.de] INFO: Scrape type for LD06025: 0
2026-03-29 18:37:33 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB27376%27 HTTP/1.1" 200 None
2026-03-29 18:37:33 [auto1.de] INFO: Scrape type for BB27376: 0
2026-03-29 18:37:33 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU64075%27 HTTP/1.1" 200 None
2026-03-29 18:37:33 [auto1.de] INFO: Scrape type for XU64075: 2
2026-03-29 18:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with identifier: XU64075
2026-03-29 18:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with scrape type 2
2026-03-29 18:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with scrape type 2
2026-03-29 18:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b601aab1-2b2d-58d2-aff6-7f7f8b39a580, identifier: XU64075
2026-03-29 18:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with identifier: XU64075
2026-03-29 18:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with identifier: XU64075
2026-03-29 18:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with identifier: XU64075 to the API
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:41:22Z',
'fuel_type': 'diesel',
'id': 'b601aab1-2b2d-58d2-aff6-7f7f8b39a580',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU64075',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 328288,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-30',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2013}
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU64075%27 HTTP/1.1" 200 None
2026-03-29 18:37:33 [auto1.de] INFO: Saving data for XU64075: {'auction_closing_time': 1774885282.0, 'created_time': 1773304017.773538, 'last_price_update_time': 1774809453.517847}
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU64075') HTTP/1.1" 204 0
2026-03-29 18:37:33 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL87064%27 HTTP/1.1" 200 None
2026-03-29 18:37:33 [auto1.de] INFO: Scrape type for TL87064: 2
2026-03-29 18:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f37a7713-284f-522c-8080-133b27842212 with identifier: TL87064
2026-03-29 18:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f37a7713-284f-522c-8080-133b27842212 with scrape type 2
2026-03-29 18:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f37a7713-284f-522c-8080-133b27842212 with scrape type 2
2026-03-29 18:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f37a7713-284f-522c-8080-133b27842212, identifier: TL87064
2026-03-29 18:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f37a7713-284f-522c-8080-133b27842212 with identifier: TL87064
2026-03-29 18:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f37a7713-284f-522c-8080-133b27842212 with identifier: TL87064
2026-03-29 18:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f37a7713-284f-522c-8080-133b27842212 with identifier: TL87064 to the API
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:42:04Z',
'fuel_type': 'diesel',
'id': 'f37a7713-284f-522c-8080-133b27842212',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL87064',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 365118,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-03',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Soleil',
'transmission': 'automatic',
'trim': 'Soleil',
'year': 2019}
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL87064%27 HTTP/1.1" 200 None
2026-03-29 18:37:34 [auto1.de] INFO: Saving data for TL87064: {'auction_closing_time': 1774885324.0, 'created_time': 1773384981.848925, 'last_price_update_time': 1774809454.000307}
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL87064') HTTP/1.1" 204 0
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ86105%27 HTTP/1.1" 200 None
2026-03-29 18:37:34 [auto1.de] INFO: Scrape type for YZ86105: 0
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR55742%27 HTTP/1.1" 200 None
2026-03-29 18:37:34 [auto1.de] INFO: Scrape type for AR55742: 0
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK59777%27 HTTP/1.1" 200 None
2026-03-29 18:37:34 [auto1.de] INFO: Scrape type for BK59777: 2
2026-03-29 18:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca8fe179-f946-56a3-b1cf-18343391a95d with identifier: BK59777
2026-03-29 18:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca8fe179-f946-56a3-b1cf-18343391a95d with scrape type 2
2026-03-29 18:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca8fe179-f946-56a3-b1cf-18343391a95d with scrape type 2
2026-03-29 18:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca8fe179-f946-56a3-b1cf-18343391a95d, identifier: BK59777
2026-03-29 18:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca8fe179-f946-56a3-b1cf-18343391a95d with identifier: BK59777
2026-03-29 18:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca8fe179-f946-56a3-b1cf-18343391a95d with identifier: BK59777
2026-03-29 18:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca8fe179-f946-56a3-b1cf-18343391a95d with identifier: BK59777 to the API
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:06:50Z',
'fuel_type': 'diesel',
'id': 'ca8fe179-f946-56a3-b1cf-18343391a95d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK59777',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 169653,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-04',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2022}
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK59777%27 HTTP/1.1" 200 None
2026-03-29 18:37:34 [auto1.de] INFO: Saving data for BK59777: {'auction_closing_time': 1774883210.0, 'created_time': 1774607666.584721, 'last_price_update_time': 1774809454.524124}
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK59777') HTTP/1.1" 204 0
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP91359%27 HTTP/1.1" 200 None
2026-03-29 18:37:34 [auto1.de] INFO: Scrape type for HP91359: 0
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF41212%27 HTTP/1.1" 200 None
2026-03-29 18:37:34 [auto1.de] INFO: Scrape type for VF41212: 0
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-29 18:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:34 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF06660%27 HTTP/1.1" 200 None
2026-03-29 18:37:34 [auto1.de] INFO: Scrape type for HF06660: 2
2026-03-29 18:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57aa10a7-6db1-545d-a03e-a3af09cabb59 with identifier: HF06660
2026-03-29 18:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57aa10a7-6db1-545d-a03e-a3af09cabb59 with scrape type 2
2026-03-29 18:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57aa10a7-6db1-545d-a03e-a3af09cabb59 with scrape type 2
2026-03-29 18:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57aa10a7-6db1-545d-a03e-a3af09cabb59, identifier: HF06660
2026-03-29 18:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57aa10a7-6db1-545d-a03e-a3af09cabb59 with identifier: HF06660
2026-03-29 18:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57aa10a7-6db1-545d-a03e-a3af09cabb59 with identifier: HF06660
2026-03-29 18:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57aa10a7-6db1-545d-a03e-a3af09cabb59 with identifier: HF06660 to the API
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:46:49Z',
'fuel_type': 'petrol',
'id': '57aa10a7-6db1-545d-a03e-a3af09cabb59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF06660',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 72681,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-06',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2020}
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF06660%27 HTTP/1.1" 200 None
2026-03-29 18:37:35 [auto1.de] INFO: Saving data for HF06660: {'auction_closing_time': 1774885609.0, 'created_time': 1774607627.149307, 'last_price_update_time': 1774809455.293214}
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF06660') HTTP/1.1" 204 0
2026-03-29 18:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:35 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-29 18:37:35 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-29 18:37:35 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-29 18:37:35 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-29 18:37:35 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY19584%27 HTTP/1.1" 200 None
2026-03-29 18:37:35 [auto1.de] INFO: Scrape type for WY19584: 0
2026-03-29 18:37:35 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-29 18:37:35 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT00605%27 HTTP/1.1" 200 None
2026-03-29 18:37:35 [auto1.de] INFO: Scrape type for CT00605: 2
2026-03-29 18:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce5318ef-9eac-5353-b196-ac0aac83978b with identifier: CT00605
2026-03-29 18:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce5318ef-9eac-5353-b196-ac0aac83978b with scrape type 2
2026-03-29 18:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce5318ef-9eac-5353-b196-ac0aac83978b with scrape type 2
2026-03-29 18:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce5318ef-9eac-5353-b196-ac0aac83978b, identifier: CT00605
2026-03-29 18:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce5318ef-9eac-5353-b196-ac0aac83978b with identifier: CT00605
2026-03-29 18:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce5318ef-9eac-5353-b196-ac0aac83978b with identifier: CT00605
2026-03-29 18:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce5318ef-9eac-5353-b196-ac0aac83978b with identifier: CT00605 to the API
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:43:54Z',
'fuel_type': 'diesel',
'id': 'ce5318ef-9eac-5353-b196-ac0aac83978b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT00605',
'listing': 'auction',
'make': 'Renault',
'model': 'Master',
'odometer': 107098,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-21',
'seller_name': None,
'title': 'Renault Master 2.3 dCi L4H2 HKa 3,5t',
'transmission': 'manual',
'trim': 'L4H2 HKa 3,5t',
'year': 2012}
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT00605%27 HTTP/1.1" 200 None
2026-03-29 18:37:36 [auto1.de] INFO: Saving data for CT00605: {'auction_closing_time': 1774885434.0, 'created_time': 1774291296.789796, 'last_price_update_time': 1774809456.170417}
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT00605') HTTP/1.1" 204 0
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG93130%27 HTTP/1.1" 200 None
2026-03-29 18:37:36 [auto1.de] INFO: Scrape type for WG93130: 0
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN50331%27 HTTP/1.1" 200 None
2026-03-29 18:37:36 [auto1.de] INFO: Scrape type for EN50331: 0
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ11168%27 HTTP/1.1" 200 None
2026-03-29 18:37:36 [auto1.de] INFO: Scrape type for PZ11168: 2
2026-03-29 18:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e91493f5-bed5-598c-b340-804c782350b3 with identifier: PZ11168
2026-03-29 18:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e91493f5-bed5-598c-b340-804c782350b3 with scrape type 2
2026-03-29 18:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e91493f5-bed5-598c-b340-804c782350b3 with scrape type 2
2026-03-29 18:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e91493f5-bed5-598c-b340-804c782350b3, identifier: PZ11168
2026-03-29 18:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e91493f5-bed5-598c-b340-804c782350b3 with identifier: PZ11168
2026-03-29 18:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e91493f5-bed5-598c-b340-804c782350b3 with identifier: PZ11168
2026-03-29 18:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e91493f5-bed5-598c-b340-804c782350b3 with identifier: PZ11168 to the API
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:52:15Z',
'fuel_type': 'petrol',
'id': 'e91493f5-bed5-598c-b340-804c782350b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ11168',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 182524,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-15',
'seller_name': None,
'title': 'Audi A1 Sportback 1.4 TFSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2013}
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ11168%27 HTTP/1.1" 200 None
2026-03-29 18:37:36 [auto1.de] INFO: Saving data for PZ11168: {'auction_closing_time': 1774885935.0, 'created_time': 1773466755.781098, 'last_price_update_time': 1774809456.931565}
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ11168') HTTP/1.1" 204 0
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE44185%27 HTTP/1.1" 200 None
2026-03-29 18:37:36 [auto1.de] INFO: Scrape type for WE44185: 2
2026-03-29 18:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with identifier: WE44185
2026-03-29 18:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with scrape type 2
2026-03-29 18:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with scrape type 2
2026-03-29 18:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d, identifier: WE44185
2026-03-29 18:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with identifier: WE44185
2026-03-29 18:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with identifier: WE44185
2026-03-29 18:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with identifier: WE44185 to the API
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:00:31Z',
'fuel_type': 'petrol',
'id': '1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE44185',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 88458,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-06-15',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2005}
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE44185%27 HTTP/1.1" 200 None
2026-03-29 18:37:37 [auto1.de] INFO: Saving data for WE44185: {'auction_closing_time': 1774882831.0, 'created_time': 1774290657.325942, 'last_price_update_time': 1774809457.380529}
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE44185') HTTP/1.1" 204 0
2026-03-29 18:37:37 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF30454%27 HTTP/1.1" 200 None
2026-03-29 18:37:37 [auto1.de] INFO: Scrape type for NF30454: 0
2026-03-29 18:37:37 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00412%27 HTTP/1.1" 200 None
2026-03-29 18:37:37 [auto1.de] INFO: Scrape type for ZG00412: 2
2026-03-29 18:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 703f9153-187e-5475-b1d0-35832e3679b3 with identifier: ZG00412
2026-03-29 18:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 703f9153-187e-5475-b1d0-35832e3679b3 with scrape type 2
2026-03-29 18:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 703f9153-187e-5475-b1d0-35832e3679b3 with scrape type 2
2026-03-29 18:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 703f9153-187e-5475-b1d0-35832e3679b3, identifier: ZG00412
2026-03-29 18:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 703f9153-187e-5475-b1d0-35832e3679b3 with identifier: ZG00412
2026-03-29 18:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 703f9153-187e-5475-b1d0-35832e3679b3 with identifier: ZG00412
2026-03-29 18:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 703f9153-187e-5475-b1d0-35832e3679b3 with identifier: ZG00412 to the API
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:14:09Z',
'fuel_type': 'diesel',
'id': '703f9153-187e-5475-b1d0-35832e3679b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG00412',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 94794,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-12',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2018}
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00412%27 HTTP/1.1" 200 None
2026-03-29 18:37:37 [auto1.de] INFO: Saving data for ZG00412: {'auction_closing_time': 1774883649.0, 'created_time': 1774002196.112133, 'last_price_update_time': 1774809457.865807}
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG00412') HTTP/1.1" 204 0
2026-03-29 18:37:37 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37067%27 HTTP/1.1" 200 None
2026-03-29 18:37:37 [auto1.de] INFO: Scrape type for UZ37067: 2
2026-03-29 18:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a5f763b-223d-5001-b5e9-af1e69743b56 with identifier: UZ37067
2026-03-29 18:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a5f763b-223d-5001-b5e9-af1e69743b56 with scrape type 2
2026-03-29 18:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a5f763b-223d-5001-b5e9-af1e69743b56 with scrape type 2
2026-03-29 18:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a5f763b-223d-5001-b5e9-af1e69743b56, identifier: UZ37067
2026-03-29 18:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a5f763b-223d-5001-b5e9-af1e69743b56 with identifier: UZ37067
2026-03-29 18:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a5f763b-223d-5001-b5e9-af1e69743b56 with identifier: UZ37067
2026-03-29 18:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a5f763b-223d-5001-b5e9-af1e69743b56 with identifier: UZ37067 to the API
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:51:17Z',
'fuel_type': 'petrol',
'id': '4a5f763b-223d-5001-b5e9-af1e69743b56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ37067',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 95449,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-11',
'seller_name': None,
'title': 'Seat Alhambra 1.4 TSI FR-Line',
'transmission': 'automatic',
'trim': 'FR-Line',
'year': 2020}
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37067%27 HTTP/1.1" 200 None
2026-03-29 18:37:38 [auto1.de] INFO: Saving data for UZ37067: {'auction_closing_time': 1774885877.0, 'created_time': 1774607820.899124, 'last_price_update_time': 1774809458.411188}
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ37067') HTTP/1.1" 204 0
2026-03-29 18:37:38 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-29 18:37:38 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL27608%27 HTTP/1.1" 200 None
2026-03-29 18:37:38 [auto1.de] INFO: Scrape type for SL27608: 2
2026-03-29 18:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ea41838-591c-53a9-bb05-24d745d48a1e with identifier: SL27608
2026-03-29 18:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea41838-591c-53a9-bb05-24d745d48a1e with scrape type 2
2026-03-29 18:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ea41838-591c-53a9-bb05-24d745d48a1e with scrape type 2
2026-03-29 18:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ea41838-591c-53a9-bb05-24d745d48a1e, identifier: SL27608
2026-03-29 18:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ea41838-591c-53a9-bb05-24d745d48a1e with identifier: SL27608
2026-03-29 18:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ea41838-591c-53a9-bb05-24d745d48a1e with identifier: SL27608
2026-03-29 18:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ea41838-591c-53a9-bb05-24d745d48a1e with identifier: SL27608 to the API
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:21:11Z',
'fuel_type': 'petrol',
'id': '8ea41838-591c-53a9-bb05-24d745d48a1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL27608',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 91083,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-21',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL27608%27 HTTP/1.1" 200 None
2026-03-29 18:37:38 [auto1.de] INFO: Saving data for SL27608: {'auction_closing_time': 1774884071.0, 'created_time': 1774608320.578145, 'last_price_update_time': 1774809458.857991}
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL27608') HTTP/1.1" 204 0
2026-03-29 18:37:38 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-29 18:37:38 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-29 18:37:38 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA27410%27 HTTP/1.1" 200 None
2026-03-29 18:37:38 [auto1.de] INFO: Scrape type for JA27410: 0
2026-03-29 18:37:38 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-29 18:37:38 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-29 18:37:38 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR34423%27 HTTP/1.1" 200 None
2026-03-29 18:37:38 [auto1.de] INFO: Scrape type for VR34423: 2
2026-03-29 18:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53439014-b8b9-5213-b2c2-2a1af04affbd with identifier: VR34423
2026-03-29 18:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53439014-b8b9-5213-b2c2-2a1af04affbd with scrape type 2
2026-03-29 18:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53439014-b8b9-5213-b2c2-2a1af04affbd with scrape type 2
2026-03-29 18:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53439014-b8b9-5213-b2c2-2a1af04affbd, identifier: VR34423
2026-03-29 18:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53439014-b8b9-5213-b2c2-2a1af04affbd with identifier: VR34423
2026-03-29 18:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53439014-b8b9-5213-b2c2-2a1af04affbd with identifier: VR34423
2026-03-29 18:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53439014-b8b9-5213-b2c2-2a1af04affbd with identifier: VR34423 to the API
2026-03-29 18:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:01:50Z',
'fuel_type': 'petrol',
'id': '53439014-b8b9-5213-b2c2-2a1af04affbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR34423',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 95976,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-26',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 CGI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2012}
2026-03-29 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR34423%27 HTTP/1.1" 200 None
2026-03-29 18:37:39 [auto1.de] INFO: Saving data for VR34423: {'auction_closing_time': 1774882910.0, 'created_time': 1773429146.409993, 'last_price_update_time': 1774809459.325257}
2026-03-29 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR34423') HTTP/1.1" 204 0
2026-03-29 18:37:39 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-29 18:37:39 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-29 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ18000%27 HTTP/1.1" 200 None
2026-03-29 18:37:39 [auto1.de] INFO: Scrape type for UZ18000: 0
2026-03-29 18:37:39 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-29 18:37:39 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-29 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK70882%27 HTTP/1.1" 200 None
2026-03-29 18:37:39 [auto1.de] INFO: Scrape type for UK70882: 0
2026-03-29 18:37:39 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-29 18:37:39 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-29 18:37:39 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-29 18:37:39 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-29 18:37:39 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-29 18:37:39 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-29 18:37:39 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-29 18:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:43 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:43 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-29 18:37:43 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51641%27 HTTP/1.1" 200 None
2026-03-29 18:37:43 [auto1.de] INFO: Scrape type for SK51641: 0
2026-03-29 18:37:43 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10059%27 HTTP/1.1" 200 None
2026-03-29 18:37:43 [auto1.de] INFO: Scrape type for SP10059: 0
2026-03-29 18:37:43 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-29 18:37:43 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46305%27 HTTP/1.1" 200 None
2026-03-29 18:37:43 [auto1.de] INFO: Scrape type for VN46305: 2
2026-03-29 18:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 872d93b7-c682-5bd5-b48f-91f1eb807f59 with identifier: VN46305
2026-03-29 18:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 872d93b7-c682-5bd5-b48f-91f1eb807f59 with scrape type 2
2026-03-29 18:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 872d93b7-c682-5bd5-b48f-91f1eb807f59 with scrape type 2
2026-03-29 18:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 872d93b7-c682-5bd5-b48f-91f1eb807f59, identifier: VN46305
2026-03-29 18:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 872d93b7-c682-5bd5-b48f-91f1eb807f59 with identifier: VN46305
2026-03-29 18:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 872d93b7-c682-5bd5-b48f-91f1eb807f59 with identifier: VN46305
2026-03-29 18:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 872d93b7-c682-5bd5-b48f-91f1eb807f59 with identifier: VN46305 to the API
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 450,
'expiration_date': '2026-03-30T15:09:47Z',
'fuel_type': 'petrol',
'id': '872d93b7-c682-5bd5-b48f-91f1eb807f59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN46305',
'listing': 'auction',
'make': 'BMW',
'model': '7er',
'odometer': 180981,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-21',
'seller_name': None,
'title': 'BMW 7er 750i',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46305%27 HTTP/1.1" 200 None
2026-03-29 18:37:43 [auto1.de] INFO: Saving data for VN46305: {'auction_closing_time': 1774883387.0, 'created_time': 1774262458.17038, 'last_price_update_time': 1774809463.957244}
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN46305') HTTP/1.1" 204 0
2026-03-29 18:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:44 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-29 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ16115%27 HTTP/1.1" 200 None
2026-03-29 18:37:44 [auto1.de] INFO: Scrape type for TJ16115: 2
2026-03-29 18:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with identifier: TJ16115
2026-03-29 18:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with scrape type 2
2026-03-29 18:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with scrape type 2
2026-03-29 18:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47cd58ea-691f-574d-a63d-e5c94ebbc9a9, identifier: TJ16115
2026-03-29 18:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with identifier: TJ16115
2026-03-29 18:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with identifier: TJ16115
2026-03-29 18:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with identifier: TJ16115 to the API
2026-03-29 18:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:26:18Z',
'fuel_type': 'petrol',
'id': '47cd58ea-691f-574d-a63d-e5c94ebbc9a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ16115',
'listing': 'auction',
'make': 'Dodge',
'model': 'Journey',
'odometer': 118837,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-07-21',
'seller_name': None,
'title': 'Dodge Journey 2.4 SE',
'transmission': 'manual',
'trim': 'SE',
'year': 2008}
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ16115%27 HTTP/1.1" 200 None
2026-03-29 18:37:46 [auto1.de] INFO: Saving data for TJ16115: {'auction_closing_time': 1774884378.0, 'created_time': 1774290667.910521, 'last_price_update_time': 1774809466.039116}
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ16115') HTTP/1.1" 204 0
2026-03-29 18:37:46 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK31212%27 HTTP/1.1" 200 None
2026-03-29 18:37:46 [auto1.de] INFO: Scrape type for JK31212: 2
2026-03-29 18:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bec0fae5-44c1-585d-a155-88ba83a17202 with identifier: JK31212
2026-03-29 18:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bec0fae5-44c1-585d-a155-88ba83a17202 with scrape type 2
2026-03-29 18:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bec0fae5-44c1-585d-a155-88ba83a17202 with scrape type 2
2026-03-29 18:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bec0fae5-44c1-585d-a155-88ba83a17202, identifier: JK31212
2026-03-29 18:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bec0fae5-44c1-585d-a155-88ba83a17202 with identifier: JK31212
2026-03-29 18:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bec0fae5-44c1-585d-a155-88ba83a17202 with identifier: JK31212
2026-03-29 18:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bec0fae5-44c1-585d-a155-88ba83a17202 with identifier: JK31212 to the API
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:54:32Z',
'fuel_type': 'petrol',
'id': 'bec0fae5-44c1-585d-a155-88ba83a17202',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK31212',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 82790,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-12-08',
'seller_name': None,
'title': 'Audi A6 2.0',
'transmission': 'automatic',
'trim': '',
'year': 2002}
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK31212%27 HTTP/1.1" 200 None
2026-03-29 18:37:46 [auto1.de] INFO: Saving data for JK31212: {'auction_closing_time': 1774886072.0, 'created_time': 1773687366.318032, 'last_price_update_time': 1774809466.493107}
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK31212') HTTP/1.1" 204 0
2026-03-29 18:37:46 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-29 18:37:46 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM03586%27 HTTP/1.1" 200 None
2026-03-29 18:37:46 [auto1.de] INFO: Scrape type for SM03586: 0
2026-03-29 18:37:46 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY29921%27 HTTP/1.1" 200 None
2026-03-29 18:37:46 [auto1.de] INFO: Scrape type for MY29921: 2
2026-03-29 18:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with identifier: MY29921
2026-03-29 18:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with scrape type 2
2026-03-29 18:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with scrape type 2
2026-03-29 18:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32d5e899-fa8a-53c8-a15b-f7e8611c50b2, identifier: MY29921
2026-03-29 18:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with identifier: MY29921
2026-03-29 18:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with identifier: MY29921
2026-03-29 18:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with identifier: MY29921 to the API
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:38:49Z',
'fuel_type': 'diesel',
'id': '32d5e899-fa8a-53c8-a15b-f7e8611c50b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY29921',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 197127,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-29',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2015}
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY29921%27 HTTP/1.1" 200 None
2026-03-29 18:37:46 [auto1.de] INFO: Saving data for MY29921: {'auction_closing_time': 1774885129.0, 'created_time': 1774293283.051733, 'last_price_update_time': 1774809466.993935}
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY29921') HTTP/1.1" 204 0
2026-03-29 18:37:47 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM08692%27 HTTP/1.1" 200 None
2026-03-29 18:37:47 [auto1.de] INFO: Scrape type for ZM08692: 2
2026-03-29 18:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76f7498c-7868-53a3-a7cb-16238f9114c5 with identifier: ZM08692
2026-03-29 18:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f7498c-7868-53a3-a7cb-16238f9114c5 with scrape type 2
2026-03-29 18:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76f7498c-7868-53a3-a7cb-16238f9114c5 with scrape type 2
2026-03-29 18:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76f7498c-7868-53a3-a7cb-16238f9114c5, identifier: ZM08692
2026-03-29 18:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76f7498c-7868-53a3-a7cb-16238f9114c5 with identifier: ZM08692
2026-03-29 18:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76f7498c-7868-53a3-a7cb-16238f9114c5 with identifier: ZM08692
2026-03-29 18:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76f7498c-7868-53a3-a7cb-16238f9114c5 with identifier: ZM08692 to the API
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 255,
'expiration_date': '2026-03-30T15:52:10Z',
'fuel_type': 'diesel',
'id': '76f7498c-7868-53a3-a7cb-16238f9114c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM08692',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Discovery 4',
'odometer': 287320,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-01',
'seller_name': None,
'title': 'Land Rover Discovery 4 3.0 TD V6 SDV6 HSE',
'transmission': 'automatic',
'trim': 'SDV6 HSE',
'year': 2013}
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM08692%27 HTTP/1.1" 200 None
2026-03-29 18:37:47 [auto1.de] INFO: Saving data for ZM08692: {'auction_closing_time': 1774885930.0, 'created_time': 1774290637.775782, 'last_price_update_time': 1774809467.440912}
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM08692') HTTP/1.1" 204 0
2026-03-29 18:37:47 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-29 18:37:47 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-29 18:37:47 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN13511%27 HTTP/1.1" 200 None
2026-03-29 18:37:47 [auto1.de] INFO: Scrape type for UN13511: 2
2026-03-29 18:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37544f20-f4f9-5ba6-a37e-5c299210d676 with identifier: UN13511
2026-03-29 18:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37544f20-f4f9-5ba6-a37e-5c299210d676 with scrape type 2
2026-03-29 18:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37544f20-f4f9-5ba6-a37e-5c299210d676 with scrape type 2
2026-03-29 18:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37544f20-f4f9-5ba6-a37e-5c299210d676, identifier: UN13511
2026-03-29 18:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37544f20-f4f9-5ba6-a37e-5c299210d676 with identifier: UN13511
2026-03-29 18:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37544f20-f4f9-5ba6-a37e-5c299210d676 with identifier: UN13511
2026-03-29 18:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37544f20-f4f9-5ba6-a37e-5c299210d676 with identifier: UN13511 to the API
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 145,
'expiration_date': '2026-03-30T15:37:17Z',
'fuel_type': 'petrol',
'id': '37544f20-f4f9-5ba6-a37e-5c299210d676',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN13511',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 17692,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-14',
'seller_name': None,
'title': 'Ford Focus 2.0 Ghia',
'transmission': 'manual',
'trim': 'Ghia',
'year': 2009}
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN13511%27 HTTP/1.1" 200 None
2026-03-29 18:37:47 [auto1.de] INFO: Saving data for UN13511: {'auction_closing_time': 1774885037.0, 'created_time': 1772546597.414282, 'last_price_update_time': 1774809467.934012}
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN13511') HTTP/1.1" 204 0
2026-03-29 18:37:47 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61504%27 HTTP/1.1" 200 None
2026-03-29 18:37:47 [auto1.de] INFO: Scrape type for GD61504: 2
2026-03-29 18:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with identifier: GD61504
2026-03-29 18:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with scrape type 2
2026-03-29 18:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with scrape type 2
2026-03-29 18:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58, identifier: GD61504
2026-03-29 18:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with identifier: GD61504
2026-03-29 18:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with identifier: GD61504
2026-03-29 18:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with identifier: GD61504 to the API
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:11:34Z',
'fuel_type': 'diesel',
'id': '6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD61504',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 202964,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-05-29',
'seller_name': None,
'title': 'Renault Trafic 1.9 Diesel L1H1 2,7t verglast',
'transmission': 'manual',
'trim': 'L1H1 2,7t verglast',
'year': 2006}
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61504%27 HTTP/1.1" 200 None
2026-03-29 18:37:48 [auto1.de] INFO: Saving data for GD61504: {'auction_closing_time': 1774883494.0, 'created_time': 1774608284.094619, 'last_price_update_time': 1774809468.433171}
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD61504') HTTP/1.1" 204 0
2026-03-29 18:37:48 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-29 18:37:48 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-29 18:37:48 [auto1.de] INFO: Found listing with ID: KE06488
2026-03-29 18:37:48 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86111%27 HTTP/1.1" 200 None
2026-03-29 18:37:48 [auto1.de] INFO: Scrape type for RC86111: 0
2026-03-29 18:37:48 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR75394%27 HTTP/1.1" 200 None
2026-03-29 18:37:48 [auto1.de] INFO: Scrape type for VR75394: 0
2026-03-29 18:37:48 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-29 18:37:48 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ26035%27 HTTP/1.1" 200 None
2026-03-29 18:37:48 [auto1.de] INFO: Scrape type for XJ26035: 2
2026-03-29 18:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db92ae2d-2098-5620-ae30-97002b745125 with identifier: XJ26035
2026-03-29 18:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db92ae2d-2098-5620-ae30-97002b745125 with scrape type 2
2026-03-29 18:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db92ae2d-2098-5620-ae30-97002b745125 with scrape type 2
2026-03-29 18:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db92ae2d-2098-5620-ae30-97002b745125, identifier: XJ26035
2026-03-29 18:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db92ae2d-2098-5620-ae30-97002b745125 with identifier: XJ26035
2026-03-29 18:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db92ae2d-2098-5620-ae30-97002b745125 with identifier: XJ26035
2026-03-29 18:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db92ae2d-2098-5620-ae30-97002b745125 with identifier: XJ26035 to the API
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 441,
'expiration_date': '2026-03-30T15:39:35Z',
'fuel_type': 'petrol',
'id': 'db92ae2d-2098-5620-ae30-97002b745125',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ26035',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 109422,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-13',
'seller_name': None,
'title': 'Porsche Macan Turbo',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ26035%27 HTTP/1.1" 200 None
2026-03-29 18:37:49 [auto1.de] INFO: Saving data for XJ26035: {'auction_closing_time': 1774885175.0, 'created_time': 1774033108.242731, 'last_price_update_time': 1774809469.612965}
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ26035') HTTP/1.1" 204 0
2026-03-29 18:37:49 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-29 18:37:49 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH26905%27 HTTP/1.1" 200 None
2026-03-29 18:37:49 [auto1.de] INFO: Scrape type for GH26905: 2
2026-03-29 18:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbdaabe3-6e66-5477-b63e-84e78944a4af with identifier: GH26905
2026-03-29 18:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbdaabe3-6e66-5477-b63e-84e78944a4af with scrape type 2
2026-03-29 18:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbdaabe3-6e66-5477-b63e-84e78944a4af with scrape type 2
2026-03-29 18:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbdaabe3-6e66-5477-b63e-84e78944a4af, identifier: GH26905
2026-03-29 18:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbdaabe3-6e66-5477-b63e-84e78944a4af with identifier: GH26905
2026-03-29 18:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbdaabe3-6e66-5477-b63e-84e78944a4af with identifier: GH26905
2026-03-29 18:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbdaabe3-6e66-5477-b63e-84e78944a4af with identifier: GH26905 to the API
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:50:21Z',
'fuel_type': 'petrol',
'id': 'cbdaabe3-6e66-5477-b63e-84e78944a4af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH26905',
'listing': 'auction',
'make': 'Cupra',
'model': 'Ateca',
'odometer': 80304,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-10',
'seller_name': None,
'title': 'Cupra Ateca 2.0 TSI 4Drive',
'transmission': 'automatic',
'trim': '4Drive',
'year': 2020}
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH26905%27 HTTP/1.1" 200 None
2026-03-29 18:37:50 [auto1.de] INFO: Saving data for GH26905: {'auction_closing_time': 1774885821.0, 'created_time': 1773427149.562784, 'last_price_update_time': 1774809470.153796}
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH26905') HTTP/1.1" 204 0
2026-03-29 18:37:50 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP45415%27 HTTP/1.1" 200 None
2026-03-29 18:37:50 [auto1.de] INFO: Scrape type for GP45415: 0
2026-03-29 18:37:50 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-29 18:37:50 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-29 18:37:50 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-29 18:37:50 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE22716%27 HTTP/1.1" 200 None
2026-03-29 18:37:50 [auto1.de] INFO: Scrape type for FE22716: 2
2026-03-29 18:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19e4b5d2-d01e-5883-9a4c-4d9267968632 with identifier: FE22716
2026-03-29 18:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19e4b5d2-d01e-5883-9a4c-4d9267968632 with scrape type 2
2026-03-29 18:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19e4b5d2-d01e-5883-9a4c-4d9267968632 with scrape type 2
2026-03-29 18:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19e4b5d2-d01e-5883-9a4c-4d9267968632, identifier: FE22716
2026-03-29 18:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19e4b5d2-d01e-5883-9a4c-4d9267968632 with identifier: FE22716
2026-03-29 18:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19e4b5d2-d01e-5883-9a4c-4d9267968632 with identifier: FE22716
2026-03-29 18:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19e4b5d2-d01e-5883-9a4c-4d9267968632 with identifier: FE22716 to the API
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:50:03Z',
'fuel_type': 'diesel',
'id': '19e4b5d2-d01e-5883-9a4c-4d9267968632',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE22716',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai+2',
'odometer': 218551,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-07',
'seller_name': None,
'title': 'Nissan Qashqai+2 2.0 dCi Acenta 4x4',
'transmission': 'automatic',
'trim': 'Acenta 4x4',
'year': 2012}
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE22716%27 HTTP/1.1" 200 None
2026-03-29 18:37:50 [auto1.de] INFO: Saving data for FE22716: {'auction_closing_time': 1774885803.0, 'created_time': 1774032081.666348, 'last_price_update_time': 1774809470.604026}
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE22716') HTTP/1.1" 204 0
2026-03-29 18:37:50 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-29 18:37:50 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN77653%27 HTTP/1.1" 200 None
2026-03-29 18:37:50 [auto1.de] INFO: Scrape type for YN77653: 2
2026-03-29 18:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with identifier: YN77653
2026-03-29 18:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with scrape type 2
2026-03-29 18:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with scrape type 2
2026-03-29 18:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55, identifier: YN77653
2026-03-29 18:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with identifier: YN77653
2026-03-29 18:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with identifier: YN77653
2026-03-29 18:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with identifier: YN77653 to the API
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:57:49Z',
'fuel_type': 'petrol',
'id': '4d58a9c3-eb96-5374-bd3a-e25ea28cbe55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN77653',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 115894,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-08',
'seller_name': None,
'title': 'Opel Mokka X 1.4 Turbo Active Start/Stop',
'transmission': 'manual',
'trim': 'Active Start/Stop',
'year': 2017}
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN77653%27 HTTP/1.1" 200 None
2026-03-29 18:37:52 [auto1.de] INFO: Saving data for YN77653: {'auction_closing_time': 1774886269.0, 'created_time': 1774292602.629372, 'last_price_update_time': 1774809472.025837}
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN77653') HTTP/1.1" 204 0
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU59417%27 HTTP/1.1" 200 None
2026-03-29 18:37:52 [auto1.de] INFO: Scrape type for ZU59417: 2
2026-03-29 18:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with identifier: ZU59417
2026-03-29 18:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with scrape type 2
2026-03-29 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with scrape type 2
2026-03-29 18:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8407425c-0f4f-5956-89f3-e7d9d7d49a3d, identifier: ZU59417
2026-03-29 18:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with identifier: ZU59417
2026-03-29 18:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with identifier: ZU59417
2026-03-29 18:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with identifier: ZU59417 to the API
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:38:05Z',
'fuel_type': 'petrol',
'id': '8407425c-0f4f-5956-89f3-e7d9d7d49a3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU59417',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 73259,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-29',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2019}
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU59417%27 HTTP/1.1" 200 None
2026-03-29 18:37:52 [auto1.de] INFO: Saving data for ZU59417: {'auction_closing_time': 1774885085.0, 'created_time': 1774290961.666728, 'last_price_update_time': 1774809472.48318}
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU59417') HTTP/1.1" 204 0
2026-03-29 18:37:52 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS57817%27 HTTP/1.1" 200 None
2026-03-29 18:37:52 [auto1.de] INFO: Scrape type for CS57817: 0
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD95746%27 HTTP/1.1" 200 None
2026-03-29 18:37:52 [auto1.de] INFO: Scrape type for DD95746: 2
2026-03-29 18:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba4d6faf-7794-57b8-aa46-6a2e86217fc1 with identifier: DD95746
2026-03-29 18:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba4d6faf-7794-57b8-aa46-6a2e86217fc1 with scrape type 2
2026-03-29 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba4d6faf-7794-57b8-aa46-6a2e86217fc1 with scrape type 2
2026-03-29 18:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba4d6faf-7794-57b8-aa46-6a2e86217fc1, identifier: DD95746
2026-03-29 18:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba4d6faf-7794-57b8-aa46-6a2e86217fc1 with identifier: DD95746
2026-03-29 18:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba4d6faf-7794-57b8-aa46-6a2e86217fc1 with identifier: DD95746
2026-03-29 18:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba4d6faf-7794-57b8-aa46-6a2e86217fc1 with identifier: DD95746 to the API
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:32:44Z',
'fuel_type': 'diesel',
'id': 'ba4d6faf-7794-57b8-aa46-6a2e86217fc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD95746',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 183906,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-07-14',
'seller_name': None,
'title': 'Peugeot 207 1.4 HDi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2008}
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD95746%27 HTTP/1.1" 200 None
2026-03-29 18:37:52 [auto1.de] INFO: Saving data for DD95746: {'auction_closing_time': 1774884764.0, 'created_time': 1774522020.987534, 'last_price_update_time': 1774809472.991449}
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD95746') HTTP/1.1" 204 0
2026-03-29 18:37:53 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK33939%27 HTTP/1.1" 200 None
2026-03-29 18:37:53 [auto1.de] INFO: Scrape type for ZK33939: 2
2026-03-29 18:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59572df7-6846-5744-b8a3-18f3703c3a22 with identifier: ZK33939
2026-03-29 18:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59572df7-6846-5744-b8a3-18f3703c3a22 with scrape type 2
2026-03-29 18:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59572df7-6846-5744-b8a3-18f3703c3a22 with scrape type 2
2026-03-29 18:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59572df7-6846-5744-b8a3-18f3703c3a22, identifier: ZK33939
2026-03-29 18:37:53 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN07086%27 HTTP/1.1" 200 None
2026-03-29 18:37:53 [auto1.de] INFO: Scrape type for PN07086: 2
2026-03-29 18:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 964c03a8-0229-5468-9a5f-ec28bd95931c with identifier: PN07086
2026-03-29 18:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 964c03a8-0229-5468-9a5f-ec28bd95931c with scrape type 2
2026-03-29 18:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 964c03a8-0229-5468-9a5f-ec28bd95931c with scrape type 2
2026-03-29 18:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 964c03a8-0229-5468-9a5f-ec28bd95931c, identifier: PN07086
2026-03-29 18:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59572df7-6846-5744-b8a3-18f3703c3a22 with identifier: ZK33939
2026-03-29 18:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59572df7-6846-5744-b8a3-18f3703c3a22 with identifier: ZK33939
2026-03-29 18:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59572df7-6846-5744-b8a3-18f3703c3a22 with identifier: ZK33939 to the API
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:25:52Z',
'fuel_type': 'petrol',
'id': '59572df7-6846-5744-b8a3-18f3703c3a22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK33939',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 83156,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-28',
'seller_name': None,
'title': 'Opel Meriva 1.6 Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2008}
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK33939%27 HTTP/1.1" 200 None
2026-03-29 18:37:53 [auto1.de] INFO: Saving data for ZK33939: {'auction_closing_time': 1774884352.0, 'created_time': 1773945660.808408, 'last_price_update_time': 1774809473.549038}
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK33939') HTTP/1.1" 204 0
2026-03-29 18:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 964c03a8-0229-5468-9a5f-ec28bd95931c with identifier: PN07086
2026-03-29 18:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 964c03a8-0229-5468-9a5f-ec28bd95931c with identifier: PN07086
2026-03-29 18:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 964c03a8-0229-5468-9a5f-ec28bd95931c with identifier: PN07086 to the API
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:34:18Z',
'fuel_type': 'petrol',
'id': '964c03a8-0229-5468-9a5f-ec28bd95931c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN07086',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 52722,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-06',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.5 eTSI ACT Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2020}
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN07086%27 HTTP/1.1" 200 None
2026-03-29 18:37:53 [auto1.de] INFO: Saving data for PN07086: {'auction_closing_time': 1774884858.0, 'created_time': 1774033885.18282, 'last_price_update_time': 1774809473.84891}
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN07086') HTTP/1.1" 204 0
2026-03-29 18:37:53 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-29 18:37:53 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA17140%27 HTTP/1.1" 200 None
2026-03-29 18:37:53 [auto1.de] INFO: Scrape type for SA17140: 2
2026-03-29 18:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f30114d-9415-58c7-92e8-2767ed86cde6 with identifier: SA17140
2026-03-29 18:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f30114d-9415-58c7-92e8-2767ed86cde6 with scrape type 2
2026-03-29 18:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f30114d-9415-58c7-92e8-2767ed86cde6 with scrape type 2
2026-03-29 18:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f30114d-9415-58c7-92e8-2767ed86cde6, identifier: SA17140
2026-03-29 18:37:53 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV27706%27 HTTP/1.1" 200 None
2026-03-29 18:37:53 [auto1.de] INFO: Scrape type for RV27706: 2
2026-03-29 18:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f63d19a2-3a56-5424-a9a8-ffd37e82437e with identifier: RV27706
2026-03-29 18:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f63d19a2-3a56-5424-a9a8-ffd37e82437e with scrape type 2
2026-03-29 18:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f63d19a2-3a56-5424-a9a8-ffd37e82437e with scrape type 2
2026-03-29 18:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f63d19a2-3a56-5424-a9a8-ffd37e82437e, identifier: RV27706
2026-03-29 18:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f30114d-9415-58c7-92e8-2767ed86cde6 with identifier: SA17140
2026-03-29 18:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f30114d-9415-58c7-92e8-2767ed86cde6 with identifier: SA17140
2026-03-29 18:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f30114d-9415-58c7-92e8-2767ed86cde6 with identifier: SA17140 to the API
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:35:27Z',
'fuel_type': 'petrol',
'id': '1f30114d-9415-58c7-92e8-2767ed86cde6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA17140',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse Limousine',
'odometer': 113973,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-13',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse Limousine A 220 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2019}
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA17140%27 HTTP/1.1" 200 None
2026-03-29 18:37:54 [auto1.de] INFO: Saving data for SA17140: {'auction_closing_time': 1774884927.0, 'created_time': 1774033696.031654, 'last_price_update_time': 1774809474.442695}
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA17140') HTTP/1.1" 204 0
2026-03-29 18:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f63d19a2-3a56-5424-a9a8-ffd37e82437e with identifier: RV27706
2026-03-29 18:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f63d19a2-3a56-5424-a9a8-ffd37e82437e with identifier: RV27706
2026-03-29 18:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f63d19a2-3a56-5424-a9a8-ffd37e82437e with identifier: RV27706 to the API
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:16:41Z',
'fuel_type': 'diesel',
'id': 'f63d19a2-3a56-5424-a9a8-ffd37e82437e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV27706',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 382650,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-07-17',
'seller_name': None,
'title': 'Mercedes-Benz Vito 120 CDI lang',
'transmission': 'automatic',
'trim': 'lang',
'year': 2006}
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV27706%27 HTTP/1.1" 200 None
2026-03-29 18:37:54 [auto1.de] INFO: Saving data for RV27706: {'auction_closing_time': 1774883801.0, 'created_time': 1773945462.486029, 'last_price_update_time': 1774809474.732258}
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV27706') HTTP/1.1" 204 0
2026-03-29 18:37:54 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-29 18:37:54 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-29 18:37:54 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-29 18:37:54 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-29 18:37:54 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE21190%27 HTTP/1.1" 200 None
2026-03-29 18:37:54 [auto1.de] INFO: Scrape type for HE21190: 2
2026-03-29 18:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12692d1e-1eba-53ba-ae46-7cd61805a25c with identifier: HE21190
2026-03-29 18:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12692d1e-1eba-53ba-ae46-7cd61805a25c with scrape type 2
2026-03-29 18:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12692d1e-1eba-53ba-ae46-7cd61805a25c with scrape type 2
2026-03-29 18:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12692d1e-1eba-53ba-ae46-7cd61805a25c, identifier: HE21190
2026-03-29 18:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12692d1e-1eba-53ba-ae46-7cd61805a25c with identifier: HE21190
2026-03-29 18:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12692d1e-1eba-53ba-ae46-7cd61805a25c with identifier: HE21190
2026-03-29 18:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12692d1e-1eba-53ba-ae46-7cd61805a25c with identifier: HE21190 to the API
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:53:48Z',
'fuel_type': 'diesel',
'id': '12692d1e-1eba-53ba-ae46-7cd61805a25c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE21190',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 340663,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-28',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2019}
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE21190%27 HTTP/1.1" 200 None
2026-03-29 18:37:55 [auto1.de] INFO: Saving data for HE21190: {'auction_closing_time': 1774886028.0, 'created_time': 1773427394.700474, 'last_price_update_time': 1774809475.154381}
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE21190') HTTP/1.1" 204 0
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: US71241
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US71241%27 HTTP/1.1" 200 None
2026-03-29 18:37:55 [auto1.de] INFO: Scrape type for US71241: 0
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97637%27 HTTP/1.1" 200 None
2026-03-29 18:37:55 [auto1.de] INFO: Scrape type for MY97637: 0
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY49162%27 HTTP/1.1" 200 None
2026-03-29 18:37:55 [auto1.de] INFO: Scrape type for YY49162: 2
2026-03-29 18:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with identifier: YY49162
2026-03-29 18:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with scrape type 2
2026-03-29 18:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with scrape type 2
2026-03-29 18:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9, identifier: YY49162
2026-03-29 18:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with identifier: YY49162
2026-03-29 18:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with identifier: YY49162
2026-03-29 18:37:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with identifier: YY49162 to the API
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:04:06Z',
'fuel_type': 'diesel',
'id': 'a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY49162',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 149561,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-12',
'seller_name': None,
'title': 'BMW 3er 320d xDrive Advantage',
'transmission': 'automatic',
'trim': 'xDrive Advantage',
'year': 2018}
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY49162%27 HTTP/1.1" 200 None
2026-03-29 18:37:55 [auto1.de] INFO: Saving data for YY49162: {'auction_closing_time': 1774883046.0, 'created_time': 1773686500.708663, 'last_price_update_time': 1774809475.725578}
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY49162') HTTP/1.1" 204 0
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21224%27 HTTP/1.1" 200 None
2026-03-29 18:37:55 [auto1.de] INFO: Scrape type for JR21224: 2
2026-03-29 18:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72ccc8b5-084f-5d38-95de-9803e74d340e with identifier: JR21224
2026-03-29 18:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72ccc8b5-084f-5d38-95de-9803e74d340e with scrape type 2
2026-03-29 18:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72ccc8b5-084f-5d38-95de-9803e74d340e with scrape type 2
2026-03-29 18:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72ccc8b5-084f-5d38-95de-9803e74d340e, identifier: JR21224
2026-03-29 18:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72ccc8b5-084f-5d38-95de-9803e74d340e with identifier: JR21224
2026-03-29 18:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72ccc8b5-084f-5d38-95de-9803e74d340e with identifier: JR21224
2026-03-29 18:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72ccc8b5-084f-5d38-95de-9803e74d340e with identifier: JR21224 to the API
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:00:02Z',
'fuel_type': 'petrol',
'id': '72ccc8b5-084f-5d38-95de-9803e74d340e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR21224',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 152431,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-11',
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2019}
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21224%27 HTTP/1.1" 200 None
2026-03-29 18:37:56 [auto1.de] INFO: Saving data for JR21224: {'auction_closing_time': 1774882802.0, 'created_time': 1774349484.681611, 'last_price_update_time': 1774809476.297417}
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR21224') HTTP/1.1" 204 0
2026-03-29 18:37:56 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-29 18:37:56 [auto1.de] INFO: Found listing with ID: VU36521
2026-03-29 18:37:56 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-29 18:37:56 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-29 18:37:56 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-29 18:37:56 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG38928%27 HTTP/1.1" 200 None
2026-03-29 18:37:56 [auto1.de] INFO: Scrape type for HG38928: 2
2026-03-29 18:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1ba8c85-2681-5cce-a209-5d5ee797d431 with identifier: HG38928
2026-03-29 18:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1ba8c85-2681-5cce-a209-5d5ee797d431 with scrape type 2
2026-03-29 18:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1ba8c85-2681-5cce-a209-5d5ee797d431 with scrape type 2
2026-03-29 18:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1ba8c85-2681-5cce-a209-5d5ee797d431, identifier: HG38928
2026-03-29 18:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1ba8c85-2681-5cce-a209-5d5ee797d431 with identifier: HG38928
2026-03-29 18:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1ba8c85-2681-5cce-a209-5d5ee797d431 with identifier: HG38928
2026-03-29 18:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1ba8c85-2681-5cce-a209-5d5ee797d431 with identifier: HG38928 to the API
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:27:35Z',
'fuel_type': 'diesel',
'id': 'b1ba8c85-2681-5cce-a209-5d5ee797d431',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG38928',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 184302,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-12',
'seller_name': None,
'title': 'BMW 5er 530d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2014}
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG38928%27 HTTP/1.1" 200 None
2026-03-29 18:37:56 [auto1.de] INFO: Saving data for HG38928: {'auction_closing_time': 1774884455.0, 'created_time': 1773946137.082673, 'last_price_update_time': 1774809476.71663}
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG38928') HTTP/1.1" 204 0
2026-03-29 18:37:56 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT99615%27 HTTP/1.1" 200 None
2026-03-29 18:37:56 [auto1.de] INFO: Scrape type for JT99615: 0
2026-03-29 18:37:56 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF59303%27 HTTP/1.1" 200 None
2026-03-29 18:37:56 [auto1.de] INFO: Scrape type for DF59303: 2
2026-03-29 18:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dec8777f-db22-5074-8234-bea71fe8a5c3 with identifier: DF59303
2026-03-29 18:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dec8777f-db22-5074-8234-bea71fe8a5c3 with scrape type 2
2026-03-29 18:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dec8777f-db22-5074-8234-bea71fe8a5c3 with scrape type 2
2026-03-29 18:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dec8777f-db22-5074-8234-bea71fe8a5c3, identifier: DF59303
2026-03-29 18:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dec8777f-db22-5074-8234-bea71fe8a5c3 with identifier: DF59303
2026-03-29 18:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dec8777f-db22-5074-8234-bea71fe8a5c3 with identifier: DF59303
2026-03-29 18:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dec8777f-db22-5074-8234-bea71fe8a5c3 with identifier: DF59303 to the API
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:37:00Z',
'fuel_type': 'petrol',
'id': 'dec8777f-db22-5074-8234-bea71fe8a5c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF59303',
'listing': 'auction',
'make': 'Fiat',
'model': '500C',
'odometer': 19573,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-27',
'seller_name': None,
'title': 'Fiat 500C 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2017}
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF59303%27 HTTP/1.1" 200 None
2026-03-29 18:37:57 [auto1.de] INFO: Saving data for DF59303: {'auction_closing_time': 1774885020.0, 'created_time': 1774349141.749505, 'last_price_update_time': 1774809477.200716}
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF59303') HTTP/1.1" 204 0
2026-03-29 18:37:57 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-29 18:37:57 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-29 18:37:57 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-29 18:37:57 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-29 18:37:57 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-29 18:37:57 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-29 18:37:57 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW56389%27 HTTP/1.1" 200 None
2026-03-29 18:37:57 [auto1.de] INFO: Scrape type for VW56389: 2
2026-03-29 18:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with identifier: VW56389
2026-03-29 18:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with scrape type 2
2026-03-29 18:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with scrape type 2
2026-03-29 18:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e, identifier: VW56389
2026-03-29 18:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with identifier: VW56389
2026-03-29 18:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with identifier: VW56389
2026-03-29 18:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with identifier: VW56389 to the API
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:26:41Z',
'fuel_type': 'petrol',
'id': '9df2b1f6-ab6c-52b5-a538-bfdb67ae759e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW56389',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 62023,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-10',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2014}
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW56389%27 HTTP/1.1" 200 None
2026-03-29 18:37:57 [auto1.de] INFO: Saving data for VW56389: {'auction_closing_time': 1774884401.0, 'created_time': 1773860021.136409, 'last_price_update_time': 1774809477.641245}
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW56389') HTTP/1.1" 204 0
2026-03-29 18:37:57 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY33610%27 HTTP/1.1" 200 None
2026-03-29 18:37:57 [auto1.de] INFO: Scrape type for JY33610: 2
2026-03-29 18:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with identifier: JY33610
2026-03-29 18:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with scrape type 2
2026-03-29 18:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with scrape type 2
2026-03-29 18:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51, identifier: JY33610
2026-03-29 18:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with identifier: JY33610
2026-03-29 18:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with identifier: JY33610
2026-03-29 18:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with identifier: JY33610 to the API
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 199,
'expiration_date': '2026-03-30T15:01:01Z',
'fuel_type': 'diesel',
'id': 'b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY33610',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 California',
'odometer': 101289,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-24',
'seller_name': None,
'title': 'Volkswagen T6 California 2.0 TDI Ocean Edition 4Motion',
'transmission': 'automatic',
'trim': 'Ocean Edition 4Motion',
'year': 2020}
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY33610%27 HTTP/1.1" 200 None
2026-03-29 18:37:58 [auto1.de] INFO: Saving data for JY33610: {'auction_closing_time': 1774882861.0, 'created_time': 1774607709.888909, 'last_price_update_time': 1774809478.213165}
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY33610') HTTP/1.1" 204 0
2026-03-29 18:37:58 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04457%27 HTTP/1.1" 200 None
2026-03-29 18:37:58 [auto1.de] INFO: Scrape type for HM04457: 2
2026-03-29 18:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with identifier: HM04457
2026-03-29 18:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with scrape type 2
2026-03-29 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with scrape type 2
2026-03-29 18:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b, identifier: HM04457
2026-03-29 18:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with identifier: HM04457
2026-03-29 18:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with identifier: HM04457
2026-03-29 18:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with identifier: HM04457 to the API
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:45:45Z',
'fuel_type': 'petrol',
'id': '78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM04457',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 129544,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-28',
'seller_name': None,
'title': 'Ford Focus 1.6 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2009}
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04457%27 HTTP/1.1" 200 None
2026-03-29 18:37:58 [auto1.de] INFO: Saving data for HM04457: {'auction_closing_time': 1774885545.0, 'created_time': 1773304569.610432, 'last_price_update_time': 1774809478.650847}
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM04457') HTTP/1.1" 204 0
2026-03-29 18:37:58 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-29 18:37:58 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN90928%27 HTTP/1.1" 200 None
2026-03-29 18:37:58 [auto1.de] INFO: Scrape type for EN90928: 2
2026-03-29 18:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1156df4f-c722-5115-9af4-73ce3228f788 with identifier: EN90928
2026-03-29 18:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1156df4f-c722-5115-9af4-73ce3228f788 with scrape type 2
2026-03-29 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1156df4f-c722-5115-9af4-73ce3228f788 with scrape type 2
2026-03-29 18:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1156df4f-c722-5115-9af4-73ce3228f788, identifier: EN90928
2026-03-29 18:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1156df4f-c722-5115-9af4-73ce3228f788 with identifier: EN90928
2026-03-29 18:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1156df4f-c722-5115-9af4-73ce3228f788 with identifier: EN90928
2026-03-29 18:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1156df4f-c722-5115-9af4-73ce3228f788 with identifier: EN90928 to the API
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:44:43Z',
'fuel_type': 'diesel',
'id': '1156df4f-c722-5115-9af4-73ce3228f788',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN90928',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 96705,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-26',
'seller_name': None,
'title': 'BMW 3er 320d Mild-Hybrid M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2021}
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN90928%27 HTTP/1.1" 200 None
2026-03-29 18:37:59 [auto1.de] INFO: Saving data for EN90928: {'auction_closing_time': 1774885483.0, 'created_time': 1774034104.837985, 'last_price_update_time': 1774809479.099412}
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN90928') HTTP/1.1" 204 0
2026-03-29 18:37:59 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG29776%27 HTTP/1.1" 200 None
2026-03-29 18:37:59 [auto1.de] INFO: Scrape type for KG29776: 0
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB29698%27 HTTP/1.1" 200 None
2026-03-29 18:37:59 [auto1.de] INFO: Scrape type for RB29698: 2
2026-03-29 18:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a319af6a-c378-55f1-9170-ea84f8a6abf5 with identifier: RB29698
2026-03-29 18:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a319af6a-c378-55f1-9170-ea84f8a6abf5 with scrape type 2
2026-03-29 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a319af6a-c378-55f1-9170-ea84f8a6abf5 with scrape type 2
2026-03-29 18:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a319af6a-c378-55f1-9170-ea84f8a6abf5, identifier: RB29698
2026-03-29 18:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a319af6a-c378-55f1-9170-ea84f8a6abf5 with identifier: RB29698
2026-03-29 18:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a319af6a-c378-55f1-9170-ea84f8a6abf5 with identifier: RB29698
2026-03-29 18:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a319af6a-c378-55f1-9170-ea84f8a6abf5 with identifier: RB29698 to the API
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:25:20Z',
'fuel_type': 'diesel',
'id': 'a319af6a-c378-55f1-9170-ea84f8a6abf5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB29698',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 294198,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-26',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2017}
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB29698%27 HTTP/1.1" 200 None
2026-03-29 18:37:59 [auto1.de] INFO: Saving data for RB29698: {'auction_closing_time': 1774884320.0, 'created_time': 1772541363.997127, 'last_price_update_time': 1774809479.600961}
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB29698') HTTP/1.1" 204 0
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU35402%27 HTTP/1.1" 200 None
2026-03-29 18:37:59 [auto1.de] INFO: Scrape type for MU35402: 0
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV83127%27 HTTP/1.1" 200 None
2026-03-29 18:37:59 [auto1.de] INFO: Scrape type for ZV83127: 0
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK79873%27 HTTP/1.1" 200 None
2026-03-29 18:37:59 [auto1.de] INFO: Scrape type for CK79873: 2
2026-03-29 18:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe047b51-72f5-552c-84ed-2f45b2927b3c with identifier: CK79873
2026-03-29 18:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe047b51-72f5-552c-84ed-2f45b2927b3c with scrape type 2
2026-03-29 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe047b51-72f5-552c-84ed-2f45b2927b3c with scrape type 2
2026-03-29 18:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe047b51-72f5-552c-84ed-2f45b2927b3c, identifier: CK79873
2026-03-29 18:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe047b51-72f5-552c-84ed-2f45b2927b3c with identifier: CK79873
2026-03-29 18:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe047b51-72f5-552c-84ed-2f45b2927b3c with identifier: CK79873
2026-03-29 18:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe047b51-72f5-552c-84ed-2f45b2927b3c with identifier: CK79873 to the API
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:25:15Z',
'fuel_type': 'diesel',
'id': 'fe047b51-72f5-552c-84ed-2f45b2927b3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK79873',
'listing': 'auction',
'make': 'Volvo',
'model': 'V60 Cross Country',
'odometer': 193061,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-11',
'seller_name': None,
'title': 'Volvo V60 Cross Country 2.0 D4 Momentum',
'transmission': 'automatic',
'trim': 'Momentum',
'year': 2016}
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK79873%27 HTTP/1.1" 200 None
2026-03-29 18:38:00 [auto1.de] INFO: Saving data for CK79873: {'auction_closing_time': 1774884315.0, 'created_time': 1774607717.798057, 'last_price_update_time': 1774809480.092848}
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK79873') HTTP/1.1" 204 0
2026-03-29 18:38:00 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH09734%27 HTTP/1.1" 200 None
2026-03-29 18:38:00 [auto1.de] INFO: Scrape type for LH09734: 2
2026-03-29 18:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with identifier: LH09734
2026-03-29 18:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with scrape type 2
2026-03-29 18:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with scrape type 2
2026-03-29 18:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4c443d6-9323-5407-b7d9-0540c9b1d9f4, identifier: LH09734
2026-03-29 18:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with identifier: LH09734
2026-03-29 18:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with identifier: LH09734
2026-03-29 18:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with identifier: LH09734 to the API
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:44:56Z',
'fuel_type': 'diesel',
'id': 'd4c443d6-9323-5407-b7d9-0540c9b1d9f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH09734',
'listing': 'auction',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 31533,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-24',
'seller_name': None,
'title': 'Seat Tarraco 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2023}
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH09734%27 HTTP/1.1" 200 None
2026-03-29 18:38:00 [auto1.de] INFO: Saving data for LH09734: {'auction_closing_time': 1774885496.0, 'created_time': 1773427264.380778, 'last_price_update_time': 1774809480.672989}
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH09734') HTTP/1.1" 204 0
2026-03-29 18:38:00 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-29 18:38:00 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-29 18:38:00 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ89661%27 HTTP/1.1" 200 None
2026-03-29 18:38:00 [auto1.de] INFO: Scrape type for CZ89661: 2
2026-03-29 18:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 604475fb-0a77-588c-b7d4-a3667d135f58 with identifier: CZ89661
2026-03-29 18:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 604475fb-0a77-588c-b7d4-a3667d135f58 with scrape type 2
2026-03-29 18:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 604475fb-0a77-588c-b7d4-a3667d135f58 with scrape type 2
2026-03-29 18:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 604475fb-0a77-588c-b7d4-a3667d135f58, identifier: CZ89661
2026-03-29 18:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 604475fb-0a77-588c-b7d4-a3667d135f58 with identifier: CZ89661
2026-03-29 18:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 604475fb-0a77-588c-b7d4-a3667d135f58 with identifier: CZ89661
2026-03-29 18:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 604475fb-0a77-588c-b7d4-a3667d135f58 with identifier: CZ89661 to the API
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:31:34Z',
'fuel_type': 'petrol',
'id': '604475fb-0a77-588c-b7d4-a3667d135f58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ89661',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 72383,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-27',
'seller_name': None,
'title': 'Opel Mokka X 1.6 Selection Start/Stop',
'transmission': 'manual',
'trim': 'Selection Start/Stop',
'year': 2016}
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ89661%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Saving data for CZ89661: {'auction_closing_time': 1774884694.0, 'created_time': 1773467350.095299, 'last_price_update_time': 1774809481.122539}
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ89661') HTTP/1.1" 204 0
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL73598%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Scrape type for XL73598: 0
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77478%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Scrape type for YA77478: 0
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW99572%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Scrape type for MW99572: 0
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU18213%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Scrape type for UU18213: 0
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY56723%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Scrape type for ZY56723: 0
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ94843%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Scrape type for HJ94843: 0
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW33957%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Scrape type for BW33957: 0
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU42459%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Scrape type for ZU42459: 2
2026-03-29 18:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fc8146a-c68a-538c-9f2c-f86396a85877 with identifier: ZU42459
2026-03-29 18:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fc8146a-c68a-538c-9f2c-f86396a85877 with scrape type 2
2026-03-29 18:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fc8146a-c68a-538c-9f2c-f86396a85877 with scrape type 2
2026-03-29 18:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fc8146a-c68a-538c-9f2c-f86396a85877, identifier: ZU42459
2026-03-29 18:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fc8146a-c68a-538c-9f2c-f86396a85877 with identifier: ZU42459
2026-03-29 18:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fc8146a-c68a-538c-9f2c-f86396a85877 with identifier: ZU42459
2026-03-29 18:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fc8146a-c68a-538c-9f2c-f86396a85877 with identifier: ZU42459 to the API
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:30:07Z',
'fuel_type': 'petrol',
'id': '4fc8146a-c68a-538c-9f2c-f86396a85877',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU42459',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 126061,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-23',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2011}
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU42459%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Saving data for ZU42459: {'auction_closing_time': 1774884607.0, 'created_time': 1773553623.348858, 'last_price_update_time': 1774809481.690516}
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU42459') HTTP/1.1" 204 0
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD60070%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Scrape type for YD60070: 0
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA27289%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Scrape type for CA27289: 0
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF67159%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Scrape type for ZF67159: 2
2026-03-29 18:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b2a7a36-a626-5768-a530-7b5257554d7a with identifier: ZF67159
2026-03-29 18:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b2a7a36-a626-5768-a530-7b5257554d7a with scrape type 2
2026-03-29 18:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b2a7a36-a626-5768-a530-7b5257554d7a with scrape type 2
2026-03-29 18:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b2a7a36-a626-5768-a530-7b5257554d7a, identifier: ZF67159
2026-03-29 18:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b2a7a36-a626-5768-a530-7b5257554d7a with identifier: ZF67159
2026-03-29 18:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b2a7a36-a626-5768-a530-7b5257554d7a with identifier: ZF67159
2026-03-29 18:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b2a7a36-a626-5768-a530-7b5257554d7a with identifier: ZF67159 to the API
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:37:14Z',
'fuel_type': 'petrol',
'id': '2b2a7a36-a626-5768-a530-7b5257554d7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF67159',
'listing': 'auction',
'make': 'MINI',
'model': 'Clubman',
'odometer': 75424,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-01',
'seller_name': None,
'title': 'MINI Clubman John Cooper Works ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2021}
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF67159%27 HTTP/1.1" 200 None
2026-03-29 18:38:02 [auto1.de] INFO: Saving data for ZF67159: {'auction_closing_time': 1774885034.0, 'created_time': 1773400589.124209, 'last_price_update_time': 1774809482.313302}
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF67159') HTTP/1.1" 204 0
2026-03-29 18:38:02 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW80278%27 HTTP/1.1" 200 None
2026-03-29 18:38:02 [auto1.de] INFO: Scrape type for CW80278: 2
2026-03-29 18:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f7498b0-b528-5310-a1b7-2578b4ad20aa with identifier: CW80278
2026-03-29 18:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7498b0-b528-5310-a1b7-2578b4ad20aa with scrape type 2
2026-03-29 18:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f7498b0-b528-5310-a1b7-2578b4ad20aa with scrape type 2
2026-03-29 18:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f7498b0-b528-5310-a1b7-2578b4ad20aa, identifier: CW80278
2026-03-29 18:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f7498b0-b528-5310-a1b7-2578b4ad20aa with identifier: CW80278
2026-03-29 18:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f7498b0-b528-5310-a1b7-2578b4ad20aa with identifier: CW80278
2026-03-29 18:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f7498b0-b528-5310-a1b7-2578b4ad20aa with identifier: CW80278 to the API
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:47:11Z',
'fuel_type': 'petrol',
'id': '7f7498b0-b528-5310-a1b7-2578b4ad20aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW80278',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand C-Max',
'odometer': 161376,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-25',
'seller_name': None,
'title': 'Ford Grand C-Max 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2016}
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW80278%27 HTTP/1.1" 200 None
2026-03-29 18:38:02 [auto1.de] INFO: Saving data for CW80278: {'auction_closing_time': 1774885631.0, 'created_time': 1774002301.362958, 'last_price_update_time': 1774809482.755212}
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW80278') HTTP/1.1" 204 0
2026-03-29 18:38:02 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-29 18:38:02 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-29 18:38:02 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP47747%27 HTTP/1.1" 200 None
2026-03-29 18:38:02 [auto1.de] INFO: Scrape type for WP47747: 2
2026-03-29 18:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with identifier: WP47747
2026-03-29 18:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with scrape type 2
2026-03-29 18:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with scrape type 2
2026-03-29 18:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16, identifier: WP47747
2026-03-29 18:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with identifier: WP47747
2026-03-29 18:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with identifier: WP47747
2026-03-29 18:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with identifier: WP47747 to the API
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:10:52Z',
'fuel_type': 'petrol',
'id': '4bbc95e2-a1ab-5df4-8482-2c6da3d42c16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP47747',
'listing': 'auction',
'make': 'Opel',
'model': 'Combo',
'odometer': 132429,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-31',
'seller_name': None,
'title': 'Opel Combo 1.4 Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2009}
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP47747%27 HTTP/1.1" 200 None
2026-03-29 18:38:03 [auto1.de] INFO: Saving data for WP47747: {'auction_closing_time': 1774883452.0, 'created_time': 1773686305.440238, 'last_price_update_time': 1774809483.213071}
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP47747') HTTP/1.1" 204 0
2026-03-29 18:38:03 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-29 18:38:03 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-29 18:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:03 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:03 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-29 18:38:03 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43520%27 HTTP/1.1" 200 None
2026-03-29 18:38:03 [auto1.de] INFO: Scrape type for LW43520: 2
2026-03-29 18:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f648146f-81a6-5d32-9c4c-e785b339883d with identifier: LW43520
2026-03-29 18:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f648146f-81a6-5d32-9c4c-e785b339883d with scrape type 2
2026-03-29 18:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f648146f-81a6-5d32-9c4c-e785b339883d with scrape type 2
2026-03-29 18:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f648146f-81a6-5d32-9c4c-e785b339883d, identifier: LW43520
2026-03-29 18:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f648146f-81a6-5d32-9c4c-e785b339883d with identifier: LW43520
2026-03-29 18:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f648146f-81a6-5d32-9c4c-e785b339883d with identifier: LW43520
2026-03-29 18:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f648146f-81a6-5d32-9c4c-e785b339883d with identifier: LW43520 to the API
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 390,
'expiration_date': '2026-03-30T15:20:50Z',
'fuel_type': 'petrol',
'id': 'f648146f-81a6-5d32-9c4c-e785b339883d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW43520',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 33685,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-28',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2023}
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43520%27 HTTP/1.1" 200 None
2026-03-29 18:38:04 [auto1.de] INFO: Saving data for LW43520: {'auction_closing_time': 1774884050.0, 'created_time': 1773469105.092581, 'last_price_update_time': 1774809484.099996}
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW43520') HTTP/1.1" 204 0
2026-03-29 18:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:04 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-29 18:38:04 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-29 18:38:04 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR99181%27 HTTP/1.1" 200 None
2026-03-29 18:38:04 [auto1.de] INFO: Scrape type for WR99181: 2
2026-03-29 18:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612a6b31-5044-57df-a10e-0a9b2401b357 with identifier: WR99181
2026-03-29 18:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612a6b31-5044-57df-a10e-0a9b2401b357 with scrape type 2
2026-03-29 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612a6b31-5044-57df-a10e-0a9b2401b357 with scrape type 2
2026-03-29 18:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 612a6b31-5044-57df-a10e-0a9b2401b357, identifier: WR99181
2026-03-29 18:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 612a6b31-5044-57df-a10e-0a9b2401b357 with identifier: WR99181
2026-03-29 18:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 612a6b31-5044-57df-a10e-0a9b2401b357 with identifier: WR99181
2026-03-29 18:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 612a6b31-5044-57df-a10e-0a9b2401b357 with identifier: WR99181 to the API
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:55:26Z',
'fuel_type': 'petrol',
'id': '612a6b31-5044-57df-a10e-0a9b2401b357',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR99181',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 109774,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-10-31',
'seller_name': None,
'title': 'Smart fortwo 0.7 Turbo Basis pure',
'transmission': 'automatic',
'trim': 'Basis pure',
'year': 2005}
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR99181%27 HTTP/1.1" 200 None
2026-03-29 18:38:04 [auto1.de] INFO: Saving data for WR99181: {'auction_closing_time': 1774886126.0, 'created_time': 1774607679.08843, 'last_price_update_time': 1774809484.774912}
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR99181') HTTP/1.1" 204 0
2026-03-29 18:38:04 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD58993%27 HTTP/1.1" 200 None
2026-03-29 18:38:04 [auto1.de] INFO: Scrape type for XD58993: 2
2026-03-29 18:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with identifier: XD58993
2026-03-29 18:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with scrape type 2
2026-03-29 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with scrape type 2
2026-03-29 18:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab34de3c-8ce6-5bd7-a9cf-2943e620d101, identifier: XD58993
2026-03-29 18:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with identifier: XD58993
2026-03-29 18:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with identifier: XD58993
2026-03-29 18:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with identifier: XD58993 to the API
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:39:38Z',
'fuel_type': 'petrol',
'id': 'ab34de3c-8ce6-5bd7-a9cf-2943e620d101',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD58993',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 79439,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-19',
'seller_name': None,
'title': 'BMW 1er 118i',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD58993%27 HTTP/1.1" 200 None
2026-03-29 18:38:05 [auto1.de] INFO: Saving data for XD58993: {'auction_closing_time': 1774885178.0, 'created_time': 1774292078.54508, 'last_price_update_time': 1774809485.22859}
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD58993') HTTP/1.1" 204 0
2026-03-29 18:38:05 [auto1.de] INFO: Found listing with ID: KS42383
2026-03-29 18:38:05 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME12043%27 HTTP/1.1" 200 None
2026-03-29 18:38:05 [auto1.de] INFO: Scrape type for ME12043: 0
2026-03-29 18:38:05 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-29 18:38:05 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-29 18:38:05 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97280%27 HTTP/1.1" 200 None
2026-03-29 18:38:05 [auto1.de] INFO: Scrape type for SD97280: 2
2026-03-29 18:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with identifier: SD97280
2026-03-29 18:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with scrape type 2
2026-03-29 18:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with scrape type 2
2026-03-29 18:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b5963f9-ef84-5b9f-a541-c9a37890e0a9, identifier: SD97280
2026-03-29 18:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with identifier: SD97280
2026-03-29 18:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with identifier: SD97280
2026-03-29 18:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with identifier: SD97280 to the API
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:38:31Z',
'fuel_type': 'diesel',
'id': '7b5963f9-ef84-5b9f-a541-c9a37890e0a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD97280',
'listing': 'auction',
'make': 'Volvo',
'model': 'S60',
'odometer': 185187,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-31',
'seller_name': None,
'title': 'Volvo S60 2.0 D3 Linje Business',
'transmission': 'manual',
'trim': 'Linje Business',
'year': 2015}
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97280%27 HTTP/1.1" 200 None
2026-03-29 18:38:05 [auto1.de] INFO: Saving data for SD97280: {'auction_closing_time': 1774885111.0, 'created_time': 1773134171.075775, 'last_price_update_time': 1774809485.67722}
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD97280') HTTP/1.1" 204 0
2026-03-29 18:38:05 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-29 18:38:05 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP02747%27 HTTP/1.1" 200 None
2026-03-29 18:38:05 [auto1.de] INFO: Scrape type for BP02747: 2
2026-03-29 18:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7734d4b9-6b07-545e-a7ab-6e568f141601 with identifier: BP02747
2026-03-29 18:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7734d4b9-6b07-545e-a7ab-6e568f141601 with scrape type 2
2026-03-29 18:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7734d4b9-6b07-545e-a7ab-6e568f141601 with scrape type 2
2026-03-29 18:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7734d4b9-6b07-545e-a7ab-6e568f141601, identifier: BP02747
2026-03-29 18:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7734d4b9-6b07-545e-a7ab-6e568f141601 with identifier: BP02747
2026-03-29 18:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7734d4b9-6b07-545e-a7ab-6e568f141601 with identifier: BP02747
2026-03-29 18:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7734d4b9-6b07-545e-a7ab-6e568f141601 with identifier: BP02747 to the API
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 184,
'expiration_date': '2026-03-30T15:40:14Z',
'fuel_type': 'petrol',
'id': '7734d4b9-6b07-545e-a7ab-6e568f141601',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP02747',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 10974,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-23',
'seller_name': None,
'title': 'BMW X3 xDrive 20i Mild-Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP02747%27 HTTP/1.1" 200 None
2026-03-29 18:38:06 [auto1.de] INFO: Saving data for BP02747: {'auction_closing_time': 1774885214.0, 'created_time': 1774608305.765001, 'last_price_update_time': 1774809486.128617}
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP02747') HTTP/1.1" 204 0
2026-03-29 18:38:06 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT37883%27 HTTP/1.1" 200 None
2026-03-29 18:38:06 [auto1.de] INFO: Scrape type for BT37883: 2
2026-03-29 18:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7974582-960f-5013-b4df-96d3b932e76d with identifier: BT37883
2026-03-29 18:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7974582-960f-5013-b4df-96d3b932e76d with scrape type 2
2026-03-29 18:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7974582-960f-5013-b4df-96d3b932e76d with scrape type 2
2026-03-29 18:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7974582-960f-5013-b4df-96d3b932e76d, identifier: BT37883
2026-03-29 18:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7974582-960f-5013-b4df-96d3b932e76d with identifier: BT37883
2026-03-29 18:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7974582-960f-5013-b4df-96d3b932e76d with identifier: BT37883
2026-03-29 18:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7974582-960f-5013-b4df-96d3b932e76d with identifier: BT37883 to the API
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:40:15Z',
'fuel_type': 'petrol',
'id': 'c7974582-960f-5013-b4df-96d3b932e76d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT37883',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 232234,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-08-31',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 S line Sportpaket plus',
'transmission': 'manual',
'trim': 'S line Sportpaket plus',
'year': 2005}
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT37883%27 HTTP/1.1" 200 None
2026-03-29 18:38:06 [auto1.de] INFO: Saving data for BT37883: {'auction_closing_time': 1774885215.0, 'created_time': 1774118411.2241, 'last_price_update_time': 1774809486.622845}
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT37883') HTTP/1.1" 204 0
2026-03-29 18:38:06 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST29936%27 HTTP/1.1" 200 None
2026-03-29 18:38:06 [auto1.de] INFO: Scrape type for ST29936: 2
2026-03-29 18:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a1433d5-6377-5255-bb72-e615eac3ab3d with identifier: ST29936
2026-03-29 18:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a1433d5-6377-5255-bb72-e615eac3ab3d with scrape type 2
2026-03-29 18:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a1433d5-6377-5255-bb72-e615eac3ab3d with scrape type 2
2026-03-29 18:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a1433d5-6377-5255-bb72-e615eac3ab3d, identifier: ST29936
2026-03-29 18:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a1433d5-6377-5255-bb72-e615eac3ab3d with identifier: ST29936
2026-03-29 18:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a1433d5-6377-5255-bb72-e615eac3ab3d with identifier: ST29936
2026-03-29 18:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a1433d5-6377-5255-bb72-e615eac3ab3d with identifier: ST29936 to the API
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:24:39Z',
'fuel_type': 'petrol',
'id': '2a1433d5-6377-5255-bb72-e615eac3ab3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST29936',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 130929,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-08-06',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 230 Kompressor',
'transmission': 'automatic',
'trim': '',
'year': 2003}
2026-03-29 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST29936%27 HTTP/1.1" 200 None
2026-03-29 18:38:07 [auto1.de] INFO: Saving data for ST29936: {'auction_closing_time': 1774884279.0, 'created_time': 1773429062.924315, 'last_price_update_time': 1774809487.005836}
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST29936') HTTP/1.1" 204 0
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX04560%27 HTTP/1.1" 200 None
2026-03-29 18:38:07 [auto1.de] INFO: Scrape type for RX04560: 0
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW79588%27 HTTP/1.1" 200 None
2026-03-29 18:38:07 [auto1.de] INFO: Scrape type for VW79588: 0
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV26342%27 HTTP/1.1" 200 None
2026-03-29 18:38:07 [auto1.de] INFO: Scrape type for FV26342: 2
2026-03-29 18:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with identifier: FV26342
2026-03-29 18:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with scrape type 2
2026-03-29 18:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with scrape type 2
2026-03-29 18:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1be89d9f-5d60-5d7a-8895-4cb06c51f066, identifier: FV26342
2026-03-29 18:38:07 [scrapy.extensions.logstats] INFO: Crawled 86 pages (at 9 pages/min), scraped 605 items (at 102 items/min)
2026-03-29 18:38:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with identifier: FV26342
2026-03-29 18:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with identifier: FV26342
2026-03-29 18:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with identifier: FV26342 to the API
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:24:51Z',
'fuel_type': 'diesel',
'id': '1be89d9f-5d60-5d7a-8895-4cb06c51f066',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV26342',
'listing': 'auction',
'make': 'Ford',
'model': 'Ranger',
'odometer': 190760,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-06-12',
'seller_name': None,
'title': 'Ford Ranger 2.5 Diesel Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2003}
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV26342%27 HTTP/1.1" 200 None
2026-03-29 18:38:07 [auto1.de] INFO: Saving data for FV26342: {'auction_closing_time': 1774884291.0, 'created_time': 1773830756.372274, 'last_price_update_time': 1774809487.489293}
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV26342') HTTP/1.1" 204 0
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX03120%27 HTTP/1.1" 200 None
2026-03-29 18:38:07 [auto1.de] INFO: Scrape type for DX03120: 0
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV59464%27 HTTP/1.1" 200 None
2026-03-29 18:38:07 [auto1.de] INFO: Scrape type for UV59464: 2
2026-03-29 18:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83e36d07-94e8-560a-b8f0-07eae5eb2454 with identifier: UV59464
2026-03-29 18:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83e36d07-94e8-560a-b8f0-07eae5eb2454 with scrape type 2
2026-03-29 18:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83e36d07-94e8-560a-b8f0-07eae5eb2454 with scrape type 2
2026-03-29 18:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83e36d07-94e8-560a-b8f0-07eae5eb2454, identifier: UV59464
2026-03-29 18:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83e36d07-94e8-560a-b8f0-07eae5eb2454 with identifier: UV59464
2026-03-29 18:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83e36d07-94e8-560a-b8f0-07eae5eb2454 with identifier: UV59464
2026-03-29 18:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83e36d07-94e8-560a-b8f0-07eae5eb2454 with identifier: UV59464 to the API
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:31:23Z',
'fuel_type': 'petrol',
'id': '83e36d07-94e8-560a-b8f0-07eae5eb2454',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV59464',
'listing': 'auction',
'make': 'Skoda',
'model': 'Citigo',
'odometer': 188397,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-21',
'seller_name': None,
'title': 'Skoda Citigo 1.0 MPI Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2015}
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV59464%27 HTTP/1.1" 200 None
2026-03-29 18:38:07 [auto1.de] INFO: Saving data for UV59464: {'auction_closing_time': 1774884683.0, 'created_time': 1774089426.211989, 'last_price_update_time': 1774809487.900438}
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV59464') HTTP/1.1" 204 0
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS49465%27 HTTP/1.1" 200 None
2026-03-29 18:38:07 [auto1.de] INFO: Scrape type for GS49465: 0
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF35410%27 HTTP/1.1" 200 None
2026-03-29 18:38:07 [auto1.de] INFO: Scrape type for HF35410: 0
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS53664%27 HTTP/1.1" 200 None
2026-03-29 18:38:07 [auto1.de] INFO: Scrape type for NS53664: 0
2026-03-29 18:38:07 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU97792%27 HTTP/1.1" 200 None
2026-03-29 18:38:07 [auto1.de] INFO: Scrape type for TU97792: 2
2026-03-29 18:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with identifier: TU97792
2026-03-29 18:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with scrape type 2
2026-03-29 18:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with scrape type 2
2026-03-29 18:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf, identifier: TU97792
2026-03-29 18:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with identifier: TU97792
2026-03-29 18:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with identifier: TU97792
2026-03-29 18:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with identifier: TU97792 to the API
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 349,
'expiration_date': '2026-03-30T15:59:03Z',
'fuel_type': 'diesel',
'id': '720c9c0a-b91f-5e92-bc08-7f234d3e9ddf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU97792',
'listing': 'auction',
'make': 'Audi',
'model': 'S6',
'odometer': 76073,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-09',
'seller_name': None,
'title': 'Audi S6 3.0 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2020}
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU97792%27 HTTP/1.1" 200 None
2026-03-29 18:38:08 [auto1.de] INFO: Saving data for TU97792: {'auction_closing_time': 1774886343.0, 'created_time': 1774293193.95069, 'last_price_update_time': 1774809488.422369}
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU97792') HTTP/1.1" 204 0
2026-03-29 18:38:08 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY67479%27 HTTP/1.1" 200 None
2026-03-29 18:38:08 [auto1.de] INFO: Scrape type for GY67479: 0
2026-03-29 18:38:08 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA44978%27 HTTP/1.1" 200 None
2026-03-29 18:38:08 [auto1.de] INFO: Scrape type for MA44978: 0
2026-03-29 18:38:08 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52113%27 HTTP/1.1" 200 None
2026-03-29 18:38:08 [auto1.de] INFO: Scrape type for VG52113: 2
2026-03-29 18:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a063b2c-7622-504b-8065-89a3b3ca6eea with identifier: VG52113
2026-03-29 18:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a063b2c-7622-504b-8065-89a3b3ca6eea with scrape type 2
2026-03-29 18:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a063b2c-7622-504b-8065-89a3b3ca6eea with scrape type 2
2026-03-29 18:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a063b2c-7622-504b-8065-89a3b3ca6eea, identifier: VG52113
2026-03-29 18:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a063b2c-7622-504b-8065-89a3b3ca6eea with identifier: VG52113
2026-03-29 18:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a063b2c-7622-504b-8065-89a3b3ca6eea with identifier: VG52113
2026-03-29 18:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a063b2c-7622-504b-8065-89a3b3ca6eea with identifier: VG52113 to the API
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:48:29Z',
'fuel_type': 'diesel',
'id': '9a063b2c-7622-504b-8065-89a3b3ca6eea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG52113',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 230400,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-22',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line AWD',
'transmission': 'automatic',
'trim': 'Exclusive-Line AWD',
'year': 2015}
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52113%27 HTTP/1.1" 200 None
2026-03-29 18:38:08 [auto1.de] INFO: Saving data for VG52113: {'auction_closing_time': 1774885709.0, 'created_time': 1773307526.762141, 'last_price_update_time': 1774809488.995533}
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG52113') HTTP/1.1" 204 0
2026-03-29 18:38:09 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:09 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-29 18:38:09 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ51579%27 HTTP/1.1" 200 None
2026-03-29 18:38:09 [auto1.de] INFO: Scrape type for HZ51579: 2
2026-03-29 18:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff6a7cee-e898-5406-a99a-adc5d63a00ac with identifier: HZ51579
2026-03-29 18:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff6a7cee-e898-5406-a99a-adc5d63a00ac with scrape type 2
2026-03-29 18:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff6a7cee-e898-5406-a99a-adc5d63a00ac with scrape type 2
2026-03-29 18:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff6a7cee-e898-5406-a99a-adc5d63a00ac, identifier: HZ51579
2026-03-29 18:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff6a7cee-e898-5406-a99a-adc5d63a00ac with identifier: HZ51579
2026-03-29 18:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff6a7cee-e898-5406-a99a-adc5d63a00ac with identifier: HZ51579
2026-03-29 18:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff6a7cee-e898-5406-a99a-adc5d63a00ac with identifier: HZ51579 to the API
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:07:45Z',
'fuel_type': 'diesel',
'id': 'ff6a7cee-e898-5406-a99a-adc5d63a00ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ51579',
'listing': 'auction',
'make': 'Kia',
'model': 'Optima',
'odometer': 179632,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-07',
'seller_name': None,
'title': 'Kia Optima 1.7 CRDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2016}
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ51579%27 HTTP/1.1" 200 None
2026-03-29 18:38:09 [auto1.de] INFO: Saving data for HZ51579: {'auction_closing_time': 1774883265.0, 'created_time': 1774510234.155591, 'last_price_update_time': 1774809489.434193}
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ51579') HTTP/1.1" 204 0
2026-03-29 18:38:09 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-29 18:38:09 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-29 18:38:09 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX62190%27 HTTP/1.1" 200 None
2026-03-29 18:38:09 [auto1.de] INFO: Scrape type for CX62190: 0
2026-03-29 18:38:09 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ08081%27 HTTP/1.1" 200 None
2026-03-29 18:38:09 [auto1.de] INFO: Scrape type for VJ08081: 0
2026-03-29 18:38:09 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73698%27 HTTP/1.1" 200 None
2026-03-29 18:38:09 [auto1.de] INFO: Scrape type for WK73698: 2
2026-03-29 18:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 063e5226-f561-59c4-b604-86ba178dda17 with identifier: WK73698
2026-03-29 18:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 063e5226-f561-59c4-b604-86ba178dda17 with scrape type 2
2026-03-29 18:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 063e5226-f561-59c4-b604-86ba178dda17 with scrape type 2
2026-03-29 18:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 063e5226-f561-59c4-b604-86ba178dda17, identifier: WK73698
2026-03-29 18:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:09 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-29 18:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 063e5226-f561-59c4-b604-86ba178dda17 with identifier: WK73698
2026-03-29 18:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 063e5226-f561-59c4-b604-86ba178dda17 with identifier: WK73698
2026-03-29 18:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 063e5226-f561-59c4-b604-86ba178dda17 with identifier: WK73698 to the API
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:39:06Z',
'fuel_type': 'diesel',
'id': '063e5226-f561-59c4-b604-86ba178dda17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK73698',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 307803,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-24',
'seller_name': None,
'title': 'Audi A6 2.7 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2011}
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73698%27 HTTP/1.1" 200 None
2026-03-29 18:38:10 [auto1.de] INFO: Saving data for WK73698: {'auction_closing_time': 1774885146.0, 'created_time': 1774293139.644653, 'last_price_update_time': 1774809490.090049}
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK73698') HTTP/1.1" 204 0
2026-03-29 18:38:10 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE06888%27 HTTP/1.1" 200 None
2026-03-29 18:38:10 [auto1.de] INFO: Scrape type for RE06888: 0
2026-03-29 18:38:10 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-29 18:38:10 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83038%27 HTTP/1.1" 200 None
2026-03-29 18:38:10 [auto1.de] INFO: Scrape type for EE83038: 0
2026-03-29 18:38:10 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-29 18:38:10 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX72393%27 HTTP/1.1" 200 None
2026-03-29 18:38:10 [auto1.de] INFO: Scrape type for NX72393: 2
2026-03-29 18:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with identifier: NX72393
2026-03-29 18:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with scrape type 2
2026-03-29 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with scrape type 2
2026-03-29 18:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a, identifier: NX72393
2026-03-29 18:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with identifier: NX72393
2026-03-29 18:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with identifier: NX72393
2026-03-29 18:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with identifier: NX72393 to the API
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 184,
'expiration_date': '2026-03-30T15:46:18Z',
'fuel_type': 'diesel',
'id': '9dd84191-b856-5b15-9ba4-bf04d1a0ca9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX72393',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 119166,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-04',
'seller_name': None,
'title': 'Audi A3 Sportback 40 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX72393%27 HTTP/1.1" 200 None
2026-03-29 18:38:10 [auto1.de] INFO: Saving data for NX72393: {'auction_closing_time': 1774885578.0, 'created_time': 1773400932.846374, 'last_price_update_time': 1774809490.738725}
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX72393') HTTP/1.1" 204 0
2026-03-29 18:38:10 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE92439%27 HTTP/1.1" 200 None
2026-03-29 18:38:10 [auto1.de] INFO: Scrape type for HE92439: 2
2026-03-29 18:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bef224bb-6015-537b-9b19-ef4e79c364e7 with identifier: HE92439
2026-03-29 18:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bef224bb-6015-537b-9b19-ef4e79c364e7 with scrape type 2
2026-03-29 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bef224bb-6015-537b-9b19-ef4e79c364e7 with scrape type 2
2026-03-29 18:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bef224bb-6015-537b-9b19-ef4e79c364e7, identifier: HE92439
2026-03-29 18:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bef224bb-6015-537b-9b19-ef4e79c364e7 with identifier: HE92439
2026-03-29 18:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bef224bb-6015-537b-9b19-ef4e79c364e7 with identifier: HE92439
2026-03-29 18:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bef224bb-6015-537b-9b19-ef4e79c364e7 with identifier: HE92439 to the API
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 367,
'expiration_date': '2026-03-30T15:34:59Z',
'fuel_type': 'petrol',
'id': 'bef224bb-6015-537b-9b19-ef4e79c364e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE92439',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 84871,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-22',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 43 AMG T 4Matic',
'transmission': 'automatic',
'trim': 'T 4Matic',
'year': 2017}
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE92439%27 HTTP/1.1" 200 None
2026-03-29 18:38:11 [auto1.de] INFO: Saving data for HE92439: {'auction_closing_time': 1774884899.0, 'created_time': 1774330261.393096, 'last_price_update_time': 1774809491.29933}
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE92439') HTTP/1.1" 204 0
2026-03-29 18:38:11 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-29 18:38:11 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM36361%27 HTTP/1.1" 200 None
2026-03-29 18:38:11 [auto1.de] INFO: Scrape type for MM36361: 2
2026-03-29 18:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8af8be3-996b-5095-995f-4fd6fd4eb7ed with identifier: MM36361
2026-03-29 18:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8af8be3-996b-5095-995f-4fd6fd4eb7ed with scrape type 2
2026-03-29 18:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8af8be3-996b-5095-995f-4fd6fd4eb7ed with scrape type 2
2026-03-29 18:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8af8be3-996b-5095-995f-4fd6fd4eb7ed, identifier: MM36361
2026-03-29 18:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8af8be3-996b-5095-995f-4fd6fd4eb7ed with identifier: MM36361
2026-03-29 18:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8af8be3-996b-5095-995f-4fd6fd4eb7ed with identifier: MM36361
2026-03-29 18:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8af8be3-996b-5095-995f-4fd6fd4eb7ed with identifier: MM36361 to the API
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:29:28Z',
'fuel_type': 'petrol',
'id': 'f8af8be3-996b-5095-995f-4fd6fd4eb7ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM36361',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Colt',
'odometer': 120980,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-09',
'seller_name': None,
'title': 'Mitsubishi Colt 1.5 Invite',
'transmission': 'manual',
'trim': 'Invite',
'year': 2009}
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM36361%27 HTTP/1.1" 200 None
2026-03-29 18:38:11 [auto1.de] INFO: Saving data for MM36361: {'auction_closing_time': 1774884568.0, 'created_time': 1774032384.58589, 'last_price_update_time': 1774809491.710441}
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM36361') HTTP/1.1" 204 0
2026-03-29 18:38:11 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH26484%27 HTTP/1.1" 200 None
2026-03-29 18:38:11 [auto1.de] INFO: Scrape type for SH26484: 2
2026-03-29 18:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with identifier: SH26484
2026-03-29 18:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with scrape type 2
2026-03-29 18:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with scrape type 2
2026-03-29 18:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e, identifier: SH26484
2026-03-29 18:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with identifier: SH26484
2026-03-29 18:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with identifier: SH26484
2026-03-29 18:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with identifier: SH26484 to the API
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:57:51Z',
'fuel_type': 'petrol',
'id': '9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH26484',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 152397,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-27',
'seller_name': None,
'title': 'Skoda Octavia 1.5 TSI ACT Soleil',
'transmission': 'automatic',
'trim': 'Soleil',
'year': 2020}
2026-03-29 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH26484%27 HTTP/1.1" 200 None
2026-03-29 18:38:12 [auto1.de] INFO: Saving data for SH26484: {'auction_closing_time': 1774886271.0, 'created_time': 1773819034.431577, 'last_price_update_time': 1774809492.197123}
2026-03-29 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH26484') HTTP/1.1" 204 0
2026-03-29 18:38:12 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-29 18:38:12 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-29 18:38:12 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-29 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN48826%27 HTTP/1.1" 200 None
2026-03-29 18:38:12 [auto1.de] INFO: Scrape type for BN48826: 2
2026-03-29 18:38:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with identifier: BN48826
2026-03-29 18:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with scrape type 2
2026-03-29 18:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with scrape type 2
2026-03-29 18:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d2072bb-abe0-5396-9d15-155b7e92c1c6, identifier: BN48826
2026-03-29 18:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with identifier: BN48826
2026-03-29 18:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with identifier: BN48826
2026-03-29 18:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with identifier: BN48826 to the API
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:55:58Z',
'fuel_type': 'diesel',
'id': '3d2072bb-abe0-5396-9d15-155b7e92c1c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN48826',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 333254,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-21',
'seller_name': None,
'title': 'Volkswagen Caddy 1.9 TDI Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2009}
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN48826%27 HTTP/1.1" 200 None
2026-03-29 18:38:13 [auto1.de] INFO: Saving data for BN48826: {'auction_closing_time': 1774886158.0, 'created_time': 1774607724.093854, 'last_price_update_time': 1774809493.243462}
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN48826') HTTP/1.1" 204 0
2026-03-29 18:38:13 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH62706%27 HTTP/1.1" 200 None
2026-03-29 18:38:13 [auto1.de] INFO: Scrape type for VH62706: 0
2026-03-29 18:38:13 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ04570%27 HTTP/1.1" 200 None
2026-03-29 18:38:13 [auto1.de] INFO: Scrape type for NZ04570: 2
2026-03-29 18:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with identifier: NZ04570
2026-03-29 18:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with scrape type 2
2026-03-29 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with scrape type 2
2026-03-29 18:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b463400-3d4f-5b3a-9f36-335d5f2fa506, identifier: NZ04570
2026-03-29 18:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with identifier: NZ04570
2026-03-29 18:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with identifier: NZ04570
2026-03-29 18:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with identifier: NZ04570 to the API
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:31:17Z',
'fuel_type': 'diesel',
'id': '8b463400-3d4f-5b3a-9f36-335d5f2fa506',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ04570',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 96390,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-28',
'seller_name': None,
'title': 'BMW X3 xDrive 30d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2019}
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ04570%27 HTTP/1.1" 200 None
2026-03-29 18:38:13 [auto1.de] INFO: Saving data for NZ04570: {'auction_closing_time': 1774884677.0, 'created_time': 1773467017.480534, 'last_price_update_time': 1774809493.872079}
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ04570') HTTP/1.1" 204 0
2026-03-29 18:38:13 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-29 18:38:13 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC29722%27 HTTP/1.1" 200 None
2026-03-29 18:38:13 [auto1.de] INFO: Scrape type for FC29722: 2
2026-03-29 18:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with identifier: FC29722
2026-03-29 18:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with scrape type 2
2026-03-29 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with scrape type 2
2026-03-29 18:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b79e52d5-7216-5b83-9ff0-2b2e8efb8266, identifier: FC29722
2026-03-29 18:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with identifier: FC29722
2026-03-29 18:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with identifier: FC29722
2026-03-29 18:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with identifier: FC29722 to the API
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 260,
'expiration_date': '2026-03-30T15:52:17Z',
'fuel_type': 'petrol',
'id': 'b79e52d5-7216-5b83-9ff0-2b2e8efb8266',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC29722',
'listing': 'auction',
'make': 'Dodge',
'model': 'Nitro',
'odometer': 126228,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-06',
'seller_name': None,
'title': 'Dodge Nitro 4.0 V6 R/T',
'transmission': 'automatic',
'trim': 'R/T',
'year': 2013}
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC29722%27 HTTP/1.1" 200 None
2026-03-29 18:38:14 [auto1.de] INFO: Saving data for FC29722: {'auction_closing_time': 1774885937.0, 'created_time': 1773305217.884571, 'last_price_update_time': 1774809494.413727}
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC29722') HTTP/1.1" 204 0
2026-03-29 18:38:14 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB96923%27 HTTP/1.1" 200 None
2026-03-29 18:38:14 [auto1.de] INFO: Scrape type for EB96923: 0
2026-03-29 18:38:14 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK03693%27 HTTP/1.1" 200 None
2026-03-29 18:38:14 [auto1.de] INFO: Scrape type for XK03693: 0
2026-03-29 18:38:14 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-29 18:38:14 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG34789%27 HTTP/1.1" 200 None
2026-03-29 18:38:14 [auto1.de] INFO: Scrape type for AG34789: 0
2026-03-29 18:38:14 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL56832%27 HTTP/1.1" 200 None
2026-03-29 18:38:14 [auto1.de] INFO: Scrape type for WL56832: 0
2026-03-29 18:38:14 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-29 18:38:14 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-29 18:38:14 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-29 18:38:14 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR61415%27 HTTP/1.1" 200 None
2026-03-29 18:38:14 [auto1.de] INFO: Scrape type for MR61415: 2
2026-03-29 18:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b714281-c6a3-50fe-8f8a-7424b8d71064 with identifier: MR61415
2026-03-29 18:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b714281-c6a3-50fe-8f8a-7424b8d71064 with scrape type 2
2026-03-29 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b714281-c6a3-50fe-8f8a-7424b8d71064 with scrape type 2
2026-03-29 18:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b714281-c6a3-50fe-8f8a-7424b8d71064, identifier: MR61415
2026-03-29 18:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b714281-c6a3-50fe-8f8a-7424b8d71064 with identifier: MR61415
2026-03-29 18:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b714281-c6a3-50fe-8f8a-7424b8d71064 with identifier: MR61415
2026-03-29 18:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b714281-c6a3-50fe-8f8a-7424b8d71064 with identifier: MR61415 to the API
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:48:11Z',
'fuel_type': 'petrol',
'id': '2b714281-c6a3-50fe-8f8a-7424b8d71064',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR61415',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 74528,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-09',
'seller_name': None,
'title': 'Audi A4 40 TFSI Mild-Hybrid S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2019}
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR61415%27 HTTP/1.1" 200 None
2026-03-29 18:38:14 [auto1.de] INFO: Saving data for MR61415: {'auction_closing_time': 1774885691.0, 'created_time': 1773917462.964363, 'last_price_update_time': 1774809494.962155}
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR61415') HTTP/1.1" 204 0
2026-03-29 18:38:15 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA01659%27 HTTP/1.1" 200 None
2026-03-29 18:38:15 [auto1.de] INFO: Scrape type for SA01659: 2
2026-03-29 18:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1854b930-ef1e-5d8f-8eba-69fdb92ebd6e with identifier: SA01659
2026-03-29 18:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1854b930-ef1e-5d8f-8eba-69fdb92ebd6e with scrape type 2
2026-03-29 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1854b930-ef1e-5d8f-8eba-69fdb92ebd6e with scrape type 2
2026-03-29 18:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1854b930-ef1e-5d8f-8eba-69fdb92ebd6e, identifier: SA01659
2026-03-29 18:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1854b930-ef1e-5d8f-8eba-69fdb92ebd6e with identifier: SA01659
2026-03-29 18:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1854b930-ef1e-5d8f-8eba-69fdb92ebd6e with identifier: SA01659
2026-03-29 18:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1854b930-ef1e-5d8f-8eba-69fdb92ebd6e with identifier: SA01659 to the API
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:42:33Z',
'fuel_type': 'petrol',
'id': '1854b930-ef1e-5d8f-8eba-69fdb92ebd6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA01659',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 87955,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-29',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.2 TSI Lounge BlueMotion Tech',
'transmission': 'manual',
'trim': 'Lounge BlueMotion Tech',
'year': 2015}
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA01659%27 HTTP/1.1" 200 None
2026-03-29 18:38:15 [auto1.de] INFO: Saving data for SA01659: {'auction_closing_time': 1774885353.0, 'created_time': 1774521747.31023, 'last_price_update_time': 1774809495.471327}
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA01659') HTTP/1.1" 204 0
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20328%27 HTTP/1.1" 200 None
2026-03-29 18:38:15 [auto1.de] INFO: Scrape type for BB20328: 2
2026-03-29 18:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with identifier: BB20328
2026-03-29 18:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with scrape type 2
2026-03-29 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with scrape type 2
2026-03-29 18:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 169408c3-b369-5eab-a4dc-b53a94b9a0c7, identifier: BB20328
2026-03-29 18:38:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP87344%27 HTTP/1.1" 200 None
2026-03-29 18:38:15 [auto1.de] INFO: Scrape type for KP87344: 0
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS57219%27 HTTP/1.1" 200 None
2026-03-29 18:38:15 [auto1.de] INFO: Scrape type for MS57219: 0
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK29782%27 HTTP/1.1" 200 None
2026-03-29 18:38:15 [auto1.de] INFO: Scrape type for LK29782: 2
2026-03-29 18:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with identifier: LK29782
2026-03-29 18:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with scrape type 2
2026-03-29 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with scrape type 2
2026-03-29 18:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4d7e4c2-6335-5aa6-b768-99391cc6bd88, identifier: LK29782
2026-03-29 18:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with identifier: BB20328
2026-03-29 18:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with identifier: BB20328
2026-03-29 18:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with identifier: BB20328 to the API
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:54:55Z',
'fuel_type': 'diesel',
'id': '169408c3-b369-5eab-a4dc-b53a94b9a0c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB20328',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 266848,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-01',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Highline 4Motion',
'transmission': 'automatic',
'trim': 'Highline 4Motion',
'year': 2012}
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20328%27 HTTP/1.1" 200 None
2026-03-29 18:38:16 [auto1.de] INFO: Saving data for BB20328: {'auction_closing_time': 1774886095.0, 'created_time': 1773774729.471735, 'last_price_update_time': 1774809496.123021}
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB20328') HTTP/1.1" 204 0
2026-03-29 18:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with identifier: LK29782
2026-03-29 18:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with identifier: LK29782
2026-03-29 18:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with identifier: LK29782 to the API
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:35:33Z',
'fuel_type': 'petrol',
'id': 'a4d7e4c2-6335-5aa6-b768-99391cc6bd88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK29782',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Taigo',
'odometer': 23860,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-06',
'seller_name': None,
'title': 'Volkswagen Taigo 1.0 TSI',
'transmission': 'manual',
'trim': '',
'year': 2022}
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK29782%27 HTTP/1.1" 200 None
2026-03-29 18:38:16 [auto1.de] INFO: Saving data for LK29782: {'auction_closing_time': 1774884933.0, 'created_time': 1773427476.579495, 'last_price_update_time': 1774809496.456967}
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK29782') HTTP/1.1" 204 0
2026-03-29 18:38:16 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM51025%27 HTTP/1.1" 200 None
2026-03-29 18:38:16 [auto1.de] INFO: Scrape type for JM51025: 0
2026-03-29 18:38:16 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-29 18:38:16 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-29 18:38:16 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-29 18:38:16 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55927%27 HTTP/1.1" 200 None
2026-03-29 18:38:16 [auto1.de] INFO: Scrape type for TN55927: 0
2026-03-29 18:38:16 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-29 18:38:16 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-29 18:38:16 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-29 18:38:16 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV99140%27 HTTP/1.1" 200 None
2026-03-29 18:38:16 [auto1.de] INFO: Scrape type for EV99140: 2
2026-03-29 18:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb54719f-86a4-5e42-a83e-6bab6439cc75 with identifier: EV99140
2026-03-29 18:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb54719f-86a4-5e42-a83e-6bab6439cc75 with scrape type 2
2026-03-29 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb54719f-86a4-5e42-a83e-6bab6439cc75 with scrape type 2
2026-03-29 18:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb54719f-86a4-5e42-a83e-6bab6439cc75, identifier: EV99140
2026-03-29 18:38:16 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD39951%27 HTTP/1.1" 200 None
2026-03-29 18:38:16 [auto1.de] INFO: Scrape type for HD39951: 0
2026-03-29 18:38:16 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-29 18:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb54719f-86a4-5e42-a83e-6bab6439cc75 with identifier: EV99140
2026-03-29 18:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb54719f-86a4-5e42-a83e-6bab6439cc75 with identifier: EV99140
2026-03-29 18:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb54719f-86a4-5e42-a83e-6bab6439cc75 with identifier: EV99140 to the API
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:54:04Z',
'fuel_type': 'petrol',
'id': 'cb54719f-86a4-5e42-a83e-6bab6439cc75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV99140',
'listing': 'auction',
'make': 'Skoda',
'model': 'Rapid Spaceback',
'odometer': 102162,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-07',
'seller_name': None,
'title': 'Skoda Rapid Spaceback 1.0 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2018}
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV99140%27 HTTP/1.1" 200 None
2026-03-29 18:38:17 [auto1.de] INFO: Saving data for EV99140: {'auction_closing_time': 1774886044.0, 'created_time': 1773774569.567171, 'last_price_update_time': 1774809497.11781}
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV99140') HTTP/1.1" 204 0
2026-03-29 18:38:17 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW54456%27 HTTP/1.1" 200 None
2026-03-29 18:38:17 [auto1.de] INFO: Scrape type for EW54456: 0
2026-03-29 18:38:17 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-29 18:38:17 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM15631%27 HTTP/1.1" 200 None
2026-03-29 18:38:17 [auto1.de] INFO: Scrape type for GM15631: 0
2026-03-29 18:38:17 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-29 18:38:17 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW11176%27 HTTP/1.1" 200 None
2026-03-29 18:38:17 [auto1.de] INFO: Scrape type for EW11176: 2
2026-03-29 18:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c553dbc-0bb9-5aeb-b4f4-c84a9a601888 with identifier: EW11176
2026-03-29 18:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c553dbc-0bb9-5aeb-b4f4-c84a9a601888 with scrape type 2
2026-03-29 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c553dbc-0bb9-5aeb-b4f4-c84a9a601888 with scrape type 2
2026-03-29 18:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c553dbc-0bb9-5aeb-b4f4-c84a9a601888, identifier: EW11176
2026-03-29 18:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c553dbc-0bb9-5aeb-b4f4-c84a9a601888 with identifier: EW11176
2026-03-29 18:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c553dbc-0bb9-5aeb-b4f4-c84a9a601888 with identifier: EW11176
2026-03-29 18:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c553dbc-0bb9-5aeb-b4f4-c84a9a601888 with identifier: EW11176 to the API
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:57:21Z',
'fuel_type': 'diesel',
'id': '8c553dbc-0bb9-5aeb-b4f4-c84a9a601888',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW11176',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 142170,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-29',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2019}
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW11176%27 HTTP/1.1" 200 None
2026-03-29 18:38:17 [auto1.de] INFO: Saving data for EW11176: {'auction_closing_time': 1774886241.0, 'created_time': 1774522069.285753, 'last_price_update_time': 1774809497.7209}
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW11176') HTTP/1.1" 204 0
2026-03-29 18:38:17 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK51404%27 HTTP/1.1" 200 None
2026-03-29 18:38:17 [auto1.de] INFO: Scrape type for GK51404: 2
2026-03-29 18:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with identifier: GK51404
2026-03-29 18:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with scrape type 2
2026-03-29 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with scrape type 2
2026-03-29 18:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70, identifier: GK51404
2026-03-29 18:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with identifier: GK51404
2026-03-29 18:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with identifier: GK51404
2026-03-29 18:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with identifier: GK51404 to the API
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 408,
'expiration_date': '2026-03-30T15:54:25Z',
'fuel_type': 'petrol',
'id': '0d97d5d3-552b-5f3d-b4e5-1364ddd66e70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK51404',
'listing': 'auction',
'make': 'BMW',
'model': 'X6',
'odometer': 153790,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-20',
'seller_name': None,
'title': 'BMW X6 xDrive 50i',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK51404%27 HTTP/1.1" 200 None
2026-03-29 18:38:18 [auto1.de] INFO: Saving data for GK51404: {'auction_closing_time': 1774886065.0, 'created_time': 1774294616.505064, 'last_price_update_time': 1774809498.274941}
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK51404') HTTP/1.1" 204 0
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG67731%27 HTTP/1.1" 200 None
2026-03-29 18:38:18 [auto1.de] INFO: Scrape type for SG67731: 0
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY52691%27 HTTP/1.1" 200 None
2026-03-29 18:38:18 [auto1.de] INFO: Scrape type for VY52691: 0
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09309%27 HTTP/1.1" 200 None
2026-03-29 18:38:18 [auto1.de] INFO: Scrape type for PC09309: 0
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK79004%27 HTTP/1.1" 200 None
2026-03-29 18:38:18 [auto1.de] INFO: Scrape type for XK79004: 0
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG80642%27 HTTP/1.1" 200 None
2026-03-29 18:38:18 [auto1.de] INFO: Scrape type for LG80642: 0
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN24694%27 HTTP/1.1" 200 None
2026-03-29 18:38:18 [auto1.de] INFO: Scrape type for MN24694: 0
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72462%27 HTTP/1.1" 200 None
2026-03-29 18:38:18 [auto1.de] INFO: Scrape type for RW72462: 0
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC04391%27 HTTP/1.1" 200 None
2026-03-29 18:38:18 [auto1.de] INFO: Scrape type for MC04391: 2
2026-03-29 18:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 383362d7-1699-534d-b2b6-f957b986223d with identifier: MC04391
2026-03-29 18:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 383362d7-1699-534d-b2b6-f957b986223d with scrape type 2
2026-03-29 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 383362d7-1699-534d-b2b6-f957b986223d with scrape type 2
2026-03-29 18:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 383362d7-1699-534d-b2b6-f957b986223d, identifier: MC04391
2026-03-29 18:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 383362d7-1699-534d-b2b6-f957b986223d with identifier: MC04391
2026-03-29 18:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 383362d7-1699-534d-b2b6-f957b986223d with identifier: MC04391
2026-03-29 18:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 383362d7-1699-534d-b2b6-f957b986223d with identifier: MC04391 to the API
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:37:34Z',
'fuel_type': 'diesel',
'id': '383362d7-1699-534d-b2b6-f957b986223d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC04391',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 148983,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-02',
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC04391%27 HTTP/1.1" 200 None
2026-03-29 18:38:19 [auto1.de] INFO: Saving data for MC04391: {'auction_closing_time': 1774885054.0, 'created_time': 1774522476.138866, 'last_price_update_time': 1774809499.155375}
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC04391') HTTP/1.1" 204 0
2026-03-29 18:38:19 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-29 18:38:19 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-29 18:38:19 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-29 18:38:19 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01468%27 HTTP/1.1" 200 None
2026-03-29 18:38:19 [auto1.de] INFO: Scrape type for KE01468: 2
2026-03-29 18:38:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7b80dba-e9a1-5418-bb7c-d9e2e14819de with identifier: KE01468
2026-03-29 18:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7b80dba-e9a1-5418-bb7c-d9e2e14819de with scrape type 2
2026-03-29 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7b80dba-e9a1-5418-bb7c-d9e2e14819de with scrape type 2
2026-03-29 18:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7b80dba-e9a1-5418-bb7c-d9e2e14819de, identifier: KE01468
2026-03-29 18:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7b80dba-e9a1-5418-bb7c-d9e2e14819de with identifier: KE01468
2026-03-29 18:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7b80dba-e9a1-5418-bb7c-d9e2e14819de with identifier: KE01468
2026-03-29 18:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7b80dba-e9a1-5418-bb7c-d9e2e14819de with identifier: KE01468 to the API
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:29:08Z',
'fuel_type': 'petrol',
'id': 'd7b80dba-e9a1-5418-bb7c-d9e2e14819de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE01468',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 155750,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-26',
'seller_name': None,
'title': 'Opel Astra 1.4 Turbo Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2015}
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01468%27 HTTP/1.1" 200 None
2026-03-29 18:38:19 [auto1.de] INFO: Saving data for KE01468: {'auction_closing_time': 1774884548.0, 'created_time': 1774522466.631769, 'last_price_update_time': 1774809499.694109}
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE01468') HTTP/1.1" 204 0
2026-03-29 18:38:20 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-29 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82171%27 HTTP/1.1" 200 None
2026-03-29 18:38:20 [auto1.de] INFO: Scrape type for PS82171: 0
2026-03-29 18:38:20 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-29 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW33862%27 HTTP/1.1" 200 None
2026-03-29 18:38:20 [auto1.de] INFO: Scrape type for AW33862: 0
2026-03-29 18:38:20 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-29 18:38:20 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-29 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS99143%27 HTTP/1.1" 200 None
2026-03-29 18:38:20 [auto1.de] INFO: Scrape type for YS99143: 0
2026-03-29 18:38:20 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-29 18:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:22 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB36208%27 HTTP/1.1" 200 None
2026-03-29 18:38:22 [auto1.de] INFO: Scrape type for WB36208: 2
2026-03-29 18:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e979c6-c893-5656-b2a7-395ff5039fa5 with identifier: WB36208
2026-03-29 18:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e979c6-c893-5656-b2a7-395ff5039fa5 with scrape type 2
2026-03-29 18:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e979c6-c893-5656-b2a7-395ff5039fa5 with scrape type 2
2026-03-29 18:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61e979c6-c893-5656-b2a7-395ff5039fa5, identifier: WB36208
2026-03-29 18:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61e979c6-c893-5656-b2a7-395ff5039fa5 with identifier: WB36208
2026-03-29 18:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61e979c6-c893-5656-b2a7-395ff5039fa5 with identifier: WB36208
2026-03-29 18:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61e979c6-c893-5656-b2a7-395ff5039fa5 with identifier: WB36208 to the API
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:22:56Z',
'fuel_type': 'petrol',
'id': '61e979c6-c893-5656-b2a7-395ff5039fa5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB36208',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 439233,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-04-19',
'seller_name': None,
'title': 'BMW 5er 530i',
'transmission': 'automatic',
'trim': '',
'year': 2005}
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB36208%27 HTTP/1.1" 200 None
2026-03-29 18:38:22 [auto1.de] INFO: Saving data for WB36208: {'auction_closing_time': 1774884176.0, 'created_time': 1774636277.738753, 'last_price_update_time': 1774809502.473508}
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB36208') HTTP/1.1" 204 0
2026-03-29 18:38:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS03851%27 HTTP/1.1" 200 None
2026-03-29 18:38:22 [auto1.de] INFO: Scrape type for WS03851: 0
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA01467%27 HTTP/1.1" 200 None
2026-03-29 18:38:22 [auto1.de] INFO: Scrape type for AA01467: 0
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD03873%27 HTTP/1.1" 200 None
2026-03-29 18:38:22 [auto1.de] INFO: Scrape type for LD03873: 0
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20233%27 HTTP/1.1" 200 None
2026-03-29 18:38:22 [auto1.de] INFO: Scrape type for XT20233: 0
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK34912%27 HTTP/1.1" 200 None
2026-03-29 18:38:22 [auto1.de] INFO: Scrape type for TK34912: 0
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71547%27 HTTP/1.1" 200 None
2026-03-29 18:38:22 [auto1.de] INFO: Scrape type for FJ71547: 0
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF63031%27 HTTP/1.1" 200 None
2026-03-29 18:38:22 [auto1.de] INFO: Scrape type for KF63031: 0
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU22008%27 HTTP/1.1" 200 None
2026-03-29 18:38:22 [auto1.de] INFO: Scrape type for EU22008: 2
2026-03-29 18:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08d665d8-c9d1-5eb4-89b1-7a0f16a630c9 with identifier: EU22008
2026-03-29 18:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08d665d8-c9d1-5eb4-89b1-7a0f16a630c9 with scrape type 2
2026-03-29 18:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08d665d8-c9d1-5eb4-89b1-7a0f16a630c9 with scrape type 2
2026-03-29 18:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08d665d8-c9d1-5eb4-89b1-7a0f16a630c9, identifier: EU22008
2026-03-29 18:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08d665d8-c9d1-5eb4-89b1-7a0f16a630c9 with identifier: EU22008
2026-03-29 18:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08d665d8-c9d1-5eb4-89b1-7a0f16a630c9 with identifier: EU22008
2026-03-29 18:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08d665d8-c9d1-5eb4-89b1-7a0f16a630c9 with identifier: EU22008 to the API
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:17:37Z',
'fuel_type': 'diesel',
'id': '08d665d8-c9d1-5eb4-89b1-7a0f16a630c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU22008',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 363129,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-27',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Drive',
'transmission': 'manual',
'trim': 'Drive',
'year': 2017}
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU22008%27 HTTP/1.1" 200 None
2026-03-29 18:38:23 [auto1.de] INFO: Saving data for EU22008: {'auction_closing_time': 1774883857.0, 'created_time': 1774522403.096396, 'last_price_update_time': 1774809503.109015}
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU22008') HTTP/1.1" 204 0
2026-03-29 18:38:23 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-29 18:38:23 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-29 18:38:23 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF55313%27 HTTP/1.1" 200 None
2026-03-29 18:38:23 [auto1.de] INFO: Scrape type for KF55313: 2
2026-03-29 18:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with identifier: KF55313
2026-03-29 18:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with scrape type 2
2026-03-29 18:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with scrape type 2
2026-03-29 18:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3, identifier: KF55313
2026-03-29 18:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with identifier: KF55313
2026-03-29 18:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with identifier: KF55313
2026-03-29 18:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with identifier: KF55313 to the API
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:16:33Z',
'fuel_type': 'petrol',
'id': '5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF55313',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 333094,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-03',
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 Life Gewinner Caddy',
'transmission': 'manual',
'trim': 'Life Gewinner',
'year': 2009}
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF55313%27 HTTP/1.1" 200 None
2026-03-29 18:38:23 [auto1.de] INFO: Saving data for KF55313: {'auction_closing_time': 1774883793.0, 'created_time': 1773732645.104751, 'last_price_update_time': 1774809503.683754}
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF55313') HTTP/1.1" 204 0
2026-03-29 18:38:23 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-29 18:38:23 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW00779%27 HTTP/1.1" 200 None
2026-03-29 18:38:23 [auto1.de] INFO: Scrape type for UW00779: 2
2026-03-29 18:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e42132ff-3dcd-50f7-9cf1-df0a057dde8c with identifier: UW00779
2026-03-29 18:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e42132ff-3dcd-50f7-9cf1-df0a057dde8c with scrape type 2
2026-03-29 18:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e42132ff-3dcd-50f7-9cf1-df0a057dde8c with scrape type 2
2026-03-29 18:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e42132ff-3dcd-50f7-9cf1-df0a057dde8c, identifier: UW00779
2026-03-29 18:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e42132ff-3dcd-50f7-9cf1-df0a057dde8c with identifier: UW00779
2026-03-29 18:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e42132ff-3dcd-50f7-9cf1-df0a057dde8c with identifier: UW00779
2026-03-29 18:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e42132ff-3dcd-50f7-9cf1-df0a057dde8c with identifier: UW00779 to the API
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:09:21Z',
'fuel_type': 'diesel',
'id': 'e42132ff-3dcd-50f7-9cf1-df0a057dde8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW00779',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 391015,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-24',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW00779%27 HTTP/1.1" 200 None
2026-03-29 18:38:24 [auto1.de] INFO: Saving data for UW00779: {'auction_closing_time': 1774883361.0, 'created_time': 1773811841.372994, 'last_price_update_time': 1774809504.169894}
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW00779') HTTP/1.1" 204 0
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41516%27 HTTP/1.1" 200 None
2026-03-29 18:38:24 [auto1.de] INFO: Scrape type for CE41516: 2
2026-03-29 18:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8368a6a4-80d7-56a6-8792-967a3273d302 with identifier: CE41516
2026-03-29 18:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8368a6a4-80d7-56a6-8792-967a3273d302 with scrape type 2
2026-03-29 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8368a6a4-80d7-56a6-8792-967a3273d302 with scrape type 2
2026-03-29 18:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8368a6a4-80d7-56a6-8792-967a3273d302, identifier: CE41516
2026-03-29 18:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8368a6a4-80d7-56a6-8792-967a3273d302 with identifier: CE41516
2026-03-29 18:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8368a6a4-80d7-56a6-8792-967a3273d302 with identifier: CE41516
2026-03-29 18:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8368a6a4-80d7-56a6-8792-967a3273d302 with identifier: CE41516 to the API
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:53:26Z',
'fuel_type': 'diesel',
'id': '8368a6a4-80d7-56a6-8792-967a3273d302',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE41516',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 200728,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-02',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Cup BlueMotion Tech',
'transmission': 'manual',
'trim': 'Cup BlueMotion Tech',
'year': 2014}
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41516%27 HTTP/1.1" 200 None
2026-03-29 18:38:24 [auto1.de] INFO: Saving data for CE41516: {'auction_closing_time': 1774886006.0, 'created_time': 1773305258.71597, 'last_price_update_time': 1774809504.690544}
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE41516') HTTP/1.1" 204 0
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82194%27 HTTP/1.1" 200 None
2026-03-29 18:38:24 [auto1.de] INFO: Scrape type for PW82194: 0
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT47484%27 HTTP/1.1" 200 None
2026-03-29 18:38:24 [auto1.de] INFO: Scrape type for JT47484: 0
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT39177%27 HTTP/1.1" 200 None
2026-03-29 18:38:24 [auto1.de] INFO: Scrape type for HT39177: 2
2026-03-29 18:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89f24e68-8bfa-54b5-ba08-7183d096ae6c with identifier: HT39177
2026-03-29 18:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f24e68-8bfa-54b5-ba08-7183d096ae6c with scrape type 2
2026-03-29 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89f24e68-8bfa-54b5-ba08-7183d096ae6c with scrape type 2
2026-03-29 18:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89f24e68-8bfa-54b5-ba08-7183d096ae6c, identifier: HT39177
2026-03-29 18:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89f24e68-8bfa-54b5-ba08-7183d096ae6c with identifier: HT39177
2026-03-29 18:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89f24e68-8bfa-54b5-ba08-7183d096ae6c with identifier: HT39177
2026-03-29 18:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89f24e68-8bfa-54b5-ba08-7183d096ae6c with identifier: HT39177 to the API
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:39:26Z',
'fuel_type': 'petrol',
'id': '89f24e68-8bfa-54b5-ba08-7183d096ae6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT39177',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 89412,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-20',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
'transmission': 'automatic',
'trim': 'Sport 4Motion',
'year': 2017}
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT39177%27 HTTP/1.1" 200 None
2026-03-29 18:38:25 [auto1.de] INFO: Saving data for HT39177: {'auction_closing_time': 1774885166.0, 'created_time': 1773775723.47669, 'last_price_update_time': 1774809505.205743}
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT39177') HTTP/1.1" 204 0
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA88514%27 HTTP/1.1" 200 None
2026-03-29 18:38:25 [auto1.de] INFO: Scrape type for XA88514: 0
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19206%27 HTTP/1.1" 200 None
2026-03-29 18:38:25 [auto1.de] INFO: Scrape type for UB19206: 2
2026-03-29 18:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24caabff-1c53-586c-9263-9d545a848c8a with identifier: UB19206
2026-03-29 18:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24caabff-1c53-586c-9263-9d545a848c8a with scrape type 2
2026-03-29 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24caabff-1c53-586c-9263-9d545a848c8a with scrape type 2
2026-03-29 18:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24caabff-1c53-586c-9263-9d545a848c8a, identifier: UB19206
2026-03-29 18:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24caabff-1c53-586c-9263-9d545a848c8a with identifier: UB19206
2026-03-29 18:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24caabff-1c53-586c-9263-9d545a848c8a with identifier: UB19206
2026-03-29 18:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24caabff-1c53-586c-9263-9d545a848c8a with identifier: UB19206 to the API
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:58:13Z',
'fuel_type': 'petrol',
'id': '24caabff-1c53-586c-9263-9d545a848c8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB19206',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 282206,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-08-13',
'seller_name': None,
'title': 'Audi A4 2.0 TFSI S line Sportpaket plus',
'transmission': 'manual',
'trim': 'S line Sportpaket plus',
'year': 2008}
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19206%27 HTTP/1.1" 200 None
2026-03-29 18:38:25 [auto1.de] INFO: Saving data for UB19206: {'auction_closing_time': 1774886293.0, 'created_time': 1774510234.520522, 'last_price_update_time': 1774809505.769777}
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB19206') HTTP/1.1" 204 0
2026-03-29 18:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:25 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA52648%27 HTTP/1.1" 200 None
2026-03-29 18:38:25 [auto1.de] INFO: Scrape type for YA52648: 0
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK41748%27 HTTP/1.1" 200 None
2026-03-29 18:38:25 [auto1.de] INFO: Scrape type for GK41748: 2
2026-03-29 18:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d14ed150-6733-590a-9ba9-8133d7a03997 with identifier: GK41748
2026-03-29 18:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d14ed150-6733-590a-9ba9-8133d7a03997 with scrape type 2
2026-03-29 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d14ed150-6733-590a-9ba9-8133d7a03997 with scrape type 2
2026-03-29 18:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d14ed150-6733-590a-9ba9-8133d7a03997, identifier: GK41748
2026-03-29 18:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d14ed150-6733-590a-9ba9-8133d7a03997 with identifier: GK41748
2026-03-29 18:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d14ed150-6733-590a-9ba9-8133d7a03997 with identifier: GK41748
2026-03-29 18:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d14ed150-6733-590a-9ba9-8133d7a03997 with identifier: GK41748 to the API
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:09:46Z',
'fuel_type': 'petrol',
'id': 'd14ed150-6733-590a-9ba9-8133d7a03997',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK41748',
'listing': 'auction',
'make': 'Toyota',
'model': 'Corolla',
'odometer': 217622,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-09-09',
'seller_name': None,
'title': 'Toyota Corolla 1.8 Compact TS',
'transmission': 'manual',
'trim': 'Compact TS',
'year': 2002}
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK41748%27 HTTP/1.1" 200 None
2026-03-29 18:38:26 [auto1.de] INFO: Saving data for GK41748: {'auction_closing_time': 1774883386.0, 'created_time': 1773302964.758846, 'last_price_update_time': 1774809506.359565}
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK41748') HTTP/1.1" 204 0
2026-03-29 18:38:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE54720%27 HTTP/1.1" 200 None
2026-03-29 18:38:26 [auto1.de] INFO: Scrape type for VE54720: 0
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP35448%27 HTTP/1.1" 200 None
2026-03-29 18:38:26 [auto1.de] INFO: Scrape type for FP35448: 0
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU23189%27 HTTP/1.1" 200 None
2026-03-29 18:38:26 [auto1.de] INFO: Scrape type for JU23189: 2
2026-03-29 18:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with identifier: JU23189
2026-03-29 18:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with scrape type 2
2026-03-29 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with scrape type 2
2026-03-29 18:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3097a46a-39d6-5ef1-a1ae-9239be909dd1, identifier: JU23189
2026-03-29 18:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with identifier: JU23189
2026-03-29 18:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with identifier: JU23189
2026-03-29 18:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with identifier: JU23189 to the API
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:57:48Z',
'fuel_type': 'petrol',
'id': '3097a46a-39d6-5ef1-a1ae-9239be909dd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU23189',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 168144,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-09-04',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
'transmission': 'manual',
'trim': '',
'year': 2002}
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU23189%27 HTTP/1.1" 200 None
2026-03-29 18:38:26 [auto1.de] INFO: Saving data for JU23189: {'auction_closing_time': 1774886268.0, 'created_time': 1774607546.12803, 'last_price_update_time': 1774809506.837543}
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU23189') HTTP/1.1" 204 0
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: NK87306
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC18756%27 HTTP/1.1" 200 None
2026-03-29 18:38:26 [auto1.de] INFO: Scrape type for PC18756: 2
2026-03-29 18:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80df274c-a93f-54c8-adef-645a79f63b7f with identifier: PC18756
2026-03-29 18:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80df274c-a93f-54c8-adef-645a79f63b7f with scrape type 2
2026-03-29 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80df274c-a93f-54c8-adef-645a79f63b7f with scrape type 2
2026-03-29 18:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80df274c-a93f-54c8-adef-645a79f63b7f, identifier: PC18756
2026-03-29 18:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80df274c-a93f-54c8-adef-645a79f63b7f with identifier: PC18756
2026-03-29 18:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80df274c-a93f-54c8-adef-645a79f63b7f with identifier: PC18756
2026-03-29 18:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80df274c-a93f-54c8-adef-645a79f63b7f with identifier: PC18756 to the API
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 159,
'expiration_date': '2026-03-30T15:57:50Z',
'fuel_type': 'petrol',
'id': '80df274c-a93f-54c8-adef-645a79f63b7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC18756',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 172830,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-22',
'seller_name': None,
'title': 'Nissan Qashqai 1.3 DIG-T N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2019}
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC18756%27 HTTP/1.1" 200 None
2026-03-29 18:38:27 [auto1.de] INFO: Saving data for PC18756: {'auction_closing_time': 1774886270.0, 'created_time': 1774349703.429225, 'last_price_update_time': 1774809507.39874}
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC18756') HTTP/1.1" 204 0
2026-03-29 18:38:27 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-29 18:38:27 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48598%27 HTTP/1.1" 200 None
2026-03-29 18:38:27 [auto1.de] INFO: Scrape type for YT48598: 2
2026-03-29 18:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc852cd7-f6d5-5406-addd-ead2b27c816b with identifier: YT48598
2026-03-29 18:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc852cd7-f6d5-5406-addd-ead2b27c816b with scrape type 2
2026-03-29 18:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc852cd7-f6d5-5406-addd-ead2b27c816b with scrape type 2
2026-03-29 18:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc852cd7-f6d5-5406-addd-ead2b27c816b, identifier: YT48598
2026-03-29 18:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc852cd7-f6d5-5406-addd-ead2b27c816b with identifier: YT48598
2026-03-29 18:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc852cd7-f6d5-5406-addd-ead2b27c816b with identifier: YT48598
2026-03-29 18:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc852cd7-f6d5-5406-addd-ead2b27c816b with identifier: YT48598 to the API
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 455,
'expiration_date': '2026-03-30T15:07:23Z',
'fuel_type': 'petrol',
'id': 'cc852cd7-f6d5-5406-addd-ead2b27c816b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT48598',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 228128,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-11',
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 500 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2013}
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48598%27 HTTP/1.1" 200 None
2026-03-29 18:38:27 [auto1.de] INFO: Saving data for YT48598: {'auction_closing_time': 1774883243.0, 'created_time': 1773688627.535516, 'last_price_update_time': 1774809507.877062}
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT48598') HTTP/1.1" 204 0
2026-03-29 18:38:27 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-29 18:38:27 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-29 18:38:27 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC76019%27 HTTP/1.1" 200 None
2026-03-29 18:38:27 [auto1.de] INFO: Scrape type for FC76019: 2
2026-03-29 18:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5b138fc-5bd4-5ea9-a304-6254cfb0812c with identifier: FC76019
2026-03-29 18:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5b138fc-5bd4-5ea9-a304-6254cfb0812c with scrape type 2
2026-03-29 18:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5b138fc-5bd4-5ea9-a304-6254cfb0812c with scrape type 2
2026-03-29 18:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5b138fc-5bd4-5ea9-a304-6254cfb0812c, identifier: FC76019
2026-03-29 18:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5b138fc-5bd4-5ea9-a304-6254cfb0812c with identifier: FC76019
2026-03-29 18:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5b138fc-5bd4-5ea9-a304-6254cfb0812c with identifier: FC76019
2026-03-29 18:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5b138fc-5bd4-5ea9-a304-6254cfb0812c with identifier: FC76019 to the API
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:23:12Z',
'fuel_type': 'diesel',
'id': 'b5b138fc-5bd4-5ea9-a304-6254cfb0812c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC76019',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 243152,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-22',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Joy',
'transmission': 'automatic',
'trim': 'Joy',
'year': 2017}
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC76019%27 HTTP/1.1" 200 None
2026-03-29 18:38:28 [auto1.de] INFO: Saving data for FC76019: {'auction_closing_time': 1774884192.0, 'created_time': 1772541082.608511, 'last_price_update_time': 1774809508.367072}
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC76019') HTTP/1.1" 204 0
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK93777%27 HTTP/1.1" 200 None
2026-03-29 18:38:28 [auto1.de] INFO: Scrape type for CK93777: 0
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX61544%27 HTTP/1.1" 200 None
2026-03-29 18:38:28 [auto1.de] INFO: Scrape type for TX61544: 0
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET07412%27 HTTP/1.1" 200 None
2026-03-29 18:38:28 [auto1.de] INFO: Scrape type for ET07412: 0
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC17243%27 HTTP/1.1" 200 None
2026-03-29 18:38:28 [auto1.de] INFO: Scrape type for XC17243: 2
2026-03-29 18:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea6f3cf5-df17-5907-9c4d-a6074d92f54e with identifier: XC17243
2026-03-29 18:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea6f3cf5-df17-5907-9c4d-a6074d92f54e with scrape type 2
2026-03-29 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea6f3cf5-df17-5907-9c4d-a6074d92f54e with scrape type 2
2026-03-29 18:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea6f3cf5-df17-5907-9c4d-a6074d92f54e, identifier: XC17243
2026-03-29 18:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea6f3cf5-df17-5907-9c4d-a6074d92f54e with identifier: XC17243
2026-03-29 18:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea6f3cf5-df17-5907-9c4d-a6074d92f54e with identifier: XC17243
2026-03-29 18:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea6f3cf5-df17-5907-9c4d-a6074d92f54e with identifier: XC17243 to the API
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:22:17Z',
'fuel_type': 'petrol',
'id': 'ea6f3cf5-df17-5907-9c4d-a6074d92f54e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC17243',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 112748,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-03',
'seller_name': None,
'title': 'Seat Ibiza 1.2 TSI Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2011}
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC17243%27 HTTP/1.1" 200 None
2026-03-29 18:38:28 [auto1.de] INFO: Saving data for XC17243: {'auction_closing_time': 1774884137.0, 'created_time': 1774032301.563577, 'last_price_update_time': 1774809508.946156}
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC17243') HTTP/1.1" 204 0
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL84965%27 HTTP/1.1" 200 None
2026-03-29 18:38:28 [auto1.de] INFO: Scrape type for BL84965: 2
2026-03-29 18:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with identifier: BL84965
2026-03-29 18:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with scrape type 2
2026-03-29 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with scrape type 2
2026-03-29 18:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4841b8a7-b30d-5dcf-bb3d-7925f921ee97, identifier: BL84965
2026-03-29 18:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with identifier: BL84965
2026-03-29 18:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with identifier: BL84965
2026-03-29 18:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with identifier: BL84965 to the API
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:05:11Z',
'fuel_type': 'petrol',
'id': '4841b8a7-b30d-5dcf-bb3d-7925f921ee97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL84965',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 90495,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-20',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2019}
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL84965%27 HTTP/1.1" 200 None
2026-03-29 18:38:29 [auto1.de] INFO: Saving data for BL84965: {'auction_closing_time': 1774883111.0, 'created_time': 1774291200.135366, 'last_price_update_time': 1774809509.389156}
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL84965') HTTP/1.1" 204 0
2026-03-29 18:38:29 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-29 18:38:29 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89022%27 HTTP/1.1" 200 None
2026-03-29 18:38:29 [auto1.de] INFO: Scrape type for ZT89022: 0
2026-03-29 18:38:29 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA73958%27 HTTP/1.1" 200 None
2026-03-29 18:38:29 [auto1.de] INFO: Scrape type for MA73958: 0
2026-03-29 18:38:29 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-29 18:38:29 [auto1.de] INFO: Found listing with ID: JC65588
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC65588%27 HTTP/1.1" 200 None
2026-03-29 18:38:29 [auto1.de] INFO: Scrape type for JC65588: 2
2026-03-29 18:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77147a72-9fc5-5286-8c53-b8c61fb023cb with identifier: JC65588
2026-03-29 18:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77147a72-9fc5-5286-8c53-b8c61fb023cb with scrape type 2
2026-03-29 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77147a72-9fc5-5286-8c53-b8c61fb023cb with scrape type 2
2026-03-29 18:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77147a72-9fc5-5286-8c53-b8c61fb023cb, identifier: JC65588
2026-03-29 18:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77147a72-9fc5-5286-8c53-b8c61fb023cb with identifier: JC65588
2026-03-29 18:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77147a72-9fc5-5286-8c53-b8c61fb023cb with identifier: JC65588
2026-03-29 18:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77147a72-9fc5-5286-8c53-b8c61fb023cb with identifier: JC65588 to the API
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:10:40Z',
'fuel_type': 'petrol',
'id': '77147a72-9fc5-5286-8c53-b8c61fb023cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC65588',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'New Beetle',
'odometer': 200791,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-08-02',
'seller_name': None,
'title': 'Volkswagen New Beetle 1.6',
'transmission': 'manual',
'trim': '',
'year': 2006}
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC65588%27 HTTP/1.1" 200 None
2026-03-29 18:38:29 [auto1.de] INFO: Saving data for JC65588: {'auction_closing_time': 1774883440.0, 'created_time': 1774722823.141087, 'last_price_update_time': 1774809509.868936}
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC65588') HTTP/1.1" 204 0
2026-03-29 18:38:29 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-29 18:38:29 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH21180%27 HTTP/1.1" 200 None
2026-03-29 18:38:29 [auto1.de] INFO: Scrape type for ZH21180: 2
2026-03-29 18:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02d00dec-8d76-52fe-aada-729dd9d39940 with identifier: ZH21180
2026-03-29 18:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02d00dec-8d76-52fe-aada-729dd9d39940 with scrape type 2
2026-03-29 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02d00dec-8d76-52fe-aada-729dd9d39940 with scrape type 2
2026-03-29 18:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02d00dec-8d76-52fe-aada-729dd9d39940, identifier: ZH21180
2026-03-29 18:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02d00dec-8d76-52fe-aada-729dd9d39940 with identifier: ZH21180
2026-03-29 18:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02d00dec-8d76-52fe-aada-729dd9d39940 with identifier: ZH21180
2026-03-29 18:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02d00dec-8d76-52fe-aada-729dd9d39940 with identifier: ZH21180 to the API
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:10:14Z',
'fuel_type': 'diesel',
'id': '02d00dec-8d76-52fe-aada-729dd9d39940',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH21180',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 110498,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-11',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Laurin & Klement',
'transmission': 'automatic',
'trim': 'Laurin & Klement',
'year': 2019}
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH21180%27 HTTP/1.1" 200 None
2026-03-29 18:38:30 [auto1.de] INFO: Saving data for ZH21180: {'auction_closing_time': 1774883414.0, 'created_time': 1774636349.307379, 'last_price_update_time': 1774809510.379311}
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH21180') HTTP/1.1" 204 0
2026-03-29 18:38:30 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39505%27 HTTP/1.1" 200 None
2026-03-29 18:38:30 [auto1.de] INFO: Scrape type for UW39505: 0
2026-03-29 18:38:30 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-29 18:38:30 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT21646%27 HTTP/1.1" 200 None
2026-03-29 18:38:30 [auto1.de] INFO: Scrape type for LT21646: 2
2026-03-29 18:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3007820d-77db-5437-8080-c9a57e30c5f5 with identifier: LT21646
2026-03-29 18:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3007820d-77db-5437-8080-c9a57e30c5f5 with scrape type 2
2026-03-29 18:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3007820d-77db-5437-8080-c9a57e30c5f5 with scrape type 2
2026-03-29 18:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3007820d-77db-5437-8080-c9a57e30c5f5, identifier: LT21646
2026-03-29 18:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3007820d-77db-5437-8080-c9a57e30c5f5 with identifier: LT21646
2026-03-29 18:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3007820d-77db-5437-8080-c9a57e30c5f5 with identifier: LT21646
2026-03-29 18:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3007820d-77db-5437-8080-c9a57e30c5f5 with identifier: LT21646 to the API
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:37:45Z',
'fuel_type': 'petrol',
'id': '3007820d-77db-5437-8080-c9a57e30c5f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT21646',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 87721,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-01',
'seller_name': None,
'title': 'BMW 1er 118i Edition M Sport Shadow',
'transmission': 'manual',
'trim': 'Edition M Sport Shadow',
'year': 2019}
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT21646%27 HTTP/1.1" 200 None
2026-03-29 18:38:30 [auto1.de] INFO: Saving data for LT21646: {'auction_closing_time': 1774885065.0, 'created_time': 1773427246.178547, 'last_price_update_time': 1774809510.898003}
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT21646') HTTP/1.1" 204 0
2026-03-29 18:38:30 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD20057%27 HTTP/1.1" 200 None
2026-03-29 18:38:30 [auto1.de] INFO: Scrape type for MD20057: 0
2026-03-29 18:38:30 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC25925%27 HTTP/1.1" 200 None
2026-03-29 18:38:30 [auto1.de] INFO: Scrape type for EC25925: 2
2026-03-29 18:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc08f6bf-99be-56e5-8859-cccfd5d12af2 with identifier: EC25925
2026-03-29 18:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc08f6bf-99be-56e5-8859-cccfd5d12af2 with scrape type 2
2026-03-29 18:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc08f6bf-99be-56e5-8859-cccfd5d12af2 with scrape type 2
2026-03-29 18:38:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc08f6bf-99be-56e5-8859-cccfd5d12af2, identifier: EC25925
2026-03-29 18:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc08f6bf-99be-56e5-8859-cccfd5d12af2 with identifier: EC25925
2026-03-29 18:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc08f6bf-99be-56e5-8859-cccfd5d12af2 with identifier: EC25925
2026-03-29 18:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc08f6bf-99be-56e5-8859-cccfd5d12af2 with identifier: EC25925 to the API
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:56:13Z',
'fuel_type': 'petrol',
'id': 'bc08f6bf-99be-56e5-8859-cccfd5d12af2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC25925',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 199499,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-29',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC25925%27 HTTP/1.1" 200 None
2026-03-29 18:38:31 [auto1.de] INFO: Saving data for EC25925: {'auction_closing_time': 1774886173.0, 'created_time': 1773466619.58683, 'last_price_update_time': 1774809511.73033}
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC25925') HTTP/1.1" 204 0
2026-03-29 18:38:31 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:31 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL94183%27 HTTP/1.1" 200 None
2026-03-29 18:38:31 [auto1.de] INFO: Scrape type for FL94183: 2
2026-03-29 18:38:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a2935a5-8727-5a4e-a5bb-50ad22c79ceb with identifier: FL94183
2026-03-29 18:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a2935a5-8727-5a4e-a5bb-50ad22c79ceb with scrape type 2
2026-03-29 18:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a2935a5-8727-5a4e-a5bb-50ad22c79ceb with scrape type 2
2026-03-29 18:38:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a2935a5-8727-5a4e-a5bb-50ad22c79ceb, identifier: FL94183
2026-03-29 18:38:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a2935a5-8727-5a4e-a5bb-50ad22c79ceb with identifier: FL94183
2026-03-29 18:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a2935a5-8727-5a4e-a5bb-50ad22c79ceb with identifier: FL94183
2026-03-29 18:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a2935a5-8727-5a4e-a5bb-50ad22c79ceb with identifier: FL94183 to the API
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 132,
'expiration_date': '2026-03-30T15:49:32Z',
'fuel_type': 'petrol',
'id': '7a2935a5-8727-5a4e-a5bb-50ad22c79ceb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL94183',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 123205,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-25',
'seller_name': None,
'title': 'Renault Megane 1.2 TCe Energy GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2015}
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL94183%27 HTTP/1.1" 200 None
2026-03-29 18:38:32 [auto1.de] INFO: Saving data for FL94183: {'auction_closing_time': 1774885772.0, 'created_time': 1774522059.543818, 'last_price_update_time': 1774809512.160044}
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL94183') HTTP/1.1" 204 0
2026-03-29 18:38:32 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69910%27 HTTP/1.1" 200 None
2026-03-29 18:38:32 [auto1.de] INFO: Scrape type for DE69910: 2
2026-03-29 18:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with identifier: DE69910
2026-03-29 18:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with scrape type 2
2026-03-29 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with scrape type 2
2026-03-29 18:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1ee61fe-a6d5-513c-bf2d-0e876c11d443, identifier: DE69910
2026-03-29 18:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with identifier: DE69910
2026-03-29 18:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with identifier: DE69910
2026-03-29 18:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with identifier: DE69910 to the API
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:22:15Z',
'fuel_type': 'diesel',
'id': 'a1ee61fe-a6d5-513c-bf2d-0e876c11d443',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE69910',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 145573,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-10',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2016}
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69910%27 HTTP/1.1" 200 None
2026-03-29 18:38:32 [auto1.de] INFO: Saving data for DE69910: {'auction_closing_time': 1774884135.0, 'created_time': 1773859723.229698, 'last_price_update_time': 1774809512.634406}
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE69910') HTTP/1.1" 204 0
2026-03-29 18:38:32 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-29 18:38:32 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU24195%27 HTTP/1.1" 200 None
2026-03-29 18:38:32 [auto1.de] INFO: Scrape type for EU24195: 0
2026-03-29 18:38:32 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT60185%27 HTTP/1.1" 200 None
2026-03-29 18:38:32 [auto1.de] INFO: Scrape type for NT60185: 2
2026-03-29 18:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abe15317-01ff-5dd8-a58a-abeea1216824 with identifier: NT60185
2026-03-29 18:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abe15317-01ff-5dd8-a58a-abeea1216824 with scrape type 2
2026-03-29 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abe15317-01ff-5dd8-a58a-abeea1216824 with scrape type 2
2026-03-29 18:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abe15317-01ff-5dd8-a58a-abeea1216824, identifier: NT60185
2026-03-29 18:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abe15317-01ff-5dd8-a58a-abeea1216824 with identifier: NT60185
2026-03-29 18:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abe15317-01ff-5dd8-a58a-abeea1216824 with identifier: NT60185
2026-03-29 18:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abe15317-01ff-5dd8-a58a-abeea1216824 with identifier: NT60185 to the API
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:50:28Z',
'fuel_type': 'petrol',
'id': 'abe15317-01ff-5dd8-a58a-abeea1216824',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT60185',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 73291,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-25',
'seller_name': None,
'title': 'Hyundai i30 1.4 Trend blue',
'transmission': 'manual',
'trim': 'Trend blue',
'year': 2016}
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT60185%27 HTTP/1.1" 200 None
2026-03-29 18:38:33 [auto1.de] INFO: Saving data for NT60185: {'auction_closing_time': 1774885828.0, 'created_time': 1773466618.589498, 'last_price_update_time': 1774809513.096423}
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT60185') HTTP/1.1" 204 0
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27020%27 HTTP/1.1" 200 None
2026-03-29 18:38:33 [auto1.de] INFO: Scrape type for NT27020: 0
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT01969%27 HTTP/1.1" 200 None
2026-03-29 18:38:33 [auto1.de] INFO: Scrape type for RT01969: 0
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV29308%27 HTTP/1.1" 200 None
2026-03-29 18:38:33 [auto1.de] INFO: Scrape type for ZV29308: 2
2026-03-29 18:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53c69dda-dcac-5e57-8e79-44b586e0ef5c with identifier: ZV29308
2026-03-29 18:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c with scrape type 2
2026-03-29 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c with scrape type 2
2026-03-29 18:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53c69dda-dcac-5e57-8e79-44b586e0ef5c, identifier: ZV29308
2026-03-29 18:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53c69dda-dcac-5e57-8e79-44b586e0ef5c with identifier: ZV29308
2026-03-29 18:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53c69dda-dcac-5e57-8e79-44b586e0ef5c with identifier: ZV29308
2026-03-29 18:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53c69dda-dcac-5e57-8e79-44b586e0ef5c with identifier: ZV29308 to the API
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:03:46Z',
'fuel_type': 'petrol',
'id': '53c69dda-dcac-5e57-8e79-44b586e0ef5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV29308',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 37465,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-14',
'seller_name': None,
'title': 'MINI Cooper Classic Trim',
'transmission': 'automatic',
'trim': 'Classic Trim',
'year': 2021}
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV29308%27 HTTP/1.1" 200 None
2026-03-29 18:38:33 [auto1.de] INFO: Saving data for ZV29308: {'auction_closing_time': 1774883026.0, 'created_time': 1774607719.695803, 'last_price_update_time': 1774809513.676195}
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV29308') HTTP/1.1" 204 0
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS65923%27 HTTP/1.1" 200 None
2026-03-29 18:38:33 [auto1.de] INFO: Scrape type for MS65923: 0
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX60280%27 HTTP/1.1" 200 None
2026-03-29 18:38:33 [auto1.de] INFO: Scrape type for SX60280: 2
2026-03-29 18:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with identifier: SX60280
2026-03-29 18:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with scrape type 2
2026-03-29 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with scrape type 2
2026-03-29 18:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32bf8a2f-1a89-505d-b885-8a4c8cc1b004, identifier: SX60280
2026-03-29 18:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with identifier: SX60280
2026-03-29 18:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with identifier: SX60280
2026-03-29 18:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with identifier: SX60280 to the API
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:29:13Z',
'fuel_type': 'diesel',
'id': '32bf8a2f-1a89-505d-b885-8a4c8cc1b004',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX60280',
'listing': 'auction',
'make': 'Nissan',
'model': 'NV200 Evalia',
'odometer': 161650,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-25',
'seller_name': None,
'title': 'Nissan NV200 Evalia 1.5 dCi Evalia Tekna',
'transmission': 'manual',
'trim': 'Evalia Tekna',
'year': 2013}
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX60280%27 HTTP/1.1" 200 None
2026-03-29 18:38:34 [auto1.de] INFO: Saving data for SX60280: {'auction_closing_time': 1774884553.0, 'created_time': 1773426936.082551, 'last_price_update_time': 1774809514.159481}
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX60280') HTTP/1.1" 204 0
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU96815%27 HTTP/1.1" 200 None
2026-03-29 18:38:34 [auto1.de] INFO: Scrape type for TU96815: 0
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW42175%27 HTTP/1.1" 200 None
2026-03-29 18:38:34 [auto1.de] INFO: Scrape type for LW42175: 0
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE09652%27 HTTP/1.1" 200 None
2026-03-29 18:38:34 [auto1.de] INFO: Scrape type for PE09652: 0
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42625%27 HTTP/1.1" 200 None
2026-03-29 18:38:34 [auto1.de] INFO: Scrape type for DE42625: 2
2026-03-29 18:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5565833-2ca2-5e96-bd88-9461c4c07921 with identifier: DE42625
2026-03-29 18:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5565833-2ca2-5e96-bd88-9461c4c07921 with scrape type 2
2026-03-29 18:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5565833-2ca2-5e96-bd88-9461c4c07921 with scrape type 2
2026-03-29 18:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5565833-2ca2-5e96-bd88-9461c4c07921, identifier: DE42625
2026-03-29 18:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5565833-2ca2-5e96-bd88-9461c4c07921 with identifier: DE42625
2026-03-29 18:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5565833-2ca2-5e96-bd88-9461c4c07921 with identifier: DE42625
2026-03-29 18:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5565833-2ca2-5e96-bd88-9461c4c07921 with identifier: DE42625 to the API
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:32:07Z',
'fuel_type': 'petrol',
'id': 'b5565833-2ca2-5e96-bd88-9461c4c07921',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE42625',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 218247,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-31',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.4 TSI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2010}
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42625%27 HTTP/1.1" 200 None
2026-03-29 18:38:34 [auto1.de] INFO: Saving data for DE42625: {'auction_closing_time': 1774884727.0, 'created_time': 1773686583.058438, 'last_price_update_time': 1774809514.696193}
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE42625') HTTP/1.1" 204 0
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC01446%27 HTTP/1.1" 200 None
2026-03-29 18:38:34 [auto1.de] INFO: Scrape type for RC01446: 0
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF86895%27 HTTP/1.1" 200 None
2026-03-29 18:38:34 [auto1.de] INFO: Scrape type for HF86895: 2
2026-03-29 18:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46f51e7d-2959-5dd9-af67-c724dffabdbd with identifier: HF86895
2026-03-29 18:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46f51e7d-2959-5dd9-af67-c724dffabdbd with scrape type 2
2026-03-29 18:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46f51e7d-2959-5dd9-af67-c724dffabdbd with scrape type 2
2026-03-29 18:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46f51e7d-2959-5dd9-af67-c724dffabdbd, identifier: HF86895
2026-03-29 18:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46f51e7d-2959-5dd9-af67-c724dffabdbd with identifier: HF86895
2026-03-29 18:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46f51e7d-2959-5dd9-af67-c724dffabdbd with identifier: HF86895
2026-03-29 18:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46f51e7d-2959-5dd9-af67-c724dffabdbd with identifier: HF86895 to the API
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:25:59Z',
'fuel_type': 'petrol',
'id': '46f51e7d-2959-5dd9-af67-c724dffabdbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF86895',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 90549,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-02',
'seller_name': None,
'title': 'BMW 1er 118i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF86895%27 HTTP/1.1" 200 None
2026-03-29 18:38:35 [auto1.de] INFO: Saving data for HF86895: {'auction_closing_time': 1774884359.0, 'created_time': 1773946473.476026, 'last_price_update_time': 1774809515.222116}
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF86895') HTTP/1.1" 204 0
2026-03-29 18:38:35 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR57506%27 HTTP/1.1" 200 None
2026-03-29 18:38:35 [auto1.de] INFO: Scrape type for HR57506: 0
2026-03-29 18:38:35 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD67762%27 HTTP/1.1" 200 None
2026-03-29 18:38:35 [auto1.de] INFO: Scrape type for PD67762: 0
2026-03-29 18:38:35 [auto1.de] INFO: Found listing with ID: RM72626
2026-03-29 18:38:35 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA50642%27 HTTP/1.1" 200 None
2026-03-29 18:38:35 [auto1.de] INFO: Scrape type for SA50642: 2
2026-03-29 18:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ca63a10-fe6b-51a4-aa41-d67268b76f9c with identifier: SA50642
2026-03-29 18:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ca63a10-fe6b-51a4-aa41-d67268b76f9c with scrape type 2
2026-03-29 18:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ca63a10-fe6b-51a4-aa41-d67268b76f9c with scrape type 2
2026-03-29 18:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ca63a10-fe6b-51a4-aa41-d67268b76f9c, identifier: SA50642
2026-03-29 18:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ca63a10-fe6b-51a4-aa41-d67268b76f9c with identifier: SA50642
2026-03-29 18:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ca63a10-fe6b-51a4-aa41-d67268b76f9c with identifier: SA50642
2026-03-29 18:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ca63a10-fe6b-51a4-aa41-d67268b76f9c with identifier: SA50642 to the API
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:33:58Z',
'fuel_type': 'diesel',
'id': '2ca63a10-fe6b-51a4-aa41-d67268b76f9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA50642',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 491320,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-10',
'seller_name': None,
'title': 'BMW 5er 530d GT',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA50642%27 HTTP/1.1" 200 None
2026-03-29 18:38:35 [auto1.de] INFO: Saving data for SA50642: {'auction_closing_time': 1774884838.0, 'created_time': 1774521531.024252, 'last_price_update_time': 1774809515.660156}
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA50642') HTTP/1.1" 204 0
2026-03-29 18:38:35 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-29 18:38:35 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-29 18:38:35 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM47642%27 HTTP/1.1" 200 None
2026-03-29 18:38:35 [auto1.de] INFO: Scrape type for GM47642: 2
2026-03-29 18:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with identifier: GM47642
2026-03-29 18:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with scrape type 2
2026-03-29 18:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with scrape type 2
2026-03-29 18:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34a330c4-12b1-520f-b19a-9eb7713f2eb0, identifier: GM47642
2026-03-29 18:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with identifier: GM47642
2026-03-29 18:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with identifier: GM47642
2026-03-29 18:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with identifier: GM47642 to the API
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:05:30Z',
'fuel_type': 'petrol',
'id': '34a330c4-12b1-520f-b19a-9eb7713f2eb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM47642',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 76651,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-07',
'seller_name': None,
'title': 'Renault Twingo 1.0 SCe Chic',
'transmission': 'manual',
'trim': 'Chic',
'year': 2019}
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM47642%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Saving data for GM47642: {'auction_closing_time': 1774883130.0, 'created_time': 1773859992.552013, 'last_price_update_time': 1774809516.121166}
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM47642') HTTP/1.1" 204 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT29598%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for TT29598: 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR47170%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for GR47170: 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM87462%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for XM87462: 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78994%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for XA78994: 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU26768%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for ZU26768: 2
2026-03-29 18:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b40f711-92ae-5045-adcb-71839f045d3d with identifier: ZU26768
2026-03-29 18:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b40f711-92ae-5045-adcb-71839f045d3d with scrape type 2
2026-03-29 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b40f711-92ae-5045-adcb-71839f045d3d with scrape type 2
2026-03-29 18:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b40f711-92ae-5045-adcb-71839f045d3d, identifier: ZU26768
2026-03-29 18:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b40f711-92ae-5045-adcb-71839f045d3d with identifier: ZU26768
2026-03-29 18:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b40f711-92ae-5045-adcb-71839f045d3d with identifier: ZU26768
2026-03-29 18:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b40f711-92ae-5045-adcb-71839f045d3d with identifier: ZU26768 to the API
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:49:26Z',
'fuel_type': 'diesel',
'id': '3b40f711-92ae-5045-adcb-71839f045d3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU26768',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 294305,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-26',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TDI Sportline',
'transmission': 'manual',
'trim': 'Sportline',
'year': 2006}
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU26768%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Saving data for ZU26768: {'auction_closing_time': 1774885766.0, 'created_time': 1774118856.095716, 'last_price_update_time': 1774809516.624986}
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU26768') HTTP/1.1" 204 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV16310%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for EV16310: 0
2026-03-29 18:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:36 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP25717%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for BP25717: 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ41164%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for XJ41164: 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK35752%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for CK35752: 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50378%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for WY50378: 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD29565%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for DD29565: 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE11389%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for WE11389: 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK93112%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for PK93112: 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT53234%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for YT53234: 2
2026-03-29 18:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c30aac1b-c7cb-51bb-b55e-896d77089f47 with identifier: YT53234
2026-03-29 18:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c30aac1b-c7cb-51bb-b55e-896d77089f47 with scrape type 2
2026-03-29 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c30aac1b-c7cb-51bb-b55e-896d77089f47 with scrape type 2
2026-03-29 18:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c30aac1b-c7cb-51bb-b55e-896d77089f47, identifier: YT53234
2026-03-29 18:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c30aac1b-c7cb-51bb-b55e-896d77089f47 with identifier: YT53234
2026-03-29 18:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c30aac1b-c7cb-51bb-b55e-896d77089f47 with identifier: YT53234
2026-03-29 18:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c30aac1b-c7cb-51bb-b55e-896d77089f47 with identifier: YT53234 to the API
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:21Z',
'fuel_type': 'gas',
'id': 'c30aac1b-c7cb-51bb-b55e-896d77089f47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT53234',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 155819,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-15',
'seller_name': None,
'title': 'Volkswagen Passat 1.4 TSI EcoFuel Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT53234%27 HTTP/1.1" 200 None
2026-03-29 18:38:37 [auto1.de] INFO: Saving data for YT53234: {'auction_closing_time': 1774883001.0, 'created_time': 1774522314.005285, 'last_price_update_time': 1774809517.377128}
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT53234') HTTP/1.1" 204 0
2026-03-29 18:38:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:37 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW86631%27 HTTP/1.1" 200 None
2026-03-29 18:38:37 [auto1.de] INFO: Scrape type for MW86631: 0
2026-03-29 18:38:37 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02654%27 HTTP/1.1" 200 None
2026-03-29 18:38:37 [auto1.de] INFO: Scrape type for WS02654: 2
2026-03-29 18:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with identifier: WS02654
2026-03-29 18:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with scrape type 2
2026-03-29 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with scrape type 2
2026-03-29 18:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a282c06c-f36b-50ae-b469-6f7f7bcb88a4, identifier: WS02654
2026-03-29 18:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with identifier: WS02654
2026-03-29 18:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with identifier: WS02654
2026-03-29 18:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with identifier: WS02654 to the API
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 72,
'expiration_date': '2026-03-30T15:30:26Z',
'fuel_type': 'petrol',
'id': 'a282c06c-f36b-50ae-b469-6f7f7bcb88a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS02654',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 162563,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-31',
'seller_name': None,
'title': 'Toyota Aygo 1.0-VVT-i X',
'transmission': 'manual',
'trim': 'X',
'year': 2018}
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02654%27 HTTP/1.1" 200 None
2026-03-29 18:38:37 [auto1.de] INFO: Saving data for WS02654: {'auction_closing_time': 1774884626.0, 'created_time': 1773830386.763692, 'last_price_update_time': 1774809517.957282}
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS02654') HTTP/1.1" 204 0
2026-03-29 18:38:37 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97511%27 HTTP/1.1" 200 None
2026-03-29 18:38:37 [auto1.de] INFO: Scrape type for PF97511: 2
2026-03-29 18:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44034d65-de7f-5afa-806b-4c568deb5a2b with identifier: PF97511
2026-03-29 18:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44034d65-de7f-5afa-806b-4c568deb5a2b with scrape type 2
2026-03-29 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44034d65-de7f-5afa-806b-4c568deb5a2b with scrape type 2
2026-03-29 18:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44034d65-de7f-5afa-806b-4c568deb5a2b, identifier: PF97511
2026-03-29 18:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44034d65-de7f-5afa-806b-4c568deb5a2b with identifier: PF97511
2026-03-29 18:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44034d65-de7f-5afa-806b-4c568deb5a2b with identifier: PF97511
2026-03-29 18:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44034d65-de7f-5afa-806b-4c568deb5a2b with identifier: PF97511 to the API
2026-03-29 18:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:16:03Z',
'fuel_type': 'diesel',
'id': '44034d65-de7f-5afa-806b-4c568deb5a2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF97511',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 376988,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-20',
'seller_name': None,
'title': 'Audi A1 Sportback 1.6 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2013}
2026-03-29 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97511%27 HTTP/1.1" 200 None
2026-03-29 18:38:38 [auto1.de] INFO: Saving data for PF97511: {'auction_closing_time': 1774883763.0, 'created_time': 1773467119.490981, 'last_price_update_time': 1774809518.876832}
2026-03-29 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF97511') HTTP/1.1" 204 0
2026-03-29 18:38:38 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-29 18:38:38 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-29 18:38:38 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-29 18:38:38 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-29 18:38:38 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-29 18:38:38 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-29 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD70281%27 HTTP/1.1" 200 None
2026-03-29 18:38:38 [auto1.de] INFO: Scrape type for DD70281: 2
2026-03-29 18:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52e7d1b2-4ac5-573e-a457-f4cba539924f with identifier: DD70281
2026-03-29 18:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52e7d1b2-4ac5-573e-a457-f4cba539924f with scrape type 2
2026-03-29 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52e7d1b2-4ac5-573e-a457-f4cba539924f with scrape type 2
2026-03-29 18:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52e7d1b2-4ac5-573e-a457-f4cba539924f, identifier: DD70281
2026-03-29 18:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52e7d1b2-4ac5-573e-a457-f4cba539924f with identifier: DD70281
2026-03-29 18:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52e7d1b2-4ac5-573e-a457-f4cba539924f with identifier: DD70281
2026-03-29 18:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52e7d1b2-4ac5-573e-a457-f4cba539924f with identifier: DD70281 to the API
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:38:47Z',
'fuel_type': 'diesel',
'id': '52e7d1b2-4ac5-573e-a457-f4cba539924f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD70281',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 216354,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-30',
'seller_name': None,
'title': 'Renault Scenic 1.6 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2011}
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD70281%27 HTTP/1.1" 200 None
2026-03-29 18:38:39 [auto1.de] INFO: Saving data for DD70281: {'auction_closing_time': 1774885127.0, 'created_time': 1773662296.665719, 'last_price_update_time': 1774809519.312567}
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD70281') HTTP/1.1" 204 0
2026-03-29 18:38:39 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE91450%27 HTTP/1.1" 200 None
2026-03-29 18:38:39 [auto1.de] INFO: Scrape type for PE91450: 2
2026-03-29 18:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adc36cff-999e-5178-a979-7747d1f01eca with identifier: PE91450
2026-03-29 18:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adc36cff-999e-5178-a979-7747d1f01eca with scrape type 2
2026-03-29 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adc36cff-999e-5178-a979-7747d1f01eca with scrape type 2
2026-03-29 18:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adc36cff-999e-5178-a979-7747d1f01eca, identifier: PE91450
2026-03-29 18:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adc36cff-999e-5178-a979-7747d1f01eca with identifier: PE91450
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-29 18:38:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adc36cff-999e-5178-a979-7747d1f01eca with identifier: PE91450
2026-03-29 18:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adc36cff-999e-5178-a979-7747d1f01eca with identifier: PE91450 to the API
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:13:51Z',
'fuel_type': 'petrol',
'id': 'adc36cff-999e-5178-a979-7747d1f01eca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE91450',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 81833,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-16',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 Edition 2020 AMG Line',
'transmission': 'automatic',
'trim': 'Edition 2020 AMG Line',
'year': 2021}
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE91450%27 HTTP/1.1" 200 None
2026-03-29 18:38:39 [auto1.de] INFO: Saving data for PE91450: {'auction_closing_time': 1774883631.0, 'created_time': 1774294889.730642, 'last_price_update_time': 1774809519.903677}
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE91450') HTTP/1.1" 204 0
2026-03-29 18:38:39 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS10261%27 HTTP/1.1" 200 None
2026-03-29 18:38:39 [auto1.de] INFO: Scrape type for VS10261: 0
2026-03-29 18:38:39 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-29 18:38:39 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-29 18:38:39 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-29 18:38:39 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG44703%27 HTTP/1.1" 200 None
2026-03-29 18:38:39 [auto1.de] INFO: Scrape type for NG44703: 2
2026-03-29 18:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4a405ad-9c93-5878-9f15-78035a93bfa7 with identifier: NG44703
2026-03-29 18:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4a405ad-9c93-5878-9f15-78035a93bfa7 with scrape type 2
2026-03-29 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4a405ad-9c93-5878-9f15-78035a93bfa7 with scrape type 2
2026-03-29 18:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4a405ad-9c93-5878-9f15-78035a93bfa7, identifier: NG44703
2026-03-29 18:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4a405ad-9c93-5878-9f15-78035a93bfa7 with identifier: NG44703
2026-03-29 18:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4a405ad-9c93-5878-9f15-78035a93bfa7 with identifier: NG44703
2026-03-29 18:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4a405ad-9c93-5878-9f15-78035a93bfa7 with identifier: NG44703 to the API
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:12:24Z',
'fuel_type': 'petrol',
'id': 'b4a405ad-9c93-5878-9f15-78035a93bfa7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG44703',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 143570,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-12-31',
'seller_name': None,
'title': 'Renault Megane 1.6 Avantage',
'transmission': 'manual',
'trim': 'Avantage',
'year': 2007}
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG44703%27 HTTP/1.1" 200 None
2026-03-29 18:38:40 [auto1.de] INFO: Saving data for NG44703: {'auction_closing_time': 1774883544.0, 'created_time': 1774607874.812894, 'last_price_update_time': 1774809520.385935}
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG44703') HTTP/1.1" 204 0
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS75707%27 HTTP/1.1" 200 None
2026-03-29 18:38:40 [auto1.de] INFO: Scrape type for MS75707: 0
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH77412%27 HTTP/1.1" 200 None
2026-03-29 18:38:40 [auto1.de] INFO: Scrape type for TH77412: 2
2026-03-29 18:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c with identifier: TH77412
2026-03-29 18:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c with scrape type 2
2026-03-29 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c with scrape type 2
2026-03-29 18:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c, identifier: TH77412
2026-03-29 18:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c with identifier: TH77412
2026-03-29 18:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c with identifier: TH77412
2026-03-29 18:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c with identifier: TH77412 to the API
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:51:53Z',
'fuel_type': 'petrol',
'id': '8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH77412',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 159256,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-20',
'seller_name': None,
'title': 'BMW 1er 118i',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH77412%27 HTTP/1.1" 200 None
2026-03-29 18:38:40 [auto1.de] INFO: Saving data for TH77412: {'auction_closing_time': 1774885913.0, 'created_time': 1774522231.311459, 'last_price_update_time': 1774809520.906412}
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH77412') HTTP/1.1" 204 0
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ55877%27 HTTP/1.1" 200 None
2026-03-29 18:38:40 [auto1.de] INFO: Scrape type for SZ55877: 2
2026-03-29 18:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb79280c-127c-50a8-9ea7-2a1402a3970c with identifier: SZ55877
2026-03-29 18:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb79280c-127c-50a8-9ea7-2a1402a3970c with scrape type 2
2026-03-29 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb79280c-127c-50a8-9ea7-2a1402a3970c with scrape type 2
2026-03-29 18:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb79280c-127c-50a8-9ea7-2a1402a3970c, identifier: SZ55877
2026-03-29 18:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb79280c-127c-50a8-9ea7-2a1402a3970c with identifier: SZ55877
2026-03-29 18:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb79280c-127c-50a8-9ea7-2a1402a3970c with identifier: SZ55877
2026-03-29 18:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb79280c-127c-50a8-9ea7-2a1402a3970c with identifier: SZ55877 to the API
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:23Z',
'fuel_type': 'diesel',
'id': 'eb79280c-127c-50a8-9ea7-2a1402a3970c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ55877',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 141495,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-06',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Highline BlueMotion Tech',
'year': 2017}
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ55877%27 HTTP/1.1" 200 None
2026-03-29 18:38:41 [auto1.de] INFO: Saving data for SZ55877: {'auction_closing_time': 1774883003.0, 'created_time': 1773946074.5603, 'last_price_update_time': 1774809521.321034}
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ55877') HTTP/1.1" 204 0
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH79941%27 HTTP/1.1" 200 None
2026-03-29 18:38:41 [auto1.de] INFO: Scrape type for CH79941: 0
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX70846%27 HTTP/1.1" 200 None
2026-03-29 18:38:41 [auto1.de] INFO: Scrape type for BX70846: 0
2026-03-29 18:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:41 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ62402%27 HTTP/1.1" 200 None
2026-03-29 18:38:41 [auto1.de] INFO: Scrape type for ZZ62402: 0
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM31367%27 HTTP/1.1" 200 None
2026-03-29 18:38:41 [auto1.de] INFO: Scrape type for WM31367: 2
2026-03-29 18:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c1b5fc7-88fb-5545-8e7e-850e61202739 with identifier: WM31367
2026-03-29 18:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c1b5fc7-88fb-5545-8e7e-850e61202739 with scrape type 2
2026-03-29 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c1b5fc7-88fb-5545-8e7e-850e61202739 with scrape type 2
2026-03-29 18:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c1b5fc7-88fb-5545-8e7e-850e61202739, identifier: WM31367
2026-03-29 18:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c1b5fc7-88fb-5545-8e7e-850e61202739 with identifier: WM31367
2026-03-29 18:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c1b5fc7-88fb-5545-8e7e-850e61202739 with identifier: WM31367
2026-03-29 18:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c1b5fc7-88fb-5545-8e7e-850e61202739 with identifier: WM31367 to the API
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 450,
'expiration_date': '2026-03-30T15:01:39Z',
'fuel_type': 'petrol',
'id': '5c1b5fc7-88fb-5545-8e7e-850e61202739',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM31367',
'listing': 'auction',
'make': 'Ford',
'model': 'Mustang',
'odometer': 72082,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-15',
'seller_name': None,
'title': 'Ford Mustang 5.0 Ti-VCT V8 GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2020}
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM31367%27 HTTP/1.1" 200 None
2026-03-29 18:38:41 [auto1.de] INFO: Saving data for WM31367: {'auction_closing_time': 1774882899.0, 'created_time': 1772546454.546687, 'last_price_update_time': 1774809521.976775}
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM31367') HTTP/1.1" 204 0
2026-03-29 18:38:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK43100%27 HTTP/1.1" 200 None
2026-03-29 18:38:42 [auto1.de] INFO: Scrape type for AK43100: 0
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD59172%27 HTTP/1.1" 200 None
2026-03-29 18:38:42 [auto1.de] INFO: Scrape type for SD59172: 0
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR59541%27 HTTP/1.1" 200 None
2026-03-29 18:38:42 [auto1.de] INFO: Scrape type for SR59541: 2
2026-03-29 18:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10854e40-e34c-5a76-ad28-17e40926b7de with identifier: SR59541
2026-03-29 18:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10854e40-e34c-5a76-ad28-17e40926b7de with scrape type 2
2026-03-29 18:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10854e40-e34c-5a76-ad28-17e40926b7de with scrape type 2
2026-03-29 18:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10854e40-e34c-5a76-ad28-17e40926b7de, identifier: SR59541
2026-03-29 18:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10854e40-e34c-5a76-ad28-17e40926b7de with identifier: SR59541
2026-03-29 18:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10854e40-e34c-5a76-ad28-17e40926b7de with identifier: SR59541
2026-03-29 18:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10854e40-e34c-5a76-ad28-17e40926b7de with identifier: SR59541 to the API
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:12:12Z',
'fuel_type': 'diesel',
'id': '10854e40-e34c-5a76-ad28-17e40926b7de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR59541',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 254378,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-08',
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 300 CDI 4Matic BlueEfficiency',
'transmission': 'automatic',
'trim': '4Matic BlueEfficiency',
'year': 2011}
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR59541%27 HTTP/1.1" 200 None
2026-03-29 18:38:42 [auto1.de] INFO: Saving data for SR59541: {'auction_closing_time': 1774883532.0, 'created_time': 1774089323.457641, 'last_price_update_time': 1774809522.522359}
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR59541') HTTP/1.1" 204 0
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71722%27 HTTP/1.1" 200 None
2026-03-29 18:38:42 [auto1.de] INFO: Scrape type for GJ71722: 2
2026-03-29 18:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7ca7b95-735b-5c73-9ecc-cd503ceeb19d with identifier: GJ71722
2026-03-29 18:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7ca7b95-735b-5c73-9ecc-cd503ceeb19d with scrape type 2
2026-03-29 18:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7ca7b95-735b-5c73-9ecc-cd503ceeb19d with scrape type 2
2026-03-29 18:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7ca7b95-735b-5c73-9ecc-cd503ceeb19d, identifier: GJ71722
2026-03-29 18:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7ca7b95-735b-5c73-9ecc-cd503ceeb19d with identifier: GJ71722
2026-03-29 18:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7ca7b95-735b-5c73-9ecc-cd503ceeb19d with identifier: GJ71722
2026-03-29 18:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7ca7b95-735b-5c73-9ecc-cd503ceeb19d with identifier: GJ71722 to the API
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:56:13Z',
'fuel_type': 'petrol',
'id': 'a7ca7b95-735b-5c73-9ecc-cd503ceeb19d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ71722',
'listing': 'auction',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 21707,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-03',
'seller_name': None,
'title': 'Skoda Karoq 1.5 TSI ACT Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2020}
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71722%27 HTTP/1.1" 200 None
2026-03-29 18:38:42 [auto1.de] INFO: Saving data for GJ71722: {'auction_closing_time': 1774886173.0, 'created_time': 1773428076.421312, 'last_price_update_time': 1774809522.937002}
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ71722') HTTP/1.1" 204 0
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW31978%27 HTTP/1.1" 200 None
2026-03-29 18:38:42 [auto1.de] INFO: Scrape type for MW31978: 2
2026-03-29 18:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with identifier: MW31978
2026-03-29 18:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with scrape type 2
2026-03-29 18:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with scrape type 2
2026-03-29 18:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3d1ba04-710d-568f-97ee-d9ca1e5da2b7, identifier: MW31978
2026-03-29 18:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with identifier: MW31978
2026-03-29 18:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with identifier: MW31978
2026-03-29 18:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with identifier: MW31978 to the API
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:27:21Z',
'fuel_type': 'petrol',
'id': 'c3d1ba04-710d-568f-97ee-d9ca1e5da2b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW31978',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 46994,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-14',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.5 eTSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2024}
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW31978%27 HTTP/1.1" 200 None
2026-03-29 18:38:43 [auto1.de] INFO: Saving data for MW31978: {'auction_closing_time': 1774884441.0, 'created_time': 1773775515.30162, 'last_price_update_time': 1774809523.384206}
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW31978') HTTP/1.1" 204 0
2026-03-29 18:38:43 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV44481%27 HTTP/1.1" 200 None
2026-03-29 18:38:43 [auto1.de] INFO: Scrape type for HV44481: 0
2026-03-29 18:38:43 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY67891%27 HTTP/1.1" 200 None
2026-03-29 18:38:43 [auto1.de] INFO: Scrape type for NY67891: 2
2026-03-29 18:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b6415df-73d6-5386-b38b-37f5ce6717a3 with identifier: NY67891
2026-03-29 18:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6415df-73d6-5386-b38b-37f5ce6717a3 with scrape type 2
2026-03-29 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b6415df-73d6-5386-b38b-37f5ce6717a3 with scrape type 2
2026-03-29 18:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b6415df-73d6-5386-b38b-37f5ce6717a3, identifier: NY67891
2026-03-29 18:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b6415df-73d6-5386-b38b-37f5ce6717a3 with identifier: NY67891
2026-03-29 18:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b6415df-73d6-5386-b38b-37f5ce6717a3 with identifier: NY67891
2026-03-29 18:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b6415df-73d6-5386-b38b-37f5ce6717a3 with identifier: NY67891 to the API
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:31:05Z',
'fuel_type': 'petrol',
'id': '8b6415df-73d6-5386-b38b-37f5ce6717a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY67891',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 94062,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-12',
'seller_name': None,
'title': 'Audi A3 Sportback 35 TFSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY67891%27 HTTP/1.1" 200 None
2026-03-29 18:38:43 [auto1.de] INFO: Saving data for NY67891: {'auction_closing_time': 1774884665.0, 'created_time': 1773429153.567507, 'last_price_update_time': 1774809523.843337}
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY67891') HTTP/1.1" 204 0
2026-03-29 18:38:43 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-29 18:38:43 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU06279%27 HTTP/1.1" 200 None
2026-03-29 18:38:43 [auto1.de] INFO: Scrape type for SU06279: 2
2026-03-29 18:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23325444-9cbf-577a-beed-221df573258f with identifier: SU06279
2026-03-29 18:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23325444-9cbf-577a-beed-221df573258f with scrape type 2
2026-03-29 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23325444-9cbf-577a-beed-221df573258f with scrape type 2
2026-03-29 18:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23325444-9cbf-577a-beed-221df573258f, identifier: SU06279
2026-03-29 18:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23325444-9cbf-577a-beed-221df573258f with identifier: SU06279
2026-03-29 18:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23325444-9cbf-577a-beed-221df573258f with identifier: SU06279
2026-03-29 18:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23325444-9cbf-577a-beed-221df573258f with identifier: SU06279 to the API
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:11:43Z',
'fuel_type': 'diesel',
'id': '23325444-9cbf-577a-beed-221df573258f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU06279',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 275945,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-25',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Drive 125 4x4',
'transmission': 'automatic',
'trim': 'Drive 125 4x4',
'year': 2020}
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU06279%27 HTTP/1.1" 200 None
2026-03-29 18:38:44 [auto1.de] INFO: Saving data for SU06279: {'auction_closing_time': 1774883503.0, 'created_time': 1774349893.903993, 'last_price_update_time': 1774809524.263325}
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU06279') HTTP/1.1" 204 0
2026-03-29 18:38:44 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW53715%27 HTTP/1.1" 200 None
2026-03-29 18:38:44 [auto1.de] INFO: Scrape type for HW53715: 2
2026-03-29 18:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94e08fe9-7b47-56ff-9dde-c55bb8dfaeca with identifier: HW53715
2026-03-29 18:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94e08fe9-7b47-56ff-9dde-c55bb8dfaeca with scrape type 2
2026-03-29 18:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94e08fe9-7b47-56ff-9dde-c55bb8dfaeca with scrape type 2
2026-03-29 18:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94e08fe9-7b47-56ff-9dde-c55bb8dfaeca, identifier: HW53715
2026-03-29 18:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94e08fe9-7b47-56ff-9dde-c55bb8dfaeca with identifier: HW53715
2026-03-29 18:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94e08fe9-7b47-56ff-9dde-c55bb8dfaeca with identifier: HW53715
2026-03-29 18:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94e08fe9-7b47-56ff-9dde-c55bb8dfaeca with identifier: HW53715 to the API
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:23:39Z',
'fuel_type': 'petrol',
'id': '94e08fe9-7b47-56ff-9dde-c55bb8dfaeca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW53715',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 131748,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-12-18',
'seller_name': None,
'title': 'Opel Meriva 1.6 Navi',
'transmission': 'automatic',
'trim': 'Navi',
'year': 2007}
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW53715%27 HTTP/1.1" 200 None
2026-03-29 18:38:44 [auto1.de] INFO: Saving data for HW53715: {'auction_closing_time': 1774884219.0, 'created_time': 1773466224.248574, 'last_price_update_time': 1774809524.68228}
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW53715') HTTP/1.1" 204 0
2026-03-29 18:38:44 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR35436%27 HTTP/1.1" 200 None
2026-03-29 18:38:44 [auto1.de] INFO: Scrape type for CR35436: 0
2026-03-29 18:38:44 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-29 18:38:44 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-29 18:38:44 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-29 18:38:44 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR44152%27 HTTP/1.1" 200 None
2026-03-29 18:38:44 [auto1.de] INFO: Scrape type for HR44152: 0
2026-03-29 18:38:44 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-29 18:38:44 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV89057%27 HTTP/1.1" 200 None
2026-03-29 18:38:44 [auto1.de] INFO: Scrape type for CV89057: 2
2026-03-29 18:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39e01bac-766d-5890-905e-f1b51cedee13 with identifier: CV89057
2026-03-29 18:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39e01bac-766d-5890-905e-f1b51cedee13 with scrape type 2
2026-03-29 18:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39e01bac-766d-5890-905e-f1b51cedee13 with scrape type 2
2026-03-29 18:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39e01bac-766d-5890-905e-f1b51cedee13, identifier: CV89057
2026-03-29 18:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39e01bac-766d-5890-905e-f1b51cedee13 with identifier: CV89057
2026-03-29 18:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39e01bac-766d-5890-905e-f1b51cedee13 with identifier: CV89057
2026-03-29 18:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39e01bac-766d-5890-905e-f1b51cedee13 with identifier: CV89057 to the API
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:46:10Z',
'fuel_type': 'petrol',
'id': '39e01bac-766d-5890-905e-f1b51cedee13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV89057',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 73793,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-03',
'seller_name': None,
'title': 'BMW 3er 330i Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2019}
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV89057%27 HTTP/1.1" 200 None
2026-03-29 18:38:45 [auto1.de] INFO: Saving data for CV89057: {'auction_closing_time': 1774885570.0, 'created_time': 1773775548.891016, 'last_price_update_time': 1774809525.275098}
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV89057') HTTP/1.1" 204 0
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS01662%27 HTTP/1.1" 200 None
2026-03-29 18:38:45 [auto1.de] INFO: Scrape type for YS01662: 0
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA30425%27 HTTP/1.1" 200 None
2026-03-29 18:38:45 [auto1.de] INFO: Scrape type for AA30425: 0
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB14083%27 HTTP/1.1" 200 None
2026-03-29 18:38:45 [auto1.de] INFO: Scrape type for AB14083: 2
2026-03-29 18:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7befd98-7c74-5aef-985d-5b661a3028ac with identifier: AB14083
2026-03-29 18:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7befd98-7c74-5aef-985d-5b661a3028ac with scrape type 2
2026-03-29 18:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7befd98-7c74-5aef-985d-5b661a3028ac with scrape type 2
2026-03-29 18:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7befd98-7c74-5aef-985d-5b661a3028ac, identifier: AB14083
2026-03-29 18:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7befd98-7c74-5aef-985d-5b661a3028ac with identifier: AB14083
2026-03-29 18:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7befd98-7c74-5aef-985d-5b661a3028ac with identifier: AB14083
2026-03-29 18:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7befd98-7c74-5aef-985d-5b661a3028ac with identifier: AB14083 to the API
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:11:51Z',
'fuel_type': 'petrol',
'id': 'f7befd98-7c74-5aef-985d-5b661a3028ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB14083',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 116246,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-04-21',
'seller_name': None,
'title': 'Volkswagen Golf V 1.6 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2005}
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB14083%27 HTTP/1.1" 200 None
2026-03-29 18:38:45 [auto1.de] INFO: Saving data for AB14083: {'auction_closing_time': 1774883511.0, 'created_time': 1774031485.470664, 'last_price_update_time': 1774809525.749105}
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB14083') HTTP/1.1" 204 0
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL45560%27 HTTP/1.1" 200 None
2026-03-29 18:38:45 [auto1.de] INFO: Scrape type for DL45560: 0
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC28656%27 HTTP/1.1" 200 None
2026-03-29 18:38:45 [auto1.de] INFO: Scrape type for GC28656: 0
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-29 18:38:45 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV81502%27 HTTP/1.1" 200 None
2026-03-29 18:38:45 [auto1.de] INFO: Scrape type for BV81502: 0
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT10840%27 HTTP/1.1" 200 None
2026-03-29 18:38:45 [auto1.de] INFO: Scrape type for KT10840: 2
2026-03-29 18:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with identifier: KT10840
2026-03-29 18:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with scrape type 2
2026-03-29 18:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with scrape type 2
2026-03-29 18:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9482a3f-a4d1-5e4e-9de1-bae9acefdff3, identifier: KT10840
2026-03-29 18:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with identifier: KT10840
2026-03-29 18:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with identifier: KT10840
2026-03-29 18:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with identifier: KT10840 to the API
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:46:44Z',
'fuel_type': 'diesel',
'id': 'a9482a3f-a4d1-5e4e-9de1-bae9acefdff3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT10840',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 159916,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-13',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi I-Way',
'transmission': 'manual',
'trim': 'I-Way',
'year': 2012}
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT10840%27 HTTP/1.1" 200 None
2026-03-29 18:38:46 [auto1.de] INFO: Saving data for KT10840: {'auction_closing_time': 1774885604.0, 'created_time': 1773859686.043765, 'last_price_update_time': 1774809526.389594}
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT10840') HTTP/1.1" 204 0
2026-03-29 18:38:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:46 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK17459%27 HTTP/1.1" 200 None
2026-03-29 18:38:46 [auto1.de] INFO: Scrape type for JK17459: 2
2026-03-29 18:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with identifier: JK17459
2026-03-29 18:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with scrape type 2
2026-03-29 18:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with scrape type 2
2026-03-29 18:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5398c5e1-fcde-5d4b-bf2f-c44038dca325, identifier: JK17459
2026-03-29 18:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with identifier: JK17459
2026-03-29 18:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with identifier: JK17459
2026-03-29 18:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with identifier: JK17459 to the API
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:55:37Z',
'fuel_type': 'diesel',
'id': '5398c5e1-fcde-5d4b-bf2f-c44038dca325',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK17459',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vaneo',
'odometer': 113495,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-09-15',
'seller_name': None,
'title': 'Mercedes-Benz Vaneo 1.7 CDI Family',
'transmission': 'automatic',
'trim': 'Family',
'year': 2003}
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK17459%27 HTTP/1.1" 200 None
2026-03-29 18:38:46 [auto1.de] INFO: Saving data for JK17459: {'auction_closing_time': 1774886137.0, 'created_time': 1774294742.310111, 'last_price_update_time': 1774809526.815348}
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK17459') HTTP/1.1" 204 0
2026-03-29 18:38:46 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-29 18:38:46 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK58988%27 HTTP/1.1" 200 None
2026-03-29 18:38:46 [auto1.de] INFO: Scrape type for AK58988: 2
2026-03-29 18:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19f53cc6-b6a8-59b5-b676-b53a91f3c490 with identifier: AK58988
2026-03-29 18:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19f53cc6-b6a8-59b5-b676-b53a91f3c490 with scrape type 2
2026-03-29 18:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19f53cc6-b6a8-59b5-b676-b53a91f3c490 with scrape type 2
2026-03-29 18:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19f53cc6-b6a8-59b5-b676-b53a91f3c490, identifier: AK58988
2026-03-29 18:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19f53cc6-b6a8-59b5-b676-b53a91f3c490 with identifier: AK58988
2026-03-29 18:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19f53cc6-b6a8-59b5-b676-b53a91f3c490 with identifier: AK58988
2026-03-29 18:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19f53cc6-b6a8-59b5-b676-b53a91f3c490 with identifier: AK58988 to the API
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 250,
'expiration_date': '2026-03-30T15:42:21Z',
'fuel_type': 'petrol',
'id': '19f53cc6-b6a8-59b5-b676-b53a91f3c490',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK58988',
'listing': 'auction',
'make': 'Porsche',
'model': '911',
'odometer': 140558,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1993-02-03',
'seller_name': None,
'title': 'Porsche 911 964 Carrera 2 Cabrio',
'transmission': 'manual',
'trim': 'Carrera 2 Cabrio',
'year': 1993}
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK58988%27 HTTP/1.1" 200 None
2026-03-29 18:38:47 [auto1.de] INFO: Saving data for AK58988: {'auction_closing_time': 1774885341.0, 'created_time': 1773466892.742894, 'last_price_update_time': 1774809527.249422}
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK58988') HTTP/1.1" 204 0
2026-03-29 18:38:47 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN63350%27 HTTP/1.1" 200 None
2026-03-29 18:38:47 [auto1.de] INFO: Scrape type for ZN63350: 2
2026-03-29 18:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5255c63-9d44-5f4d-8c46-71e9682a5d9e with identifier: ZN63350
2026-03-29 18:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5255c63-9d44-5f4d-8c46-71e9682a5d9e with scrape type 2
2026-03-29 18:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5255c63-9d44-5f4d-8c46-71e9682a5d9e with scrape type 2
2026-03-29 18:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5255c63-9d44-5f4d-8c46-71e9682a5d9e, identifier: ZN63350
2026-03-29 18:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5255c63-9d44-5f4d-8c46-71e9682a5d9e with identifier: ZN63350
2026-03-29 18:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5255c63-9d44-5f4d-8c46-71e9682a5d9e with identifier: ZN63350
2026-03-29 18:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5255c63-9d44-5f4d-8c46-71e9682a5d9e with identifier: ZN63350 to the API
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:02:50Z',
'fuel_type': 'petrol',
'id': 'b5255c63-9d44-5f4d-8c46-71e9682a5d9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN63350',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 204047,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-25',
'seller_name': None,
'title': 'Skoda Octavia 1.6 Tour',
'transmission': 'manual',
'trim': 'Tour',
'year': 2010}
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN63350%27 HTTP/1.1" 200 None
2026-03-29 18:38:47 [auto1.de] INFO: Saving data for ZN63350: {'auction_closing_time': 1774882970.0, 'created_time': 1773304071.171059, 'last_price_update_time': 1774809527.698194}
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN63350') HTTP/1.1" 204 0
2026-03-29 18:38:47 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR13595%27 HTTP/1.1" 200 None
2026-03-29 18:38:47 [auto1.de] INFO: Scrape type for HR13595: 0
2026-03-29 18:38:47 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE39343%27 HTTP/1.1" 200 None
2026-03-29 18:38:47 [auto1.de] INFO: Scrape type for TE39343: 2
2026-03-29 18:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a615796-5005-5ed1-9c2a-e3cee4072121 with identifier: TE39343
2026-03-29 18:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a615796-5005-5ed1-9c2a-e3cee4072121 with scrape type 2
2026-03-29 18:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a615796-5005-5ed1-9c2a-e3cee4072121 with scrape type 2
2026-03-29 18:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a615796-5005-5ed1-9c2a-e3cee4072121, identifier: TE39343
2026-03-29 18:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a615796-5005-5ed1-9c2a-e3cee4072121 with identifier: TE39343
2026-03-29 18:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a615796-5005-5ed1-9c2a-e3cee4072121 with identifier: TE39343
2026-03-29 18:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a615796-5005-5ed1-9c2a-e3cee4072121 with identifier: TE39343 to the API
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:36:37Z',
'fuel_type': 'petrol',
'id': '3a615796-5005-5ed1-9c2a-e3cee4072121',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE39343',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 130813,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-27',
'seller_name': None,
'title': 'Volkswagen Scirocco 1.4 TSI',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE39343%27 HTTP/1.1" 200 None
2026-03-29 18:38:48 [auto1.de] INFO: Saving data for TE39343: {'auction_closing_time': 1774884997.0, 'created_time': 1773343749.517569, 'last_price_update_time': 1774809528.288519}
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE39343') HTTP/1.1" 204 0
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP85770%27 HTTP/1.1" 200 None
2026-03-29 18:38:48 [auto1.de] INFO: Scrape type for PP85770: 0
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC75041%27 HTTP/1.1" 200 None
2026-03-29 18:38:48 [auto1.de] INFO: Scrape type for FC75041: 0
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH71943%27 HTTP/1.1" 200 None
2026-03-29 18:38:48 [auto1.de] INFO: Scrape type for AH71943: 2
2026-03-29 18:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with identifier: AH71943
2026-03-29 18:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with scrape type 2
2026-03-29 18:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with scrape type 2
2026-03-29 18:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc3dc508-45ad-56f8-a95d-dd1d888a6fb0, identifier: AH71943
2026-03-29 18:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with identifier: AH71943
2026-03-29 18:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with identifier: AH71943
2026-03-29 18:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with identifier: AH71943 to the API
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:25:28Z',
'fuel_type': 'diesel',
'id': 'cc3dc508-45ad-56f8-a95d-dd1d888a6fb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH71943',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 172178,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-25',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'automatic',
'trim': 'RS',
'year': 2015}
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH71943%27 HTTP/1.1" 200 None
2026-03-29 18:38:48 [auto1.de] INFO: Saving data for AH71943: {'auction_closing_time': 1774884328.0, 'created_time': 1774608103.724049, 'last_price_update_time': 1774809528.785457}
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH71943') HTTP/1.1" 204 0
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY07286%27 HTTP/1.1" 200 None
2026-03-29 18:38:48 [auto1.de] INFO: Scrape type for VY07286: 0
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP81674%27 HTTP/1.1" 200 None
2026-03-29 18:38:48 [auto1.de] INFO: Scrape type for KP81674: 0
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: JN51648
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG63340%27 HTTP/1.1" 200 None
2026-03-29 18:38:48 [auto1.de] INFO: Scrape type for MG63340: 2
2026-03-29 18:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9086c65-31c6-5ae1-8775-d95151bf24ae with identifier: MG63340
2026-03-29 18:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9086c65-31c6-5ae1-8775-d95151bf24ae with scrape type 2
2026-03-29 18:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9086c65-31c6-5ae1-8775-d95151bf24ae with scrape type 2
2026-03-29 18:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9086c65-31c6-5ae1-8775-d95151bf24ae, identifier: MG63340
2026-03-29 18:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9086c65-31c6-5ae1-8775-d95151bf24ae with identifier: MG63340
2026-03-29 18:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9086c65-31c6-5ae1-8775-d95151bf24ae with identifier: MG63340
2026-03-29 18:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9086c65-31c6-5ae1-8775-d95151bf24ae with identifier: MG63340 to the API
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:10:25Z',
'fuel_type': 'diesel',
'id': 'e9086c65-31c6-5ae1-8775-d95151bf24ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG63340',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 157749,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-06',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2016}
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG63340%27 HTTP/1.1" 200 None
2026-03-29 18:38:49 [auto1.de] INFO: Saving data for MG63340: {'auction_closing_time': 1774883425.0, 'created_time': 1773775150.209452, 'last_price_update_time': 1774809529.291295}
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG63340') HTTP/1.1" 204 0
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE11202%27 HTTP/1.1" 200 None
2026-03-29 18:38:49 [auto1.de] INFO: Scrape type for UE11202: 0
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN06918%27 HTTP/1.1" 200 None
2026-03-29 18:38:49 [auto1.de] INFO: Scrape type for JN06918: 0
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU16718%27 HTTP/1.1" 200 None
2026-03-29 18:38:49 [auto1.de] INFO: Scrape type for HU16718: 2
2026-03-29 18:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with identifier: HU16718
2026-03-29 18:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with scrape type 2
2026-03-29 18:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with scrape type 2
2026-03-29 18:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a74c911e-68c6-58e9-b22d-dc2aa97d03a7, identifier: HU16718
2026-03-29 18:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with identifier: HU16718
2026-03-29 18:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with identifier: HU16718
2026-03-29 18:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with identifier: HU16718 to the API
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:04:35Z',
'fuel_type': 'petrol',
'id': 'a74c911e-68c6-58e9-b22d-dc2aa97d03a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU16718',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 152833,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-11',
'seller_name': None,
'title': 'Nissan Qashqai 1.2 Visia',
'transmission': 'manual',
'trim': 'Visia',
'year': 2016}
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU16718%27 HTTP/1.1" 200 None
2026-03-29 18:38:49 [auto1.de] INFO: Saving data for HU16718: {'auction_closing_time': 1774883075.0, 'created_time': 1773306426.214923, 'last_price_update_time': 1774809529.876218}
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU16718') HTTP/1.1" 204 0
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ39351%27 HTTP/1.1" 200 None
2026-03-29 18:38:50 [auto1.de] INFO: Scrape type for ZJ39351: 2
2026-03-29 18:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2243856-a513-55c6-b9aa-61de1462e166 with identifier: ZJ39351
2026-03-29 18:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2243856-a513-55c6-b9aa-61de1462e166 with scrape type 2
2026-03-29 18:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2243856-a513-55c6-b9aa-61de1462e166 with scrape type 2
2026-03-29 18:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2243856-a513-55c6-b9aa-61de1462e166, identifier: ZJ39351
2026-03-29 18:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2243856-a513-55c6-b9aa-61de1462e166 with identifier: ZJ39351
2026-03-29 18:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2243856-a513-55c6-b9aa-61de1462e166 with identifier: ZJ39351
2026-03-29 18:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2243856-a513-55c6-b9aa-61de1462e166 with identifier: ZJ39351 to the API
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:47:26Z',
'fuel_type': 'diesel',
'id': 'd2243856-a513-55c6-b9aa-61de1462e166',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ39351',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 310660,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-06',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ39351%27 HTTP/1.1" 200 None
2026-03-29 18:38:50 [auto1.de] INFO: Saving data for ZJ39351: {'auction_closing_time': 1774885646.0, 'created_time': 1774521327.318543, 'last_price_update_time': 1774809530.380433}
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ39351') HTTP/1.1" 204 0
2026-03-29 18:38:50 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89530%27 HTTP/1.1" 200 None
2026-03-29 18:38:50 [auto1.de] INFO: Scrape type for VS89530: 2
2026-03-29 18:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with identifier: VS89530
2026-03-29 18:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with scrape type 2
2026-03-29 18:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with scrape type 2
2026-03-29 18:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1, identifier: VS89530
2026-03-29 18:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with identifier: VS89530
2026-03-29 18:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with identifier: VS89530
2026-03-29 18:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with identifier: VS89530 to the API
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-30T15:37:43Z',
'fuel_type': 'petrol',
'id': '7350c2eb-76a5-5cf0-95b6-65a0c94c46a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS89530',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 150516,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-03',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 Style 2WD',
'transmission': 'manual',
'trim': 'Style 2WD',
'year': 2019}
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89530%27 HTTP/1.1" 200 None
2026-03-29 18:38:50 [auto1.de] INFO: Saving data for VS89530: {'auction_closing_time': 1774885063.0, 'created_time': 1773513684.443549, 'last_price_update_time': 1774809530.820159}
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS89530') HTTP/1.1" 204 0
2026-03-29 18:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:50 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:50 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ19691%27 HTTP/1.1" 200 None
2026-03-29 18:38:50 [auto1.de] INFO: Scrape type for HZ19691: 2
2026-03-29 18:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4577fdf0-59b6-5052-89c2-6ff6a7859fac with identifier: HZ19691
2026-03-29 18:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4577fdf0-59b6-5052-89c2-6ff6a7859fac with scrape type 2
2026-03-29 18:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4577fdf0-59b6-5052-89c2-6ff6a7859fac with scrape type 2
2026-03-29 18:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4577fdf0-59b6-5052-89c2-6ff6a7859fac, identifier: HZ19691
2026-03-29 18:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4577fdf0-59b6-5052-89c2-6ff6a7859fac with identifier: HZ19691
2026-03-29 18:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4577fdf0-59b6-5052-89c2-6ff6a7859fac with identifier: HZ19691
2026-03-29 18:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4577fdf0-59b6-5052-89c2-6ff6a7859fac with identifier: HZ19691 to the API
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:20:00Z',
'fuel_type': 'petrol',
'id': '4577fdf0-59b6-5052-89c2-6ff6a7859fac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ19691',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 90769,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-21',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
'transmission': 'automatic',
'trim': 'Sport 4Motion',
'year': 2018}
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ19691%27 HTTP/1.1" 200 None
2026-03-29 18:38:51 [auto1.de] INFO: Saving data for HZ19691: {'auction_closing_time': 1774884000.0, 'created_time': 1773304413.250211, 'last_price_update_time': 1774809531.393598}
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ19691') HTTP/1.1" 204 0
2026-03-29 18:38:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:51 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR18814%27 HTTP/1.1" 200 None
2026-03-29 18:38:51 [auto1.de] INFO: Scrape type for RR18814: 2
2026-03-29 18:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af41d659-135e-542f-9d13-d19c9a1f9681 with identifier: RR18814
2026-03-29 18:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af41d659-135e-542f-9d13-d19c9a1f9681 with scrape type 2
2026-03-29 18:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af41d659-135e-542f-9d13-d19c9a1f9681 with scrape type 2
2026-03-29 18:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af41d659-135e-542f-9d13-d19c9a1f9681, identifier: RR18814
2026-03-29 18:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af41d659-135e-542f-9d13-d19c9a1f9681 with identifier: RR18814
2026-03-29 18:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af41d659-135e-542f-9d13-d19c9a1f9681 with identifier: RR18814
2026-03-29 18:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af41d659-135e-542f-9d13-d19c9a1f9681 with identifier: RR18814 to the API
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:00:24Z',
'fuel_type': 'petrol',
'id': 'af41d659-135e-542f-9d13-d19c9a1f9681',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR18814',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 49483,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-09',
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 35 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2020}
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR18814%27 HTTP/1.1" 200 None
2026-03-29 18:38:51 [auto1.de] INFO: Saving data for RR18814: {'auction_closing_time': 1774882824.0, 'created_time': 1773308123.177025, 'last_price_update_time': 1774809531.853182}
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR18814') HTTP/1.1" 204 0
2026-03-29 18:38:51 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71041%27 HTTP/1.1" 200 None
2026-03-29 18:38:51 [auto1.de] INFO: Scrape type for FJ71041: 2
2026-03-29 18:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with identifier: FJ71041
2026-03-29 18:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with scrape type 2
2026-03-29 18:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with scrape type 2
2026-03-29 18:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 491aaf14-d194-56ff-9ea6-d5f7177e1bb3, identifier: FJ71041
2026-03-29 18:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with identifier: FJ71041
2026-03-29 18:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with identifier: FJ71041
2026-03-29 18:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with identifier: FJ71041 to the API
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:16:39Z',
'fuel_type': 'petrol',
'id': '491aaf14-d194-56ff-9ea6-d5f7177e1bb3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ71041',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 79714,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-02',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2022}
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71041%27 HTTP/1.1" 200 None
2026-03-29 18:38:52 [auto1.de] INFO: Saving data for FJ71041: {'auction_closing_time': 1774883799.0, 'created_time': 1773229493.252307, 'last_price_update_time': 1774809532.291116}
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ71041') HTTP/1.1" 204 0
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91411%27 HTTP/1.1" 200 None
2026-03-29 18:38:52 [auto1.de] INFO: Scrape type for LC91411: 2
2026-03-29 18:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3380c483-8ae8-536d-9b30-b95ce534293b with identifier: LC91411
2026-03-29 18:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3380c483-8ae8-536d-9b30-b95ce534293b with scrape type 2
2026-03-29 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3380c483-8ae8-536d-9b30-b95ce534293b with scrape type 2
2026-03-29 18:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3380c483-8ae8-536d-9b30-b95ce534293b, identifier: LC91411
2026-03-29 18:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3380c483-8ae8-536d-9b30-b95ce534293b with identifier: LC91411
2026-03-29 18:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3380c483-8ae8-536d-9b30-b95ce534293b with identifier: LC91411
2026-03-29 18:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3380c483-8ae8-536d-9b30-b95ce534293b with identifier: LC91411 to the API
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 145,
'expiration_date': '2026-03-30T15:43:08Z',
'fuel_type': 'diesel',
'id': '3380c483-8ae8-536d-9b30-b95ce534293b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC91411',
'listing': 'auction',
'make': 'Fiat',
'model': 'Talento',
'odometer': 20354,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-16',
'seller_name': None,
'title': 'Fiat Talento 2.0 TwinTurbo Diesel Ecojet L2H1 1,2t Family',
'transmission': 'manual',
'trim': 'L2H1 1,2t Family',
'year': 2019}
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91411%27 HTTP/1.1" 200 None
2026-03-29 18:38:52 [auto1.de] INFO: Saving data for LC91411: {'auction_closing_time': 1774885388.0, 'created_time': 1774118640.250845, 'last_price_update_time': 1774809532.700863}
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC91411') HTTP/1.1" 204 0
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY11895%27 HTTP/1.1" 200 None
2026-03-29 18:38:52 [auto1.de] INFO: Scrape type for WY11895: 0
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA53807%27 HTTP/1.1" 200 None
2026-03-29 18:38:52 [auto1.de] INFO: Scrape type for NA53807: 2
2026-03-29 18:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0910a1a-16c2-523b-a9fa-72e8b6d4847a with identifier: NA53807
2026-03-29 18:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0910a1a-16c2-523b-a9fa-72e8b6d4847a with scrape type 2
2026-03-29 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0910a1a-16c2-523b-a9fa-72e8b6d4847a with scrape type 2
2026-03-29 18:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0910a1a-16c2-523b-a9fa-72e8b6d4847a, identifier: NA53807
2026-03-29 18:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0910a1a-16c2-523b-a9fa-72e8b6d4847a with identifier: NA53807
2026-03-29 18:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0910a1a-16c2-523b-a9fa-72e8b6d4847a with identifier: NA53807
2026-03-29 18:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0910a1a-16c2-523b-a9fa-72e8b6d4847a with identifier: NA53807 to the API
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 270,
'expiration_date': '2026-03-30T15:03:35Z',
'fuel_type': 'petrol',
'id': 'd0910a1a-16c2-523b-a9fa-72e8b6d4847a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA53807',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 176178,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-15',
'seller_name': None,
'title': 'Audi Q5 3.2 V6 FSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2009}
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA53807%27 HTTP/1.1" 200 None
2026-03-29 18:38:53 [auto1.de] INFO: Saving data for NA53807: {'auction_closing_time': 1774883015.0, 'created_time': 1774607930.729029, 'last_price_update_time': 1774809533.183896}
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA53807') HTTP/1.1" 204 0
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW78098%27 HTTP/1.1" 200 None
2026-03-29 18:38:53 [auto1.de] INFO: Scrape type for UW78098: 0
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE84214%27 HTTP/1.1" 200 None
2026-03-29 18:38:53 [auto1.de] INFO: Scrape type for AE84214: 0
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD94440%27 HTTP/1.1" 200 None
2026-03-29 18:38:53 [auto1.de] INFO: Scrape type for KD94440: 0
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU28434%27 HTTP/1.1" 200 None
2026-03-29 18:38:53 [auto1.de] INFO: Scrape type for XU28434: 2
2026-03-29 18:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a with identifier: XU28434
2026-03-29 18:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a with scrape type 2
2026-03-29 18:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a with scrape type 2
2026-03-29 18:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a, identifier: XU28434
2026-03-29 18:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a with identifier: XU28434
2026-03-29 18:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a with identifier: XU28434
2026-03-29 18:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a with identifier: XU28434 to the API
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:41:33Z',
'fuel_type': 'diesel',
'id': '4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU28434',
'listing': 'auction',
'make': 'Volvo',
'model': 'V90',
'odometer': 65009,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-22',
'seller_name': None,
'title': 'Volvo V90 2.0 D4 R-Design',
'transmission': 'automatic',
'trim': 'R-Design',
'year': 2020}
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU28434%27 HTTP/1.1" 200 None
2026-03-29 18:38:53 [auto1.de] INFO: Saving data for XU28434: {'auction_closing_time': 1774885293.0, 'created_time': 1774521448.035566, 'last_price_update_time': 1774809533.769203}
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU28434') HTTP/1.1" 204 0
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL26301%27 HTTP/1.1" 200 None
2026-03-29 18:38:53 [auto1.de] INFO: Scrape type for KL26301: 2
2026-03-29 18:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01a26636-1b04-5c1a-b3ee-70f1fc6106a1 with identifier: KL26301
2026-03-29 18:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01a26636-1b04-5c1a-b3ee-70f1fc6106a1 with scrape type 2
2026-03-29 18:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01a26636-1b04-5c1a-b3ee-70f1fc6106a1 with scrape type 2
2026-03-29 18:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01a26636-1b04-5c1a-b3ee-70f1fc6106a1, identifier: KL26301
2026-03-29 18:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01a26636-1b04-5c1a-b3ee-70f1fc6106a1 with identifier: KL26301
2026-03-29 18:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01a26636-1b04-5c1a-b3ee-70f1fc6106a1 with identifier: KL26301
2026-03-29 18:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01a26636-1b04-5c1a-b3ee-70f1fc6106a1 with identifier: KL26301 to the API
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 201,
'expiration_date': '2026-03-30T15:03:09Z',
'fuel_type': 'diesel',
'id': '01a26636-1b04-5c1a-b3ee-70f1fc6106a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL26301',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 96043,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-15',
'seller_name': None,
'title': 'BMW 5er 520d Mild-Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL26301%27 HTTP/1.1" 200 None
2026-03-29 18:38:54 [auto1.de] INFO: Saving data for KL26301: {'auction_closing_time': 1774882989.0, 'created_time': 1773466253.682453, 'last_price_update_time': 1774809534.214332}
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL26301') HTTP/1.1" 204 0
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: BG43270
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF92976%27 HTTP/1.1" 200 None
2026-03-29 18:38:54 [auto1.de] INFO: Scrape type for FF92976: 2
2026-03-29 18:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d049567-ddba-5da5-89b8-ff10d0657ab5 with identifier: FF92976
2026-03-29 18:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d049567-ddba-5da5-89b8-ff10d0657ab5 with scrape type 2
2026-03-29 18:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d049567-ddba-5da5-89b8-ff10d0657ab5 with scrape type 2
2026-03-29 18:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d049567-ddba-5da5-89b8-ff10d0657ab5, identifier: FF92976
2026-03-29 18:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d049567-ddba-5da5-89b8-ff10d0657ab5 with identifier: FF92976
2026-03-29 18:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d049567-ddba-5da5-89b8-ff10d0657ab5 with identifier: FF92976
2026-03-29 18:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d049567-ddba-5da5-89b8-ff10d0657ab5 with identifier: FF92976 to the API
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:46:58Z',
'fuel_type': 'diesel',
'id': '2d049567-ddba-5da5-89b8-ff10d0657ab5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF92976',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 307091,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-30',
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
'transmission': 'automatic',
'trim': 'BlueTEC',
'year': 2014}
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF92976%27 HTTP/1.1" 200 None
2026-03-29 18:38:54 [auto1.de] INFO: Saving data for FF92976: {'auction_closing_time': 1774885618.0, 'created_time': 1774293527.894637, 'last_price_update_time': 1774809534.768254}
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF92976') HTTP/1.1" 204 0
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV74864%27 HTTP/1.1" 200 None
2026-03-29 18:38:54 [auto1.de] INFO: Scrape type for BV74864: 2
2026-03-29 18:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb87bf96-be5c-55dd-b193-8dc350e0f09d with identifier: BV74864
2026-03-29 18:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb87bf96-be5c-55dd-b193-8dc350e0f09d with scrape type 2
2026-03-29 18:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb87bf96-be5c-55dd-b193-8dc350e0f09d with scrape type 2
2026-03-29 18:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb87bf96-be5c-55dd-b193-8dc350e0f09d, identifier: BV74864
2026-03-29 18:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb87bf96-be5c-55dd-b193-8dc350e0f09d with identifier: BV74864
2026-03-29 18:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb87bf96-be5c-55dd-b193-8dc350e0f09d with identifier: BV74864
2026-03-29 18:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb87bf96-be5c-55dd-b193-8dc350e0f09d with identifier: BV74864 to the API
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:09:27Z',
'fuel_type': 'petrol',
'id': 'eb87bf96-be5c-55dd-b193-8dc350e0f09d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV74864',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 103859,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-28',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV74864%27 HTTP/1.1" 200 None
2026-03-29 18:38:55 [auto1.de] INFO: Saving data for BV74864: {'auction_closing_time': 1774883367.0, 'created_time': 1773775791.75517, 'last_price_update_time': 1774809535.203618}
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV74864') HTTP/1.1" 204 0
2026-03-29 18:38:55 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV55682%27 HTTP/1.1" 200 None
2026-03-29 18:38:55 [auto1.de] INFO: Scrape type for CV55682: 0
2026-03-29 18:38:55 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72377%27 HTTP/1.1" 200 None
2026-03-29 18:38:55 [auto1.de] INFO: Scrape type for MR72377: 0
2026-03-29 18:38:55 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-29 18:38:55 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ91984%27 HTTP/1.1" 200 None
2026-03-29 18:38:55 [auto1.de] INFO: Scrape type for RZ91984: 0
2026-03-29 18:38:55 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU32018%27 HTTP/1.1" 200 None
2026-03-29 18:38:55 [auto1.de] INFO: Scrape type for JU32018: 2
2026-03-29 18:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ed47db1-f512-5c50-9234-d86cf36b1d04 with identifier: JU32018
2026-03-29 18:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ed47db1-f512-5c50-9234-d86cf36b1d04 with scrape type 2
2026-03-29 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ed47db1-f512-5c50-9234-d86cf36b1d04 with scrape type 2
2026-03-29 18:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ed47db1-f512-5c50-9234-d86cf36b1d04, identifier: JU32018
2026-03-29 18:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ed47db1-f512-5c50-9234-d86cf36b1d04 with identifier: JU32018
2026-03-29 18:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ed47db1-f512-5c50-9234-d86cf36b1d04 with identifier: JU32018
2026-03-29 18:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ed47db1-f512-5c50-9234-d86cf36b1d04 with identifier: JU32018 to the API
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:41:05Z',
'fuel_type': 'petrol',
'id': '6ed47db1-f512-5c50-9234-d86cf36b1d04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU32018',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 83426,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-08',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU32018%27 HTTP/1.1" 200 None
2026-03-29 18:38:55 [auto1.de] INFO: Saving data for JU32018: {'auction_closing_time': 1774885265.0, 'created_time': 1773468069.220246, 'last_price_update_time': 1774809535.670288}
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU32018') HTTP/1.1" 204 0
2026-03-29 18:38:55 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-29 18:38:55 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-29 18:38:55 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS77004%27 HTTP/1.1" 200 None
2026-03-29 18:38:55 [auto1.de] INFO: Scrape type for RS77004: 0
2026-03-29 18:38:55 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-29 18:38:55 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ91980%27 HTTP/1.1" 200 None
2026-03-29 18:38:55 [auto1.de] INFO: Scrape type for FJ91980: 0
2026-03-29 18:38:55 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN30919%27 HTTP/1.1" 200 None
2026-03-29 18:38:55 [auto1.de] INFO: Scrape type for BN30919: 2
2026-03-29 18:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with identifier: BN30919
2026-03-29 18:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with scrape type 2
2026-03-29 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with scrape type 2
2026-03-29 18:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62e4f9f8-8432-506d-bea7-8fe86bb0cc68, identifier: BN30919
2026-03-29 18:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with identifier: BN30919
2026-03-29 18:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with identifier: BN30919
2026-03-29 18:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with identifier: BN30919 to the API
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:45:12Z',
'fuel_type': 'diesel',
'id': '62e4f9f8-8432-506d-bea7-8fe86bb0cc68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN30919',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Arteon Shooting Brake',
'odometer': 75199,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-09',
'seller_name': None,
'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN30919%27 HTTP/1.1" 200 None
2026-03-29 18:38:56 [auto1.de] INFO: Saving data for BN30919: {'auction_closing_time': 1774885512.0, 'created_time': 1774294623.900487, 'last_price_update_time': 1774809536.231878}
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN30919') HTTP/1.1" 204 0
2026-03-29 18:38:56 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:56 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-29 18:38:56 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36326%27 HTTP/1.1" 200 None
2026-03-29 18:38:56 [auto1.de] INFO: Scrape type for GS36326: 2
2026-03-29 18:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aa3dfa2-760d-5565-9835-4eb8359113a9 with identifier: GS36326
2026-03-29 18:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aa3dfa2-760d-5565-9835-4eb8359113a9 with scrape type 2
2026-03-29 18:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7aa3dfa2-760d-5565-9835-4eb8359113a9 with scrape type 2
2026-03-29 18:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7aa3dfa2-760d-5565-9835-4eb8359113a9, identifier: GS36326
2026-03-29 18:38:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7aa3dfa2-760d-5565-9835-4eb8359113a9 with identifier: GS36326
2026-03-29 18:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7aa3dfa2-760d-5565-9835-4eb8359113a9 with identifier: GS36326
2026-03-29 18:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7aa3dfa2-760d-5565-9835-4eb8359113a9 with identifier: GS36326 to the API
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:17:32Z',
'fuel_type': 'petrol',
'id': '7aa3dfa2-760d-5565-9835-4eb8359113a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS36326',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 67479,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-17',
'seller_name': None,
'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex',
'transmission': 'manual',
'trim': 'Innovation ecoFlex',
'year': 2015}
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36326%27 HTTP/1.1" 200 None
2026-03-29 18:38:56 [auto1.de] INFO: Saving data for GS36326: {'auction_closing_time': 1774883852.0, 'created_time': 1774608304.55713, 'last_price_update_time': 1774809536.67569}
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS36326') HTTP/1.1" 204 0
2026-03-29 18:38:56 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV33488%27 HTTP/1.1" 200 None
2026-03-29 18:38:56 [auto1.de] INFO: Scrape type for TV33488: 2
2026-03-29 18:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c55d8f96-f863-590e-b3ff-f7c76999b31e with identifier: TV33488
2026-03-29 18:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c55d8f96-f863-590e-b3ff-f7c76999b31e with scrape type 2
2026-03-29 18:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c55d8f96-f863-590e-b3ff-f7c76999b31e with scrape type 2
2026-03-29 18:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c55d8f96-f863-590e-b3ff-f7c76999b31e, identifier: TV33488
2026-03-29 18:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c55d8f96-f863-590e-b3ff-f7c76999b31e with identifier: TV33488
2026-03-29 18:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c55d8f96-f863-590e-b3ff-f7c76999b31e with identifier: TV33488
2026-03-29 18:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c55d8f96-f863-590e-b3ff-f7c76999b31e with identifier: TV33488 to the API
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:17:51Z',
'fuel_type': 'petrol',
'id': 'c55d8f96-f863-590e-b3ff-f7c76999b31e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV33488',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 141355,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-22',
'seller_name': None,
'title': 'Renault Megane 1.6 Dynamique',
'transmission': 'automatic',
'trim': 'Dynamique',
'year': 2006}
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV33488%27 HTTP/1.1" 200 None
2026-03-29 18:38:57 [auto1.de] INFO: Saving data for TV33488: {'auction_closing_time': 1774883871.0, 'created_time': 1773830599.773748, 'last_price_update_time': 1774809537.067589}
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV33488') HTTP/1.1" 204 0
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF38507%27 HTTP/1.1" 200 None
2026-03-29 18:38:57 [auto1.de] INFO: Scrape type for DF38507: 2
2026-03-29 18:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with identifier: DF38507
2026-03-29 18:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with scrape type 2
2026-03-29 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with scrape type 2
2026-03-29 18:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799, identifier: DF38507
2026-03-29 18:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with identifier: DF38507
2026-03-29 18:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with identifier: DF38507
2026-03-29 18:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with identifier: DF38507 to the API
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:06:41Z',
'fuel_type': 'petrol',
'id': '60c9b00d-ce8a-59ae-aa80-3bbe06e03799',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF38507',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 40183,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-21',
'seller_name': None,
'title': 'Kia Sportage 1.6 TGDI GT Line 4WD',
'transmission': 'automatic',
'trim': 'GT Line 4WD',
'year': 2016}
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF38507%27 HTTP/1.1" 200 None
2026-03-29 18:38:57 [auto1.de] INFO: Saving data for DF38507: {'auction_closing_time': 1774883201.0, 'created_time': 1774607754.534934, 'last_price_update_time': 1774809537.493602}
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF38507') HTTP/1.1" 204 0
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN50743%27 HTTP/1.1" 200 None
2026-03-29 18:38:57 [auto1.de] INFO: Scrape type for BN50743: 0
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD55088%27 HTTP/1.1" 200 None
2026-03-29 18:38:57 [auto1.de] INFO: Scrape type for FD55088: 2
2026-03-29 18:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with identifier: FD55088
2026-03-29 18:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with scrape type 2
2026-03-29 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with scrape type 2
2026-03-29 18:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cae73e79-fd7c-582c-b87e-cd4fdbb01de2, identifier: FD55088
2026-03-29 18:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with identifier: FD55088
2026-03-29 18:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with identifier: FD55088
2026-03-29 18:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with identifier: FD55088 to the API
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:34:23Z',
'fuel_type': 'petrol',
'id': 'cae73e79-fd7c-582c-b87e-cd4fdbb01de2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD55088',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 238568,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-04-07',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 320 T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2004}
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD55088%27 HTTP/1.1" 200 None
2026-03-29 18:38:58 [auto1.de] INFO: Saving data for FD55088: {'auction_closing_time': 1774884863.0, 'created_time': 1774349944.992767, 'last_price_update_time': 1774809538.070781}
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD55088') HTTP/1.1" 204 0
2026-03-29 18:38:58 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD02189%27 HTTP/1.1" 200 None
2026-03-29 18:38:58 [auto1.de] INFO: Scrape type for ZD02189: 2
2026-03-29 18:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with identifier: ZD02189
2026-03-29 18:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with scrape type 2
2026-03-29 18:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with scrape type 2
2026-03-29 18:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3ed0bce-6b83-5d8d-a4f3-318f90615c49, identifier: ZD02189
2026-03-29 18:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with identifier: ZD02189
2026-03-29 18:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with identifier: ZD02189
2026-03-29 18:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with identifier: ZD02189 to the API
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 129,
'expiration_date': '2026-03-30T15:39:38Z',
'fuel_type': 'petrol',
'id': 'e3ed0bce-6b83-5d8d-a4f3-318f90615c49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD02189',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4 S-Cross',
'odometer': 181219,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-22',
'seller_name': None,
'title': 'Suzuki SX4 S-Cross 1.4 BoosterJet Mild-Hybrid Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2014}
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD02189%27 HTTP/1.1" 200 None
2026-03-29 18:38:58 [auto1.de] INFO: Saving data for ZD02189: {'auction_closing_time': 1774885178.0, 'created_time': 1773305352.015686, 'last_price_update_time': 1774809538.528411}
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD02189') HTTP/1.1" 204 0
2026-03-29 18:38:58 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX76692%27 HTTP/1.1" 200 None
2026-03-29 18:38:58 [auto1.de] INFO: Scrape type for XX76692: 0
2026-03-29 18:38:58 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ47682%27 HTTP/1.1" 200 None
2026-03-29 18:38:58 [auto1.de] INFO: Scrape type for SJ47682: 2
2026-03-29 18:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cdcedef-5cb5-5033-b85e-1f59ee763109 with identifier: SJ47682
2026-03-29 18:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cdcedef-5cb5-5033-b85e-1f59ee763109 with scrape type 2
2026-03-29 18:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cdcedef-5cb5-5033-b85e-1f59ee763109 with scrape type 2
2026-03-29 18:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cdcedef-5cb5-5033-b85e-1f59ee763109, identifier: SJ47682
2026-03-29 18:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cdcedef-5cb5-5033-b85e-1f59ee763109 with identifier: SJ47682
2026-03-29 18:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cdcedef-5cb5-5033-b85e-1f59ee763109 with identifier: SJ47682
2026-03-29 18:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cdcedef-5cb5-5033-b85e-1f59ee763109 with identifier: SJ47682 to the API
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:15:00Z',
'fuel_type': 'petrol',
'id': '8cdcedef-5cb5-5033-b85e-1f59ee763109',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ47682',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 185657,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-26',
'seller_name': None,
'title': 'Ford Focus 1.6 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2009}
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ47682%27 HTTP/1.1" 200 None
2026-03-29 18:38:58 [auto1.de] INFO: Saving data for SJ47682: {'auction_closing_time': 1774883700.0, 'created_time': 1774349522.08966, 'last_price_update_time': 1774809538.944688}
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ47682') HTTP/1.1" 204 0
2026-03-29 18:38:58 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-29 18:38:58 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG28709%27 HTTP/1.1" 200 None
2026-03-29 18:38:58 [auto1.de] INFO: Scrape type for CG28709: 0
2026-03-29 18:38:58 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT24059%27 HTTP/1.1" 200 None
2026-03-29 18:38:58 [auto1.de] INFO: Scrape type for JT24059: 2
2026-03-29 18:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5072d91-16ee-5e15-8133-27911ccc2976 with identifier: JT24059
2026-03-29 18:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5072d91-16ee-5e15-8133-27911ccc2976 with scrape type 2
2026-03-29 18:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5072d91-16ee-5e15-8133-27911ccc2976 with scrape type 2
2026-03-29 18:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5072d91-16ee-5e15-8133-27911ccc2976, identifier: JT24059
2026-03-29 18:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5072d91-16ee-5e15-8133-27911ccc2976 with identifier: JT24059
2026-03-29 18:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5072d91-16ee-5e15-8133-27911ccc2976 with identifier: JT24059
2026-03-29 18:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5072d91-16ee-5e15-8133-27911ccc2976 with identifier: JT24059 to the API
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:24:06Z',
'fuel_type': 'diesel',
'id': 'a5072d91-16ee-5e15-8133-27911ccc2976',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT24059',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 137543,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-27',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Champions Edition',
'transmission': 'manual',
'trim': 'Champions Edition',
'year': 2012}
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT24059%27 HTTP/1.1" 200 None
2026-03-29 18:38:59 [auto1.de] INFO: Saving data for JT24059: {'auction_closing_time': 1774884246.0, 'created_time': 1774521162.417672, 'last_price_update_time': 1774809539.82949}
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT24059') HTTP/1.1" 204 0
2026-03-29 18:38:59 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96119%27 HTTP/1.1" 200 None
2026-03-29 18:38:59 [auto1.de] INFO: Scrape type for CW96119: 2
2026-03-29 18:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66d0a061-043a-5bef-af38-b3a308bb1e86 with identifier: CW96119
2026-03-29 18:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66d0a061-043a-5bef-af38-b3a308bb1e86 with scrape type 2
2026-03-29 18:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66d0a061-043a-5bef-af38-b3a308bb1e86 with scrape type 2
2026-03-29 18:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66d0a061-043a-5bef-af38-b3a308bb1e86, identifier: CW96119
2026-03-29 18:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66d0a061-043a-5bef-af38-b3a308bb1e86 with identifier: CW96119
2026-03-29 18:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66d0a061-043a-5bef-af38-b3a308bb1e86 with identifier: CW96119
2026-03-29 18:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66d0a061-043a-5bef-af38-b3a308bb1e86 with identifier: CW96119 to the API
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:41:51Z',
'fuel_type': 'petrol',
'id': '66d0a061-043a-5bef-af38-b3a308bb1e86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW96119',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 124543,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-09',
'seller_name': None,
'title': 'Hyundai i30 1.4 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2013}
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96119%27 HTTP/1.1" 200 None
2026-03-29 18:39:00 [auto1.de] INFO: Saving data for CW96119: {'auction_closing_time': 1774885311.0, 'created_time': 1773860967.140001, 'last_price_update_time': 1774809540.401803}
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW96119') HTTP/1.1" 204 0
2026-03-29 18:39:00 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41202%27 HTTP/1.1" 200 None
2026-03-29 18:39:00 [auto1.de] INFO: Scrape type for JJ41202: 0
2026-03-29 18:39:00 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-29 18:39:00 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-29 18:39:00 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP08748%27 HTTP/1.1" 200 None
2026-03-29 18:39:00 [auto1.de] INFO: Scrape type for RP08748: 0
2026-03-29 18:39:00 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-29 18:39:00 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-29 18:39:00 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-29 18:39:00 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29418%27 HTTP/1.1" 200 None
2026-03-29 18:39:00 [auto1.de] INFO: Scrape type for AU29418: 2
2026-03-29 18:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with identifier: AU29418
2026-03-29 18:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with scrape type 2
2026-03-29 18:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with scrape type 2
2026-03-29 18:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd, identifier: AU29418
2026-03-29 18:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with identifier: AU29418
2026-03-29 18:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with identifier: AU29418
2026-03-29 18:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with identifier: AU29418 to the API
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 281,
'expiration_date': '2026-03-30T15:12:55Z',
'fuel_type': 'petrol',
'id': '2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU29418',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 18673,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-18',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid T 4Matic AMG Line',
'transmission': 'automatic',
'trim': 'T 4Matic AMG Line',
'year': 2023}
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29418%27 HTTP/1.1" 200 None
2026-03-29 18:39:00 [auto1.de] INFO: Saving data for AU29418: {'auction_closing_time': 1774883575.0, 'created_time': 1774293951.753626, 'last_price_update_time': 1774809540.962411}
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU29418') HTTP/1.1" 204 0
2026-03-29 18:39:00 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK51417%27 HTTP/1.1" 200 None
2026-03-29 18:39:00 [auto1.de] INFO: Scrape type for TK51417: 0
2026-03-29 18:39:00 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78915%27 HTTP/1.1" 200 None
2026-03-29 18:39:01 [auto1.de] INFO: Scrape type for VH78915: 2
2026-03-29 18:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5658db65-2ce8-5768-bd29-6f92465e336d with identifier: VH78915
2026-03-29 18:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5658db65-2ce8-5768-bd29-6f92465e336d with scrape type 2
2026-03-29 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5658db65-2ce8-5768-bd29-6f92465e336d with scrape type 2
2026-03-29 18:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5658db65-2ce8-5768-bd29-6f92465e336d, identifier: VH78915
2026-03-29 18:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5658db65-2ce8-5768-bd29-6f92465e336d with identifier: VH78915
2026-03-29 18:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5658db65-2ce8-5768-bd29-6f92465e336d with identifier: VH78915
2026-03-29 18:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5658db65-2ce8-5768-bd29-6f92465e336d with identifier: VH78915 to the API
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:42:56Z',
'fuel_type': 'diesel',
'id': '5658db65-2ce8-5768-bd29-6f92465e336d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH78915',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 327011,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-28',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Team 4Motion',
'transmission': 'automatic',
'trim': 'Team 4Motion',
'year': 2010}
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78915%27 HTTP/1.1" 200 None
2026-03-29 18:39:01 [auto1.de] INFO: Saving data for VH78915: {'auction_closing_time': 1774885376.0, 'created_time': 1774522410.208154, 'last_price_update_time': 1774809541.825275}
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH78915') HTTP/1.1" 204 0
2026-03-29 18:39:01 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:01 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC13471%27 HTTP/1.1" 200 None
2026-03-29 18:39:01 [auto1.de] INFO: Scrape type for WC13471: 0
2026-03-29 18:39:01 [auto1.de] INFO: Found listing with ID: CL03732
2026-03-29 18:39:01 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-29 18:39:01 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL51386%27 HTTP/1.1" 200 None
2026-03-29 18:39:01 [auto1.de] INFO: Scrape type for AL51386: 2
2026-03-29 18:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 693c97e2-ba08-537b-9fac-d5f53d4e4fca with identifier: AL51386
2026-03-29 18:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 693c97e2-ba08-537b-9fac-d5f53d4e4fca with scrape type 2
2026-03-29 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 693c97e2-ba08-537b-9fac-d5f53d4e4fca with scrape type 2
2026-03-29 18:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 693c97e2-ba08-537b-9fac-d5f53d4e4fca, identifier: AL51386
2026-03-29 18:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 693c97e2-ba08-537b-9fac-d5f53d4e4fca with identifier: AL51386
2026-03-29 18:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 693c97e2-ba08-537b-9fac-d5f53d4e4fca with identifier: AL51386
2026-03-29 18:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 693c97e2-ba08-537b-9fac-d5f53d4e4fca with identifier: AL51386 to the API
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:32:54Z',
'fuel_type': 'diesel',
'id': '693c97e2-ba08-537b-9fac-d5f53d4e4fca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL51386',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 109660,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-31',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2019}
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL51386%27 HTTP/1.1" 200 None
2026-03-29 18:39:02 [auto1.de] INFO: Saving data for AL51386: {'auction_closing_time': 1774884774.0, 'created_time': 1773688491.508294, 'last_price_update_time': 1774809542.403568}
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL51386') HTTP/1.1" 204 0
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL88784%27 HTTP/1.1" 200 None
2026-03-29 18:39:02 [auto1.de] INFO: Scrape type for LL88784: 2
2026-03-29 18:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with identifier: LL88784
2026-03-29 18:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with scrape type 2
2026-03-29 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with scrape type 2
2026-03-29 18:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bb58457-c95d-57d1-9ec3-bdc02cd1834b, identifier: LL88784
2026-03-29 18:39:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78527%27 HTTP/1.1" 200 None
2026-03-29 18:39:02 [auto1.de] INFO: Scrape type for WG78527: 0
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR96483%27 HTTP/1.1" 200 None
2026-03-29 18:39:02 [auto1.de] INFO: Scrape type for BR96483: 0
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD98482%27 HTTP/1.1" 200 None
2026-03-29 18:39:02 [auto1.de] INFO: Scrape type for JD98482: 2
2026-03-29 18:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27728961-ee35-5b47-b9a9-e274e913174d with identifier: JD98482
2026-03-29 18:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27728961-ee35-5b47-b9a9-e274e913174d with scrape type 2
2026-03-29 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27728961-ee35-5b47-b9a9-e274e913174d with scrape type 2
2026-03-29 18:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27728961-ee35-5b47-b9a9-e274e913174d, identifier: JD98482
2026-03-29 18:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with identifier: LL88784
2026-03-29 18:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with identifier: LL88784
2026-03-29 18:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with identifier: LL88784 to the API
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:10:57Z',
'fuel_type': 'diesel',
'id': '2bb58457-c95d-57d1-9ec3-bdc02cd1834b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL88784',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 140622,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-06',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 CDI T Elegance',
'transmission': 'automatic',
'trim': 'T Elegance',
'year': 2011}
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL88784%27 HTTP/1.1" 200 None
2026-03-29 18:39:03 [auto1.de] INFO: Saving data for LL88784: {'auction_closing_time': 1774883457.0, 'created_time': 1773304838.315517, 'last_price_update_time': 1774809543.016177}
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL88784') HTTP/1.1" 204 0
2026-03-29 18:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27728961-ee35-5b47-b9a9-e274e913174d with identifier: JD98482
2026-03-29 18:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27728961-ee35-5b47-b9a9-e274e913174d with identifier: JD98482
2026-03-29 18:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27728961-ee35-5b47-b9a9-e274e913174d with identifier: JD98482 to the API
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:19:10Z',
'fuel_type': 'diesel',
'id': '27728961-ee35-5b47-b9a9-e274e913174d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD98482',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 171552,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-14',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2013}
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD98482%27 HTTP/1.1" 200 None
2026-03-29 18:39:03 [auto1.de] INFO: Saving data for JD98482: {'auction_closing_time': 1774883950.0, 'created_time': 1774636308.556865, 'last_price_update_time': 1774809543.401381}
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD98482') HTTP/1.1" 204 0
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW77024%27 HTTP/1.1" 200 None
2026-03-29 18:39:03 [auto1.de] INFO: Scrape type for NW77024: 0
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE44500%27 HTTP/1.1" 200 None
2026-03-29 18:39:03 [auto1.de] INFO: Scrape type for VE44500: 2
2026-03-29 18:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with identifier: VE44500
2026-03-29 18:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with scrape type 2
2026-03-29 18:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with scrape type 2
2026-03-29 18:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a, identifier: VE44500
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-29 18:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with identifier: VE44500
2026-03-29 18:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with identifier: VE44500
2026-03-29 18:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with identifier: VE44500 to the API
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:39:52Z',
'fuel_type': 'petrol',
'id': '3de96f9d-f83e-52e8-a07b-8dd38e2cb28a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE44500',
'listing': 'auction',
'make': 'Opel',
'model': 'Adam',
'odometer': 104180,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-29',
'seller_name': None,
'title': 'Opel Adam 1.4 Turbo S',
'transmission': 'manual',
'trim': 'S',
'year': 2018}
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE44500%27 HTTP/1.1" 200 None
2026-03-29 18:39:03 [auto1.de] INFO: Saving data for VE44500: {'auction_closing_time': 1774885192.0, 'created_time': 1774468161.16167, 'last_price_update_time': 1774809543.861257}
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE44500') HTTP/1.1" 204 0
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR72053%27 HTTP/1.1" 200 None
2026-03-29 18:39:03 [auto1.de] INFO: Scrape type for NR72053: 2
2026-03-29 18:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dad828b9-221a-5747-9151-5f00fb147548 with identifier: NR72053
2026-03-29 18:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dad828b9-221a-5747-9151-5f00fb147548 with scrape type 2
2026-03-29 18:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dad828b9-221a-5747-9151-5f00fb147548 with scrape type 2
2026-03-29 18:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dad828b9-221a-5747-9151-5f00fb147548, identifier: NR72053
2026-03-29 18:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dad828b9-221a-5747-9151-5f00fb147548 with identifier: NR72053
2026-03-29 18:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dad828b9-221a-5747-9151-5f00fb147548 with identifier: NR72053
2026-03-29 18:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dad828b9-221a-5747-9151-5f00fb147548 with identifier: NR72053 to the API
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'other',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:01:12Z',
'fuel_type': 'diesel',
'id': 'dad828b9-221a-5747-9151-5f00fb147548',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR72053',
'listing': 'auction',
'make': 'Ford',
'model': 'Galaxy',
'odometer': 102775,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-24',
'seller_name': None,
'title': 'Ford Galaxy 2.0 TDCi EcoBlue Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2021}
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR72053%27 HTTP/1.1" 200 None
2026-03-29 18:39:04 [auto1.de] INFO: Saving data for NR72053: {'auction_closing_time': 1774882872.0, 'created_time': 1773304608.75297, 'last_price_update_time': 1774809544.360917}
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR72053') HTTP/1.1" 204 0
2026-03-29 18:39:04 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK68029%27 HTTP/1.1" 200 None
2026-03-29 18:39:04 [auto1.de] INFO: Scrape type for HK68029: 2
2026-03-29 18:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f108aaeb-517f-52f2-8ade-454bd505c4d0 with identifier: HK68029
2026-03-29 18:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f108aaeb-517f-52f2-8ade-454bd505c4d0 with scrape type 2
2026-03-29 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f108aaeb-517f-52f2-8ade-454bd505c4d0 with scrape type 2
2026-03-29 18:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f108aaeb-517f-52f2-8ade-454bd505c4d0, identifier: HK68029
2026-03-29 18:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f108aaeb-517f-52f2-8ade-454bd505c4d0 with identifier: HK68029
2026-03-29 18:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f108aaeb-517f-52f2-8ade-454bd505c4d0 with identifier: HK68029
2026-03-29 18:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f108aaeb-517f-52f2-8ade-454bd505c4d0 with identifier: HK68029 to the API
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:12:21Z',
'fuel_type': 'diesel',
'id': 'f108aaeb-517f-52f2-8ade-454bd505c4d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK68029',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 363136,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-19',
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 320 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2007}
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK68029%27 HTTP/1.1" 200 None
2026-03-29 18:39:04 [auto1.de] INFO: Saving data for HK68029: {'auction_closing_time': 1774883541.0, 'created_time': 1773687853.882407, 'last_price_update_time': 1774809544.830958}
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK68029') HTTP/1.1" 204 0
2026-03-29 18:39:04 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-29 18:39:04 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-29 18:39:04 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-29 18:39:04 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ30709%27 HTTP/1.1" 200 None
2026-03-29 18:39:04 [auto1.de] INFO: Scrape type for GZ30709: 0
2026-03-29 18:39:04 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-29 18:39:04 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP61796%27 HTTP/1.1" 200 None
2026-03-29 18:39:04 [auto1.de] INFO: Scrape type for WP61796: 2
2026-03-29 18:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5fb3c71-baf8-57b0-b50a-36aa058df703 with identifier: WP61796
2026-03-29 18:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5fb3c71-baf8-57b0-b50a-36aa058df703 with scrape type 2
2026-03-29 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5fb3c71-baf8-57b0-b50a-36aa058df703 with scrape type 2
2026-03-29 18:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5fb3c71-baf8-57b0-b50a-36aa058df703, identifier: WP61796
2026-03-29 18:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5fb3c71-baf8-57b0-b50a-36aa058df703 with identifier: WP61796
2026-03-29 18:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5fb3c71-baf8-57b0-b50a-36aa058df703 with identifier: WP61796
2026-03-29 18:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5fb3c71-baf8-57b0-b50a-36aa058df703 with identifier: WP61796 to the API
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:50:16Z',
'fuel_type': 'diesel',
'id': 'e5fb3c71-baf8-57b0-b50a-36aa058df703',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP61796',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 102537,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-06',
'seller_name': None,
'title': 'Porsche Macan S Diesel',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP61796%27 HTTP/1.1" 200 None
2026-03-29 18:39:05 [auto1.de] INFO: Saving data for WP61796: {'auction_closing_time': 1774885816.0, 'created_time': 1774263553.410733, 'last_price_update_time': 1774809545.28788}
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP61796') HTTP/1.1" 204 0
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC82982%27 HTTP/1.1" 200 None
2026-03-29 18:39:05 [auto1.de] INFO: Scrape type for NC82982: 0
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ19342%27 HTTP/1.1" 200 None
2026-03-29 18:39:05 [auto1.de] INFO: Scrape type for VZ19342: 0
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV97095%27 HTTP/1.1" 200 None
2026-03-29 18:39:05 [auto1.de] INFO: Scrape type for PV97095: 0
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB73740%27 HTTP/1.1" 200 None
2026-03-29 18:39:05 [auto1.de] INFO: Scrape type for WB73740: 2
2026-03-29 18:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27ca45c5-ea7d-5329-b358-03aea19176a3 with identifier: WB73740
2026-03-29 18:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27ca45c5-ea7d-5329-b358-03aea19176a3 with scrape type 2
2026-03-29 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27ca45c5-ea7d-5329-b358-03aea19176a3 with scrape type 2
2026-03-29 18:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27ca45c5-ea7d-5329-b358-03aea19176a3, identifier: WB73740
2026-03-29 18:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27ca45c5-ea7d-5329-b358-03aea19176a3 with identifier: WB73740
2026-03-29 18:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27ca45c5-ea7d-5329-b358-03aea19176a3 with identifier: WB73740
2026-03-29 18:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27ca45c5-ea7d-5329-b358-03aea19176a3 with identifier: WB73740 to the API
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:51:37Z',
'fuel_type': 'petrol',
'id': '27ca45c5-ea7d-5329-b358-03aea19176a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB73740',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 79326,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-08',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
'transmission': 'automatic',
'trim': 'Sport 4Motion',
'year': 2018}
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB73740%27 HTTP/1.1" 200 None
2026-03-29 18:39:05 [auto1.de] INFO: Saving data for WB73740: {'auction_closing_time': 1774885897.0, 'created_time': 1773775263.523724, 'last_price_update_time': 1774809545.885019}
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB73740') HTTP/1.1" 204 0
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY92219%27 HTTP/1.1" 200 None
2026-03-29 18:39:05 [auto1.de] INFO: Scrape type for KY92219: 2
2026-03-29 18:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9863d15d-9531-574e-bc4a-c12b19e55ef3 with identifier: KY92219
2026-03-29 18:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9863d15d-9531-574e-bc4a-c12b19e55ef3 with scrape type 2
2026-03-29 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9863d15d-9531-574e-bc4a-c12b19e55ef3 with scrape type 2
2026-03-29 18:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9863d15d-9531-574e-bc4a-c12b19e55ef3, identifier: KY92219
2026-03-29 18:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9863d15d-9531-574e-bc4a-c12b19e55ef3 with identifier: KY92219
2026-03-29 18:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9863d15d-9531-574e-bc4a-c12b19e55ef3 with identifier: KY92219
2026-03-29 18:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9863d15d-9531-574e-bc4a-c12b19e55ef3 with identifier: KY92219 to the API
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:22:19Z',
'fuel_type': 'petrol',
'id': '9863d15d-9531-574e-bc4a-c12b19e55ef3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY92219',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 35554,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-22',
'seller_name': None,
'title': 'Volkswagen Caddy 1.4 TSI Trendline BlueMotion',
'transmission': 'automatic',
'trim': 'Trendline BlueMotion',
'year': 2019}
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY92219%27 HTTP/1.1" 200 None
2026-03-29 18:39:06 [auto1.de] INFO: Saving data for KY92219: {'auction_closing_time': 1774884139.0, 'created_time': 1774521616.321481, 'last_price_update_time': 1774809546.320465}
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY92219') HTTP/1.1" 204 0
2026-03-29 18:39:06 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH57189%27 HTTP/1.1" 200 None
2026-03-29 18:39:06 [auto1.de] INFO: Scrape type for GH57189: 2
2026-03-29 18:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a452c62-5846-5434-b548-48af8e4b2f83 with identifier: GH57189
2026-03-29 18:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a452c62-5846-5434-b548-48af8e4b2f83 with scrape type 2
2026-03-29 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a452c62-5846-5434-b548-48af8e4b2f83 with scrape type 2
2026-03-29 18:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a452c62-5846-5434-b548-48af8e4b2f83, identifier: GH57189
2026-03-29 18:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a452c62-5846-5434-b548-48af8e4b2f83 with identifier: GH57189
2026-03-29 18:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a452c62-5846-5434-b548-48af8e4b2f83 with identifier: GH57189
2026-03-29 18:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a452c62-5846-5434-b548-48af8e4b2f83 with identifier: GH57189 to the API
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:39:37Z',
'fuel_type': 'petrol',
'id': '4a452c62-5846-5434-b548-48af8e4b2f83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH57189',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 132974,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-19',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Black Edition',
'transmission': 'manual',
'trim': 'Black Edition',
'year': 2009}
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH57189%27 HTTP/1.1" 200 None
2026-03-29 18:39:06 [auto1.de] INFO: Saving data for GH57189: {'auction_closing_time': 1774885177.0, 'created_time': 1774608455.447389, 'last_price_update_time': 1774809546.751059}
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH57189') HTTP/1.1" 204 0
2026-03-29 18:39:06 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC01658%27 HTTP/1.1" 200 None
2026-03-29 18:39:06 [auto1.de] INFO: Scrape type for VC01658: 2
2026-03-29 18:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a733c34-9214-5934-a9b0-60e7f16ea3be with identifier: VC01658
2026-03-29 18:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a733c34-9214-5934-a9b0-60e7f16ea3be with scrape type 2
2026-03-29 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a733c34-9214-5934-a9b0-60e7f16ea3be with scrape type 2
2026-03-29 18:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a733c34-9214-5934-a9b0-60e7f16ea3be, identifier: VC01658
2026-03-29 18:39:06 [scrapy.extensions.logstats] INFO: Crawled 97 pages (at 11 pages/min), scraped 713 items (at 108 items/min)
2026-03-29 18:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a733c34-9214-5934-a9b0-60e7f16ea3be with identifier: VC01658
2026-03-29 18:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a733c34-9214-5934-a9b0-60e7f16ea3be with identifier: VC01658
2026-03-29 18:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a733c34-9214-5934-a9b0-60e7f16ea3be with identifier: VC01658 to the API
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 355,
'expiration_date': '2026-03-30T15:16:42Z',
'fuel_type': 'petrol',
'id': '1a733c34-9214-5934-a9b0-60e7f16ea3be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC01658',
'listing': 'auction',
'make': 'Audi',
'model': 'S5',
'odometer': 85108,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-10',
'seller_name': None,
'title': 'Audi S5 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2018}
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC01658%27 HTTP/1.1" 200 None
2026-03-29 18:39:07 [auto1.de] INFO: Saving data for VC01658: {'auction_closing_time': 1774883802.0, 'created_time': 1773137756.452149, 'last_price_update_time': 1774809547.245079}
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC01658') HTTP/1.1" 204 0
2026-03-29 18:39:07 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-29 18:39:07 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU27688%27 HTTP/1.1" 200 None
2026-03-29 18:39:07 [auto1.de] INFO: Scrape type for AU27688: 2
2026-03-29 18:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5f1c75a-867e-5e74-b483-de1381e56f8e with identifier: AU27688
2026-03-29 18:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5f1c75a-867e-5e74-b483-de1381e56f8e with scrape type 2
2026-03-29 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5f1c75a-867e-5e74-b483-de1381e56f8e with scrape type 2
2026-03-29 18:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5f1c75a-867e-5e74-b483-de1381e56f8e, identifier: AU27688
2026-03-29 18:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5f1c75a-867e-5e74-b483-de1381e56f8e with identifier: AU27688
2026-03-29 18:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5f1c75a-867e-5e74-b483-de1381e56f8e with identifier: AU27688
2026-03-29 18:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5f1c75a-867e-5e74-b483-de1381e56f8e with identifier: AU27688 to the API
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:01:21Z',
'fuel_type': 'petrol',
'id': 'f5f1c75a-867e-5e74-b483-de1381e56f8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU27688',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 228569,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-20',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2013}
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU27688%27 HTTP/1.1" 200 None
2026-03-29 18:39:07 [auto1.de] INFO: Saving data for AU27688: {'auction_closing_time': 1774882881.0, 'created_time': 1774607545.020947, 'last_price_update_time': 1774809547.735703}
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU27688') HTTP/1.1" 204 0
2026-03-29 18:39:07 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN93789%27 HTTP/1.1" 200 None
2026-03-29 18:39:07 [auto1.de] INFO: Scrape type for EN93789: 2
2026-03-29 18:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3905ed05-11c2-527f-92eb-5ce8b7dce161 with identifier: EN93789
2026-03-29 18:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3905ed05-11c2-527f-92eb-5ce8b7dce161 with scrape type 2
2026-03-29 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3905ed05-11c2-527f-92eb-5ce8b7dce161 with scrape type 2
2026-03-29 18:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3905ed05-11c2-527f-92eb-5ce8b7dce161, identifier: EN93789
2026-03-29 18:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3905ed05-11c2-527f-92eb-5ce8b7dce161 with identifier: EN93789
2026-03-29 18:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3905ed05-11c2-527f-92eb-5ce8b7dce161 with identifier: EN93789
2026-03-29 18:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3905ed05-11c2-527f-92eb-5ce8b7dce161 with identifier: EN93789 to the API
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:06:18Z',
'fuel_type': 'petrol',
'id': '3905ed05-11c2-527f-92eb-5ce8b7dce161',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN93789',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 80303,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-26',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid T 4Matic AMG Line',
'transmission': 'automatic',
'trim': 'T 4Matic AMG Line',
'year': 2020}
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN93789%27 HTTP/1.1" 200 None
2026-03-29 18:39:08 [auto1.de] INFO: Saving data for EN93789: {'auction_closing_time': 1774883178.0, 'created_time': 1774521412.805229, 'last_price_update_time': 1774809548.152971}
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN93789') HTTP/1.1" 204 0
2026-03-29 18:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:08 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK20534%27 HTTP/1.1" 200 None
2026-03-29 18:39:08 [auto1.de] INFO: Scrape type for HK20534: 2
2026-03-29 18:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15c9de2b-0765-5940-928a-adab1f8b7fb2 with identifier: HK20534
2026-03-29 18:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c9de2b-0765-5940-928a-adab1f8b7fb2 with scrape type 2
2026-03-29 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15c9de2b-0765-5940-928a-adab1f8b7fb2 with scrape type 2
2026-03-29 18:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15c9de2b-0765-5940-928a-adab1f8b7fb2, identifier: HK20534
2026-03-29 18:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15c9de2b-0765-5940-928a-adab1f8b7fb2 with identifier: HK20534
2026-03-29 18:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15c9de2b-0765-5940-928a-adab1f8b7fb2 with identifier: HK20534
2026-03-29 18:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15c9de2b-0765-5940-928a-adab1f8b7fb2 with identifier: HK20534 to the API
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:30:52Z',
'fuel_type': 'diesel',
'id': '15c9de2b-0765-5940-928a-adab1f8b7fb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK20534',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 328635,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-20',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 CDI T 4Matic BlueTEC Avantgarde',
'transmission': 'automatic',
'trim': 'T 4Matic BlueTEC Avantgarde',
'year': 2014}
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK20534%27 HTTP/1.1" 200 None
2026-03-29 18:39:08 [auto1.de] INFO: Saving data for HK20534: {'auction_closing_time': 1774884652.0, 'created_time': 1774607747.831296, 'last_price_update_time': 1774809548.671092}
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK20534') HTTP/1.1" 204 0
2026-03-29 18:39:08 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-29 18:39:08 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-29 18:39:08 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-29 18:39:08 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA00536%27 HTTP/1.1" 200 None
2026-03-29 18:39:08 [auto1.de] INFO: Scrape type for UA00536: 0
2026-03-29 18:39:08 [auto1.de] INFO: Found listing with ID: LK12622
2026-03-29 18:39:08 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY52590%27 HTTP/1.1" 200 None
2026-03-29 18:39:08 [auto1.de] INFO: Scrape type for PY52590: 0
2026-03-29 18:39:08 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB78660%27 HTTP/1.1" 200 None
2026-03-29 18:39:08 [auto1.de] INFO: Scrape type for BB78660: 2
2026-03-29 18:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e40d57ec-fbca-580d-9c31-ad1640750801 with identifier: BB78660
2026-03-29 18:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e40d57ec-fbca-580d-9c31-ad1640750801 with scrape type 2
2026-03-29 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e40d57ec-fbca-580d-9c31-ad1640750801 with scrape type 2
2026-03-29 18:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e40d57ec-fbca-580d-9c31-ad1640750801, identifier: BB78660
2026-03-29 18:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e40d57ec-fbca-580d-9c31-ad1640750801 with identifier: BB78660
2026-03-29 18:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e40d57ec-fbca-580d-9c31-ad1640750801 with identifier: BB78660
2026-03-29 18:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e40d57ec-fbca-580d-9c31-ad1640750801 with identifier: BB78660 to the API
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:04:00Z',
'fuel_type': 'diesel',
'id': 'e40d57ec-fbca-580d-9c31-ad1640750801',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB78660',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 212114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-28',
'seller_name': None,
'title': 'BMW 3er 318d',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB78660%27 HTTP/1.1" 200 None
2026-03-29 18:39:09 [auto1.de] INFO: Saving data for BB78660: {'auction_closing_time': 1774883040.0, 'created_time': 1774521913.686059, 'last_price_update_time': 1774809549.135872}
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB78660') HTTP/1.1" 204 0
2026-03-29 18:39:09 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:09 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA95886%27 HTTP/1.1" 200 None
2026-03-29 18:39:09 [auto1.de] INFO: Scrape type for YA95886: 2
2026-03-29 18:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with identifier: YA95886
2026-03-29 18:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with scrape type 2
2026-03-29 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with scrape type 2
2026-03-29 18:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4d7653f-d6ac-501d-a1c2-cbb49ea863a5, identifier: YA95886
2026-03-29 18:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with identifier: YA95886
2026-03-29 18:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with identifier: YA95886
2026-03-29 18:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with identifier: YA95886 to the API
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:29:38Z',
'fuel_type': 'petrol',
'id': 'c4d7653f-d6ac-501d-a1c2-cbb49ea863a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA95886',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 64764,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-03-16',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
'transmission': 'automatic',
'trim': '',
'year': 2005}
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA95886%27 HTTP/1.1" 200 None
2026-03-29 18:39:09 [auto1.de] INFO: Saving data for YA95886: {'auction_closing_time': 1774884578.0, 'created_time': 1773687306.071139, 'last_price_update_time': 1774809549.592526}
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA95886') HTTP/1.1" 204 0
2026-03-29 18:39:09 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC31038%27 HTTP/1.1" 200 None
2026-03-29 18:39:09 [auto1.de] INFO: Scrape type for WC31038: 0
2026-03-29 18:39:09 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB73354%27 HTTP/1.1" 200 None
2026-03-29 18:39:09 [auto1.de] INFO: Scrape type for AB73354: 2
2026-03-29 18:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 978f3f63-a1b6-58e1-9375-8b891293ec15 with identifier: AB73354
2026-03-29 18:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 978f3f63-a1b6-58e1-9375-8b891293ec15 with scrape type 2
2026-03-29 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 978f3f63-a1b6-58e1-9375-8b891293ec15 with scrape type 2
2026-03-29 18:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 978f3f63-a1b6-58e1-9375-8b891293ec15, identifier: AB73354
2026-03-29 18:39:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:09 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-29 18:39:09 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72332%27 HTTP/1.1" 200 None
2026-03-29 18:39:09 [auto1.de] INFO: Scrape type for TL72332: 2
2026-03-29 18:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 299484e0-51e9-531b-a440-71ba80474df8 with identifier: TL72332
2026-03-29 18:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 299484e0-51e9-531b-a440-71ba80474df8 with scrape type 2
2026-03-29 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 299484e0-51e9-531b-a440-71ba80474df8 with scrape type 2
2026-03-29 18:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 299484e0-51e9-531b-a440-71ba80474df8, identifier: TL72332
2026-03-29 18:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 978f3f63-a1b6-58e1-9375-8b891293ec15 with identifier: AB73354
2026-03-29 18:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 978f3f63-a1b6-58e1-9375-8b891293ec15 with identifier: AB73354
2026-03-29 18:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 978f3f63-a1b6-58e1-9375-8b891293ec15 with identifier: AB73354 to the API
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 199,
'expiration_date': '2026-03-30T15:44:40Z',
'fuel_type': 'diesel',
'id': '978f3f63-a1b6-58e1-9375-8b891293ec15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB73354',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 114500,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-17',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six 4Motion',
'transmission': 'automatic',
'trim': 'Generation Six 4Motion',
'year': 2020}
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB73354%27 HTTP/1.1" 200 None
2026-03-29 18:39:10 [auto1.de] INFO: Saving data for AB73354: {'auction_closing_time': 1774885480.0, 'created_time': 1773427360.584378, 'last_price_update_time': 1774809550.193511}
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB73354') HTTP/1.1" 204 0
2026-03-29 18:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 299484e0-51e9-531b-a440-71ba80474df8 with identifier: TL72332
2026-03-29 18:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 299484e0-51e9-531b-a440-71ba80474df8 with identifier: TL72332
2026-03-29 18:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 299484e0-51e9-531b-a440-71ba80474df8 with identifier: TL72332 to the API
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:47:43Z',
'fuel_type': 'diesel',
'id': '299484e0-51e9-531b-a440-71ba80474df8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL72332',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 116584,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-07',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 Blue-HDi Seduction',
'transmission': 'manual',
'trim': 'Seduction',
'year': 2015}
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72332%27 HTTP/1.1" 200 None
2026-03-29 18:39:10 [auto1.de] INFO: Saving data for TL72332: {'auction_closing_time': 1774885663.0, 'created_time': 1773427538.032892, 'last_price_update_time': 1774809550.575664}
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL72332') HTTP/1.1" 204 0
2026-03-29 18:39:10 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20945%27 HTTP/1.1" 200 None
2026-03-29 18:39:10 [auto1.de] INFO: Scrape type for ZN20945: 2
2026-03-29 18:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74b58880-2cf5-519a-8be9-4ab63dd4f4d8 with identifier: ZN20945
2026-03-29 18:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74b58880-2cf5-519a-8be9-4ab63dd4f4d8 with scrape type 2
2026-03-29 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74b58880-2cf5-519a-8be9-4ab63dd4f4d8 with scrape type 2
2026-03-29 18:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74b58880-2cf5-519a-8be9-4ab63dd4f4d8, identifier: ZN20945
2026-03-29 18:39:10 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-29 18:39:10 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR89143%27 HTTP/1.1" 200 None
2026-03-29 18:39:10 [auto1.de] INFO: Scrape type for HR89143: 0
2026-03-29 18:39:10 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC37503%27 HTTP/1.1" 200 None
2026-03-29 18:39:10 [auto1.de] INFO: Scrape type for LC37503: 2
2026-03-29 18:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with identifier: LC37503
2026-03-29 18:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with scrape type 2
2026-03-29 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with scrape type 2
2026-03-29 18:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f, identifier: LC37503
2026-03-29 18:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74b58880-2cf5-519a-8be9-4ab63dd4f4d8 with identifier: ZN20945
2026-03-29 18:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74b58880-2cf5-519a-8be9-4ab63dd4f4d8 with identifier: ZN20945
2026-03-29 18:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74b58880-2cf5-519a-8be9-4ab63dd4f4d8 with identifier: ZN20945 to the API
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 55,
'expiration_date': '2026-03-30T15:13:47Z',
'fuel_type': 'diesel',
'id': '74b58880-2cf5-519a-8be9-4ab63dd4f4d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN20945',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 128955,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-12',
'seller_name': None,
'title': 'Smart fortwo 0.8 CDI Passion',
'transmission': 'automatic',
'trim': 'Passion',
'year': 2012}
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20945%27 HTTP/1.1" 200 None
2026-03-29 18:39:11 [auto1.de] INFO: Saving data for ZN20945: {'auction_closing_time': 1774883627.0, 'created_time': 1774521431.049115, 'last_price_update_time': 1774809551.099566}
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN20945') HTTP/1.1" 204 0
2026-03-29 18:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with identifier: LC37503
2026-03-29 18:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with identifier: LC37503
2026-03-29 18:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with identifier: LC37503 to the API
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 58,
'expiration_date': '2026-03-30T15:12:00Z',
'fuel_type': 'petrol',
'id': 'fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC37503',
'listing': 'auction',
'make': 'Daihatsu',
'model': 'Cuore',
'odometer': 118916,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-08-27',
'seller_name': None,
'title': 'Daihatsu Cuore 1.0 Blu',
'transmission': 'automatic',
'trim': 'Blu',
'year': 2006}
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC37503%27 HTTP/1.1" 200 None
2026-03-29 18:39:11 [auto1.de] INFO: Saving data for LC37503: {'auction_closing_time': 1774883520.0, 'created_time': 1774089252.766841, 'last_price_update_time': 1774809551.491797}
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC37503') HTTP/1.1" 204 0
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78140%27 HTTP/1.1" 200 None
2026-03-29 18:39:11 [auto1.de] INFO: Scrape type for ZT78140: 2
2026-03-29 18:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140
2026-03-29 18:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6617bcf8-7d0d-58bc-af17-a622fc461013 with scrape type 2
2026-03-29 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6617bcf8-7d0d-58bc-af17-a622fc461013 with scrape type 2
2026-03-29 18:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6617bcf8-7d0d-58bc-af17-a622fc461013, identifier: ZT78140
2026-03-29 18:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140
2026-03-29 18:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140
2026-03-29 18:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140 to the API
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-30T15:03:16Z',
'fuel_type': 'petrol',
'id': '6617bcf8-7d0d-58bc-af17-a622fc461013',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT78140',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 62430,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-26',
'seller_name': None,
'title': 'Renault Megane 1.2 TCe Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2017}
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78140%27 HTTP/1.1" 200 None
2026-03-29 18:39:11 [auto1.de] INFO: Saving data for ZT78140: {'auction_closing_time': 1774882996.0, 'created_time': 1774032500.474021, 'last_price_update_time': 1774809551.932962}
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT78140') HTTP/1.1" 204 0
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68578%27 HTTP/1.1" 200 None
2026-03-29 18:39:11 [auto1.de] INFO: Scrape type for DW68578: 0
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW16724%27 HTTP/1.1" 200 None
2026-03-29 18:39:11 [auto1.de] INFO: Scrape type for WW16724: 2
2026-03-29 18:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f94af90a-ffcb-5a07-9fd7-27f562bbce1b with identifier: WW16724
2026-03-29 18:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f94af90a-ffcb-5a07-9fd7-27f562bbce1b with scrape type 2
2026-03-29 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f94af90a-ffcb-5a07-9fd7-27f562bbce1b with scrape type 2
2026-03-29 18:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f94af90a-ffcb-5a07-9fd7-27f562bbce1b, identifier: WW16724
2026-03-29 18:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f94af90a-ffcb-5a07-9fd7-27f562bbce1b with identifier: WW16724
2026-03-29 18:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f94af90a-ffcb-5a07-9fd7-27f562bbce1b with identifier: WW16724
2026-03-29 18:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f94af90a-ffcb-5a07-9fd7-27f562bbce1b with identifier: WW16724 to the API
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:56:52Z',
'fuel_type': 'diesel',
'id': 'f94af90a-ffcb-5a07-9fd7-27f562bbce1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW16724',
'listing': 'auction',
'make': 'Renault',
'model': 'Koleos',
'odometer': 199436,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-27',
'seller_name': None,
'title': 'Renault Koleos 2.0 dCi Energy Initiale Paris 4x4',
'transmission': 'automatic',
'trim': 'Initiale Paris 4x4',
'year': 2017}
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW16724%27 HTTP/1.1" 200 None
2026-03-29 18:39:12 [auto1.de] INFO: Saving data for WW16724: {'auction_closing_time': 1774886212.0, 'created_time': 1773819038.868884, 'last_price_update_time': 1774809552.409806}
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW16724') HTTP/1.1" 204 0
2026-03-29 18:39:12 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-29 18:39:12 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT86021%27 HTTP/1.1" 200 None
2026-03-29 18:39:12 [auto1.de] INFO: Scrape type for JT86021: 2
2026-03-29 18:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e47556c7-d40c-5641-926a-3f9b6726671f with identifier: JT86021
2026-03-29 18:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e47556c7-d40c-5641-926a-3f9b6726671f with scrape type 2
2026-03-29 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e47556c7-d40c-5641-926a-3f9b6726671f with scrape type 2
2026-03-29 18:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e47556c7-d40c-5641-926a-3f9b6726671f, identifier: JT86021
2026-03-29 18:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e47556c7-d40c-5641-926a-3f9b6726671f with identifier: JT86021
2026-03-29 18:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e47556c7-d40c-5641-926a-3f9b6726671f with identifier: JT86021
2026-03-29 18:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e47556c7-d40c-5641-926a-3f9b6726671f with identifier: JT86021 to the API
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:33:33Z',
'fuel_type': 'diesel',
'id': 'e47556c7-d40c-5641-926a-3f9b6726671f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT86021',
'listing': 'auction',
'make': 'Jaguar',
'model': 'XF',
'odometer': 166403,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-28',
'seller_name': None,
'title': 'Jaguar XF 30d Prestige',
'transmission': 'automatic',
'trim': 'Prestige',
'year': 2016}
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT86021%27 HTTP/1.1" 200 None
2026-03-29 18:39:12 [auto1.de] INFO: Saving data for JT86021: {'auction_closing_time': 1774884813.0, 'created_time': 1773302801.647291, 'last_price_update_time': 1774809552.856785}
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT86021') HTTP/1.1" 204 0
2026-03-29 18:39:12 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-29 18:39:12 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY70814%27 HTTP/1.1" 200 None
2026-03-29 18:39:12 [auto1.de] INFO: Scrape type for MY70814: 2
2026-03-29 18:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcfc2730-553f-563d-88b9-6f24fed4ed19 with identifier: MY70814
2026-03-29 18:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcfc2730-553f-563d-88b9-6f24fed4ed19 with scrape type 2
2026-03-29 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcfc2730-553f-563d-88b9-6f24fed4ed19 with scrape type 2
2026-03-29 18:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcfc2730-553f-563d-88b9-6f24fed4ed19, identifier: MY70814
2026-03-29 18:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcfc2730-553f-563d-88b9-6f24fed4ed19 with identifier: MY70814
2026-03-29 18:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcfc2730-553f-563d-88b9-6f24fed4ed19 with identifier: MY70814
2026-03-29 18:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcfc2730-553f-563d-88b9-6f24fed4ed19 with identifier: MY70814 to the API
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:04:16Z',
'fuel_type': 'diesel',
'id': 'fcfc2730-553f-563d-88b9-6f24fed4ed19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY70814',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 273796,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-19',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 250 CDI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2010}
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY70814%27 HTTP/1.1" 200 None
2026-03-29 18:39:13 [auto1.de] INFO: Saving data for MY70814: {'auction_closing_time': 1774883056.0, 'created_time': 1773138690.716435, 'last_price_update_time': 1774809553.284434}
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY70814') HTTP/1.1" 204 0
2026-03-29 18:39:13 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-29 18:39:13 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK50983%27 HTTP/1.1" 200 None
2026-03-29 18:39:13 [auto1.de] INFO: Scrape type for LK50983: 2
2026-03-29 18:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dcdbe8d-42d1-5742-855a-630cd76717f4 with identifier: LK50983
2026-03-29 18:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dcdbe8d-42d1-5742-855a-630cd76717f4 with scrape type 2
2026-03-29 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dcdbe8d-42d1-5742-855a-630cd76717f4 with scrape type 2
2026-03-29 18:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8dcdbe8d-42d1-5742-855a-630cd76717f4, identifier: LK50983
2026-03-29 18:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8dcdbe8d-42d1-5742-855a-630cd76717f4 with identifier: LK50983
2026-03-29 18:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8dcdbe8d-42d1-5742-855a-630cd76717f4 with identifier: LK50983
2026-03-29 18:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8dcdbe8d-42d1-5742-855a-630cd76717f4 with identifier: LK50983 to the API
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:09:54Z',
'fuel_type': 'diesel',
'id': '8dcdbe8d-42d1-5742-855a-630cd76717f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK50983',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 296859,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-05-02',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.5 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2004}
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK50983%27 HTTP/1.1" 200 None
2026-03-29 18:39:13 [auto1.de] INFO: Saving data for LK50983: {'auction_closing_time': 1774883394.0, 'created_time': 1774291163.056043, 'last_price_update_time': 1774809553.815119}
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK50983') HTTP/1.1" 204 0
2026-03-29 18:39:13 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-29 18:39:13 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-29 18:39:13 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ38214%27 HTTP/1.1" 200 None
2026-03-29 18:39:13 [auto1.de] INFO: Scrape type for PJ38214: 2
2026-03-29 18:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with identifier: PJ38214
2026-03-29 18:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with scrape type 2
2026-03-29 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with scrape type 2
2026-03-29 18:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 340ab20a-3fa7-56b0-9fac-6293aaedc5ad, identifier: PJ38214
2026-03-29 18:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with identifier: PJ38214
2026-03-29 18:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with identifier: PJ38214
2026-03-29 18:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with identifier: PJ38214 to the API
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:48:31Z',
'fuel_type': 'petrol',
'id': '340ab20a-3fa7-56b0-9fac-6293aaedc5ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ38214',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 38851,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-04',
'seller_name': None,
'title': 'BMW 1er M135i xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2023}
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ38214%27 HTTP/1.1" 200 None
2026-03-29 18:39:14 [auto1.de] INFO: Saving data for PJ38214: {'auction_closing_time': 1774885711.0, 'created_time': 1773917486.400141, 'last_price_update_time': 1774809554.308738}
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ38214') HTTP/1.1" 204 0
2026-03-29 18:39:14 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-29 18:39:14 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-29 18:39:14 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE52893%27 HTTP/1.1" 200 None
2026-03-29 18:39:14 [auto1.de] INFO: Scrape type for SE52893: 2
2026-03-29 18:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fb4b2bf-cac9-5128-a161-31ade47b4930 with identifier: SE52893
2026-03-29 18:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fb4b2bf-cac9-5128-a161-31ade47b4930 with scrape type 2
2026-03-29 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fb4b2bf-cac9-5128-a161-31ade47b4930 with scrape type 2
2026-03-29 18:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fb4b2bf-cac9-5128-a161-31ade47b4930, identifier: SE52893
2026-03-29 18:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fb4b2bf-cac9-5128-a161-31ade47b4930 with identifier: SE52893
2026-03-29 18:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fb4b2bf-cac9-5128-a161-31ade47b4930 with identifier: SE52893
2026-03-29 18:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fb4b2bf-cac9-5128-a161-31ade47b4930 with identifier: SE52893 to the API
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:00:37Z',
'fuel_type': 'petrol',
'id': '3fb4b2bf-cac9-5128-a161-31ade47b4930',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE52893',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 152075,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-20',
'seller_name': None,
'title': 'Dacia Duster 1.3 TCe Celebration',
'transmission': 'manual',
'trim': 'Celebration',
'year': 2020}
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE52893%27 HTTP/1.1" 200 None
2026-03-29 18:39:14 [auto1.de] INFO: Saving data for SE52893: {'auction_closing_time': 1774882837.0, 'created_time': 1774607769.152934, 'last_price_update_time': 1774809554.781918}
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE52893') HTTP/1.1" 204 0
2026-03-29 18:39:14 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-29 18:39:14 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92301%27 HTTP/1.1" 200 None
2026-03-29 18:39:14 [auto1.de] INFO: Scrape type for BD92301: 0
2026-03-29 18:39:14 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-29 18:39:14 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX48260%27 HTTP/1.1" 200 None
2026-03-29 18:39:14 [auto1.de] INFO: Scrape type for TX48260: 2
2026-03-29 18:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87f618ff-196d-5724-85d8-948e6e3a204d with identifier: TX48260
2026-03-29 18:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f618ff-196d-5724-85d8-948e6e3a204d with scrape type 2
2026-03-29 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87f618ff-196d-5724-85d8-948e6e3a204d with scrape type 2
2026-03-29 18:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87f618ff-196d-5724-85d8-948e6e3a204d, identifier: TX48260
2026-03-29 18:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87f618ff-196d-5724-85d8-948e6e3a204d with identifier: TX48260
2026-03-29 18:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87f618ff-196d-5724-85d8-948e6e3a204d with identifier: TX48260
2026-03-29 18:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87f618ff-196d-5724-85d8-948e6e3a204d with identifier: TX48260 to the API
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:45:17Z',
'fuel_type': 'petrol',
'id': '87f618ff-196d-5724-85d8-948e6e3a204d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX48260',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 93317,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-30',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Tour',
'transmission': 'manual',
'trim': 'Tour',
'year': 2007}
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX48260%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Saving data for TX48260: {'auction_closing_time': 1774885517.0, 'created_time': 1773775665.179603, 'last_price_update_time': 1774809555.246154}
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX48260') HTTP/1.1" 204 0
2026-03-29 18:39:15 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL90122%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Scrape type for TL90122: 0
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: GW69862
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61437%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Scrape type for KZ61437: 0
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14470%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Scrape type for ZG14470: 0
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ19127%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Scrape type for WZ19127: 0
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH16330%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Scrape type for PH16330: 2
2026-03-29 18:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a985feb1-4c09-50c0-8023-e8f1c7394cd4 with identifier: PH16330
2026-03-29 18:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a985feb1-4c09-50c0-8023-e8f1c7394cd4 with scrape type 2
2026-03-29 18:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a985feb1-4c09-50c0-8023-e8f1c7394cd4 with scrape type 2
2026-03-29 18:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a985feb1-4c09-50c0-8023-e8f1c7394cd4, identifier: PH16330
2026-03-29 18:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a985feb1-4c09-50c0-8023-e8f1c7394cd4 with identifier: PH16330
2026-03-29 18:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a985feb1-4c09-50c0-8023-e8f1c7394cd4 with identifier: PH16330
2026-03-29 18:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a985feb1-4c09-50c0-8023-e8f1c7394cd4 with identifier: PH16330 to the API
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:01:59Z',
'fuel_type': 'diesel',
'id': 'a985feb1-4c09-50c0-8023-e8f1c7394cd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH16330',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 123118,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-23',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Elegance 4Motion',
'transmission': 'automatic',
'trim': 'Elegance 4Motion',
'year': 2021}
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH16330%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Saving data for PH16330: {'auction_closing_time': 1774882919.0, 'created_time': 1773304371.014517, 'last_price_update_time': 1774809555.992034}
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH16330') HTTP/1.1" 204 0
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT44889%27 HTTP/1.1" 200 None
2026-03-29 18:39:16 [auto1.de] INFO: Scrape type for CT44889: 2
2026-03-29 18:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5beb08c1-c19d-5744-818a-a4472e905285 with identifier: CT44889
2026-03-29 18:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5beb08c1-c19d-5744-818a-a4472e905285 with scrape type 2
2026-03-29 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5beb08c1-c19d-5744-818a-a4472e905285 with scrape type 2
2026-03-29 18:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5beb08c1-c19d-5744-818a-a4472e905285, identifier: CT44889
2026-03-29 18:39:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-29 18:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5beb08c1-c19d-5744-818a-a4472e905285 with identifier: CT44889
2026-03-29 18:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5beb08c1-c19d-5744-818a-a4472e905285 with identifier: CT44889
2026-03-29 18:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5beb08c1-c19d-5744-818a-a4472e905285 with identifier: CT44889 to the API
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:18:52Z',
'fuel_type': 'petrol',
'id': '5beb08c1-c19d-5744-818a-a4472e905285',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT44889',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 149363,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-14',
'seller_name': None,
'title': 'Volkswagen Golf V 1.4 TSI United',
'transmission': 'manual',
'trim': 'United',
'year': 2008}
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT44889%27 HTTP/1.1" 200 None
2026-03-29 18:39:16 [auto1.de] INFO: Saving data for CT44889: {'auction_closing_time': 1774883932.0, 'created_time': 1774032781.380397, 'last_price_update_time': 1774809556.545679}
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT44889') HTTP/1.1" 204 0
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19137%27 HTTP/1.1" 200 None
2026-03-29 18:39:16 [auto1.de] INFO: Scrape type for KL19137: 0
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV62833%27 HTTP/1.1" 200 None
2026-03-29 18:39:16 [auto1.de] INFO: Scrape type for AV62833: 0
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA63751%27 HTTP/1.1" 200 None
2026-03-29 18:39:16 [auto1.de] INFO: Scrape type for PA63751: 0
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC63229%27 HTTP/1.1" 200 None
2026-03-29 18:39:16 [auto1.de] INFO: Scrape type for LC63229: 0
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN72199%27 HTTP/1.1" 200 None
2026-03-29 18:39:16 [auto1.de] INFO: Scrape type for SN72199: 0
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63339%27 HTTP/1.1" 200 None
2026-03-29 18:39:16 [auto1.de] INFO: Scrape type for WC63339: 2
2026-03-29 18:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d797935d-6332-5bd1-b9eb-fdcde16c6582 with identifier: WC63339
2026-03-29 18:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d797935d-6332-5bd1-b9eb-fdcde16c6582 with scrape type 2
2026-03-29 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d797935d-6332-5bd1-b9eb-fdcde16c6582 with scrape type 2
2026-03-29 18:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d797935d-6332-5bd1-b9eb-fdcde16c6582, identifier: WC63339
2026-03-29 18:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d797935d-6332-5bd1-b9eb-fdcde16c6582 with identifier: WC63339
2026-03-29 18:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d797935d-6332-5bd1-b9eb-fdcde16c6582 with identifier: WC63339
2026-03-29 18:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d797935d-6332-5bd1-b9eb-fdcde16c6582 with identifier: WC63339 to the API
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:21:13Z',
'fuel_type': 'petrol',
'id': 'd797935d-6332-5bd1-b9eb-fdcde16c6582',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC63339',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 78431,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-20',
'seller_name': None,
'title': 'BMW 3er 318i Sport Line',
'transmission': 'manual',
'trim': 'Sport Line',
'year': 2016}
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63339%27 HTTP/1.1" 200 None
2026-03-29 18:39:17 [auto1.de] INFO: Saving data for WC63339: {'auction_closing_time': 1774884073.0, 'created_time': 1774607795.166984, 'last_price_update_time': 1774809557.043536}
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC63339') HTTP/1.1" 204 0
2026-03-29 18:39:17 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ03455%27 HTTP/1.1" 200 None
2026-03-29 18:39:17 [auto1.de] INFO: Scrape type for YJ03455: 2
2026-03-29 18:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddda53d1-a6df-580f-9fb1-60583f8d6c67 with identifier: YJ03455
2026-03-29 18:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddda53d1-a6df-580f-9fb1-60583f8d6c67 with scrape type 2
2026-03-29 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddda53d1-a6df-580f-9fb1-60583f8d6c67 with scrape type 2
2026-03-29 18:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ddda53d1-a6df-580f-9fb1-60583f8d6c67, identifier: YJ03455
2026-03-29 18:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ddda53d1-a6df-580f-9fb1-60583f8d6c67 with identifier: YJ03455
2026-03-29 18:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ddda53d1-a6df-580f-9fb1-60583f8d6c67 with identifier: YJ03455
2026-03-29 18:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ddda53d1-a6df-580f-9fb1-60583f8d6c67 with identifier: YJ03455 to the API
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:48:29Z',
'fuel_type': 'petrol',
'id': 'ddda53d1-a6df-580f-9fb1-60583f8d6c67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ03455',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 85676,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-31',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.0 TSI',
'transmission': 'manual',
'trim': '',
'year': 2020}
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ03455%27 HTTP/1.1" 200 None
2026-03-29 18:39:17 [auto1.de] INFO: Saving data for YJ03455: {'auction_closing_time': 1774885709.0, 'created_time': 1774510245.467084, 'last_price_update_time': 1774809557.588901}
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ03455') HTTP/1.1" 204 0
2026-03-29 18:39:17 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-29 18:39:17 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-29 18:39:17 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-29 18:39:17 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-29 18:39:17 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ40966%27 HTTP/1.1" 200 None
2026-03-29 18:39:17 [auto1.de] INFO: Scrape type for PZ40966: 2
2026-03-29 18:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with identifier: PZ40966
2026-03-29 18:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with scrape type 2
2026-03-29 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with scrape type 2
2026-03-29 18:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754, identifier: PZ40966
2026-03-29 18:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with identifier: PZ40966
2026-03-29 18:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with identifier: PZ40966
2026-03-29 18:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with identifier: PZ40966 to the API
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:22:37Z',
'fuel_type': 'diesel',
'id': '6fad701c-4d70-5dbe-86d4-b3e0b5f9c754',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ40966',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 315753,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-16',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2012}
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ40966%27 HTTP/1.1" 200 None
2026-03-29 18:39:18 [auto1.de] INFO: Saving data for PZ40966: {'auction_closing_time': 1774884157.0, 'created_time': 1774264778.726008, 'last_price_update_time': 1774809558.031962}
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ40966') HTTP/1.1" 204 0
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46012%27 HTTP/1.1" 200 None
2026-03-29 18:39:18 [auto1.de] INFO: Scrape type for MV46012: 2
2026-03-29 18:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with identifier: MV46012
2026-03-29 18:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with scrape type 2
2026-03-29 18:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with scrape type 2
2026-03-29 18:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1427a2ab-7707-55ac-a7ab-d428e7d19a39, identifier: MV46012
2026-03-29 18:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with identifier: MV46012
2026-03-29 18:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with identifier: MV46012
2026-03-29 18:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with identifier: MV46012 to the API
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:01:45Z',
'fuel_type': 'petrol',
'id': '1427a2ab-7707-55ac-a7ab-d428e7d19a39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV46012',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 30528,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-07',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT United',
'transmission': 'manual',
'trim': 'United',
'year': 2020}
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46012%27 HTTP/1.1" 200 None
2026-03-29 18:39:18 [auto1.de] INFO: Saving data for MV46012: {'auction_closing_time': 1774882905.0, 'created_time': 1774002392.822044, 'last_price_update_time': 1774809558.462372}
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV46012') HTTP/1.1" 204 0
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX17219%27 HTTP/1.1" 200 None
2026-03-29 18:39:18 [auto1.de] INFO: Scrape type for MX17219: 0
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ74150%27 HTTP/1.1" 200 None
2026-03-29 18:39:18 [auto1.de] INFO: Scrape type for EJ74150: 0
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN47860%27 HTTP/1.1" 200 None
2026-03-29 18:39:18 [auto1.de] INFO: Scrape type for SN47860: 0
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF11378%27 HTTP/1.1" 200 None
2026-03-29 18:39:18 [auto1.de] INFO: Scrape type for FF11378: 0
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ32658%27 HTTP/1.1" 200 None
2026-03-29 18:39:18 [auto1.de] INFO: Scrape type for HZ32658: 0
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG52240%27 HTTP/1.1" 200 None
2026-03-29 18:39:18 [auto1.de] INFO: Scrape type for NG52240: 0
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD58874%27 HTTP/1.1" 200 None
2026-03-29 18:39:18 [auto1.de] INFO: Scrape type for KD58874: 0
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF56073%27 HTTP/1.1" 200 None
2026-03-29 18:39:18 [auto1.de] INFO: Scrape type for WF56073: 2
2026-03-29 18:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4675084-2021-5fec-8f4e-a6aeb256b079 with identifier: WF56073
2026-03-29 18:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4675084-2021-5fec-8f4e-a6aeb256b079 with scrape type 2
2026-03-29 18:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4675084-2021-5fec-8f4e-a6aeb256b079 with scrape type 2
2026-03-29 18:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4675084-2021-5fec-8f4e-a6aeb256b079, identifier: WF56073
2026-03-29 18:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4675084-2021-5fec-8f4e-a6aeb256b079 with identifier: WF56073
2026-03-29 18:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4675084-2021-5fec-8f4e-a6aeb256b079 with identifier: WF56073
2026-03-29 18:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4675084-2021-5fec-8f4e-a6aeb256b079 with identifier: WF56073 to the API
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:39:11Z',
'fuel_type': 'diesel',
'id': 'c4675084-2021-5fec-8f4e-a6aeb256b079',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF56073',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 123162,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-26',
'seller_name': None,
'title': 'Audi A6 2.7 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2010}
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF56073%27 HTTP/1.1" 200 None
2026-03-29 18:39:19 [auto1.de] INFO: Saving data for WF56073: {'auction_closing_time': 1774885151.0, 'created_time': 1774521689.329279, 'last_price_update_time': 1774809559.015827}
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF56073') HTTP/1.1" 204 0
2026-03-29 18:39:19 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG53147%27 HTTP/1.1" 200 None
2026-03-29 18:39:19 [auto1.de] INFO: Scrape type for SG53147: 0
2026-03-29 18:39:19 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-29 18:39:19 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-29 18:39:19 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31302%27 HTTP/1.1" 200 None
2026-03-29 18:39:19 [auto1.de] INFO: Scrape type for WF31302: 2
2026-03-29 18:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3a1c824-b6c6-5859-ad64-3897eff2c470 with identifier: WF31302
2026-03-29 18:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3a1c824-b6c6-5859-ad64-3897eff2c470 with scrape type 2
2026-03-29 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3a1c824-b6c6-5859-ad64-3897eff2c470 with scrape type 2
2026-03-29 18:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3a1c824-b6c6-5859-ad64-3897eff2c470, identifier: WF31302
2026-03-29 18:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3a1c824-b6c6-5859-ad64-3897eff2c470 with identifier: WF31302
2026-03-29 18:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3a1c824-b6c6-5859-ad64-3897eff2c470 with identifier: WF31302
2026-03-29 18:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3a1c824-b6c6-5859-ad64-3897eff2c470 with identifier: WF31302 to the API
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 195,
'expiration_date': '2026-03-30T15:19:04Z',
'fuel_type': 'diesel',
'id': 'e3a1c824-b6c6-5859-ad64-3897eff2c470',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF31302',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 128456,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-28',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2016}
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31302%27 HTTP/1.1" 200 None
2026-03-29 18:39:19 [auto1.de] INFO: Saving data for WF31302: {'auction_closing_time': 1774883944.0, 'created_time': 1773859696.763573, 'last_price_update_time': 1774809559.586177}
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF31302') HTTP/1.1" 204 0
2026-03-29 18:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:20 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:20 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-29 18:39:20 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW19119%27 HTTP/1.1" 200 None
2026-03-29 18:39:20 [auto1.de] INFO: Scrape type for VW19119: 0
2026-03-29 18:39:20 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-29 18:39:20 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP68218%27 HTTP/1.1" 200 None
2026-03-29 18:39:20 [auto1.de] INFO: Scrape type for GP68218: 2
2026-03-29 18:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab566936-0092-5264-b538-249375a3f4db with identifier: GP68218
2026-03-29 18:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab566936-0092-5264-b538-249375a3f4db with scrape type 2
2026-03-29 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab566936-0092-5264-b538-249375a3f4db with scrape type 2
2026-03-29 18:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab566936-0092-5264-b538-249375a3f4db, identifier: GP68218
2026-03-29 18:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab566936-0092-5264-b538-249375a3f4db with identifier: GP68218
2026-03-29 18:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab566936-0092-5264-b538-249375a3f4db with identifier: GP68218
2026-03-29 18:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab566936-0092-5264-b538-249375a3f4db with identifier: GP68218 to the API
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:18:09Z',
'fuel_type': 'petrol',
'id': 'ab566936-0092-5264-b538-249375a3f4db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP68218',
'listing': 'auction',
'make': 'Kia',
'model': 'Soul',
'odometer': 164483,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-07',
'seller_name': None,
'title': 'Kia Soul 1.6 GDI Spirit',
'transmission': 'manual',
'trim': 'Spirit',
'year': 2012}
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP68218%27 HTTP/1.1" 200 None
2026-03-29 18:39:20 [auto1.de] INFO: Saving data for GP68218: {'auction_closing_time': 1774883889.0, 'created_time': 1774608319.837379, 'last_price_update_time': 1774809560.923572}
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP68218') HTTP/1.1" 204 0
2026-03-29 18:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:20 [auto1.de] INFO: Found listing with ID: TP00598
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP00598%27 HTTP/1.1" 200 None
2026-03-29 18:39:20 [auto1.de] INFO: Scrape type for TP00598: 2
2026-03-29 18:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48f7e4cc-2684-5ce4-8c88-d32217415838 with identifier: TP00598
2026-03-29 18:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48f7e4cc-2684-5ce4-8c88-d32217415838 with scrape type 2
2026-03-29 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48f7e4cc-2684-5ce4-8c88-d32217415838 with scrape type 2
2026-03-29 18:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48f7e4cc-2684-5ce4-8c88-d32217415838, identifier: TP00598
2026-03-29 18:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48f7e4cc-2684-5ce4-8c88-d32217415838 with identifier: TP00598
2026-03-29 18:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48f7e4cc-2684-5ce4-8c88-d32217415838 with identifier: TP00598
2026-03-29 18:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48f7e4cc-2684-5ce4-8c88-d32217415838 with identifier: TP00598 to the API
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:23:16Z',
'fuel_type': 'diesel',
'id': '48f7e4cc-2684-5ce4-8c88-d32217415838',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP00598',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 109258,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-31',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Cup BlueMotion',
'transmission': 'manual',
'trim': 'Cup BlueMotion',
'year': 2015}
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP00598%27 HTTP/1.1" 200 None
2026-03-29 18:39:21 [auto1.de] INFO: Saving data for TP00598: {'auction_closing_time': 1774884196.0, 'created_time': 1774349451.97668, 'last_price_update_time': 1774809561.384308}
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP00598') HTTP/1.1" 204 0
2026-03-29 18:39:21 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86869%27 HTTP/1.1" 200 None
2026-03-29 18:39:21 [auto1.de] INFO: Scrape type for YB86869: 0
2026-03-29 18:39:21 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB50161%27 HTTP/1.1" 200 None
2026-03-29 18:39:21 [auto1.de] INFO: Scrape type for XB50161: 0
2026-03-29 18:39:21 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF34057%27 HTTP/1.1" 200 None
2026-03-29 18:39:21 [auto1.de] INFO: Scrape type for NF34057: 2
2026-03-29 18:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with identifier: NF34057
2026-03-29 18:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with scrape type 2
2026-03-29 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with scrape type 2
2026-03-29 18:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2428d9c9-6af0-539c-9ca4-87e6c0e8a139, identifier: NF34057
2026-03-29 18:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with identifier: NF34057
2026-03-29 18:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with identifier: NF34057
2026-03-29 18:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with identifier: NF34057 to the API
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:29:27Z',
'fuel_type': 'diesel',
'id': '2428d9c9-6af0-539c-9ca4-87e6c0e8a139',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF34057',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 98049,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-23',
'seller_name': None,
'title': 'Mercedes-Benz Vito 110 CDI lang',
'transmission': 'automatic',
'trim': 'lang',
'year': 2013}
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF34057%27 HTTP/1.1" 200 None
2026-03-29 18:39:21 [auto1.de] INFO: Saving data for NF34057: {'auction_closing_time': 1774884567.0, 'created_time': 1773427875.674524, 'last_price_update_time': 1774809561.891258}
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF34057') HTTP/1.1" 204 0
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63476%27 HTTP/1.1" 200 None
2026-03-29 18:39:22 [auto1.de] INFO: Scrape type for LD63476: 0
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY73016%27 HTTP/1.1" 200 None
2026-03-29 18:39:22 [auto1.de] INFO: Scrape type for WY73016: 2
2026-03-29 18:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b55ad151-60f0-5448-8465-7c814cf29433 with identifier: WY73016
2026-03-29 18:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55ad151-60f0-5448-8465-7c814cf29433 with scrape type 2
2026-03-29 18:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b55ad151-60f0-5448-8465-7c814cf29433 with scrape type 2
2026-03-29 18:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b55ad151-60f0-5448-8465-7c814cf29433, identifier: WY73016
2026-03-29 18:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b55ad151-60f0-5448-8465-7c814cf29433 with identifier: WY73016
2026-03-29 18:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b55ad151-60f0-5448-8465-7c814cf29433 with identifier: WY73016
2026-03-29 18:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b55ad151-60f0-5448-8465-7c814cf29433 with identifier: WY73016 to the API
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:55:25Z',
'fuel_type': 'diesel',
'id': 'b55ad151-60f0-5448-8465-7c814cf29433',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY73016',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 228288,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-24',
'seller_name': None,
'title': 'Renault Grand Scenic 1.5 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2010}
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY73016%27 HTTP/1.1" 200 None
2026-03-29 18:39:22 [auto1.de] INFO: Saving data for WY73016: {'auction_closing_time': 1774886125.0, 'created_time': 1774636283.656998, 'last_price_update_time': 1774809562.395838}
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY73016') HTTP/1.1" 204 0
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD44435%27 HTTP/1.1" 200 None
2026-03-29 18:39:22 [auto1.de] INFO: Scrape type for MD44435: 0
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ62576%27 HTTP/1.1" 200 None
2026-03-29 18:39:22 [auto1.de] INFO: Scrape type for XJ62576: 2
2026-03-29 18:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a80eae5e-5aca-57a8-90ad-f7cd28bef639 with identifier: XJ62576
2026-03-29 18:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a80eae5e-5aca-57a8-90ad-f7cd28bef639 with scrape type 2
2026-03-29 18:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a80eae5e-5aca-57a8-90ad-f7cd28bef639 with scrape type 2
2026-03-29 18:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a80eae5e-5aca-57a8-90ad-f7cd28bef639, identifier: XJ62576
2026-03-29 18:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a80eae5e-5aca-57a8-90ad-f7cd28bef639 with identifier: XJ62576
2026-03-29 18:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a80eae5e-5aca-57a8-90ad-f7cd28bef639 with identifier: XJ62576
2026-03-29 18:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a80eae5e-5aca-57a8-90ad-f7cd28bef639 with identifier: XJ62576 to the API
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:11:42Z',
'fuel_type': 'petrol',
'id': 'a80eae5e-5aca-57a8-90ad-f7cd28bef639',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ62576',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 260278,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-25',
'seller_name': None,
'title': 'Volkswagen Touran 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2014}
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ62576%27 HTTP/1.1" 200 None
2026-03-29 18:39:22 [auto1.de] INFO: Saving data for XJ62576: {'auction_closing_time': 1774883502.0, 'created_time': 1774608385.576119, 'last_price_update_time': 1774809562.844207}
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ62576') HTTP/1.1" 204 0
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80862%27 HTTP/1.1" 200 None
2026-03-29 18:39:22 [auto1.de] INFO: Scrape type for EJ80862: 2
2026-03-29 18:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce1b8f8f-310e-5dd9-90ca-39450663815f with identifier: EJ80862
2026-03-29 18:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce1b8f8f-310e-5dd9-90ca-39450663815f with scrape type 2
2026-03-29 18:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce1b8f8f-310e-5dd9-90ca-39450663815f with scrape type 2
2026-03-29 18:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce1b8f8f-310e-5dd9-90ca-39450663815f, identifier: EJ80862
2026-03-29 18:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce1b8f8f-310e-5dd9-90ca-39450663815f with identifier: EJ80862
2026-03-29 18:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce1b8f8f-310e-5dd9-90ca-39450663815f with identifier: EJ80862
2026-03-29 18:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce1b8f8f-310e-5dd9-90ca-39450663815f with identifier: EJ80862 to the API
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:14:03Z',
'fuel_type': 'diesel',
'id': 'ce1b8f8f-310e-5dd9-90ca-39450663815f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ80862',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 60064,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-18',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
'transmission': 'automatic',
'trim': '4Matic Exclusive',
'year': 2016}
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80862%27 HTTP/1.1" 200 None
2026-03-29 18:39:23 [auto1.de] INFO: Saving data for EJ80862: {'auction_closing_time': 1774883643.0, 'created_time': 1773306596.062804, 'last_price_update_time': 1774809563.274907}
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ80862') HTTP/1.1" 204 0
2026-03-29 18:39:23 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL19525%27 HTTP/1.1" 200 None
2026-03-29 18:39:23 [auto1.de] INFO: Scrape type for HL19525: 0
2026-03-29 18:39:23 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV33449%27 HTTP/1.1" 200 None
2026-03-29 18:39:23 [auto1.de] INFO: Scrape type for ZV33449: 2
2026-03-29 18:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae156ef9-371c-5370-bf9d-2c672c632ab4 with identifier: ZV33449
2026-03-29 18:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae156ef9-371c-5370-bf9d-2c672c632ab4 with scrape type 2
2026-03-29 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae156ef9-371c-5370-bf9d-2c672c632ab4 with scrape type 2
2026-03-29 18:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae156ef9-371c-5370-bf9d-2c672c632ab4, identifier: ZV33449
2026-03-29 18:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae156ef9-371c-5370-bf9d-2c672c632ab4 with identifier: ZV33449
2026-03-29 18:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae156ef9-371c-5370-bf9d-2c672c632ab4 with identifier: ZV33449
2026-03-29 18:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae156ef9-371c-5370-bf9d-2c672c632ab4 with identifier: ZV33449 to the API
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:15:15Z',
'fuel_type': 'diesel',
'id': 'ae156ef9-371c-5370-bf9d-2c672c632ab4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV33449',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 230861,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-12',
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 350 CDI 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2010}
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV33449%27 HTTP/1.1" 200 None
2026-03-29 18:39:23 [auto1.de] INFO: Saving data for ZV33449: {'auction_closing_time': 1774883715.0, 'created_time': 1774607835.145952, 'last_price_update_time': 1774809563.769009}
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV33449') HTTP/1.1" 204 0
2026-03-29 18:39:23 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS22515%27 HTTP/1.1" 200 None
2026-03-29 18:39:23 [auto1.de] INFO: Scrape type for BS22515: 0
2026-03-29 18:39:23 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-29 18:39:23 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78766%27 HTTP/1.1" 200 None
2026-03-29 18:39:23 [auto1.de] INFO: Scrape type for FJ78766: 0
2026-03-29 18:39:23 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE64290%27 HTTP/1.1" 200 None
2026-03-29 18:39:23 [auto1.de] INFO: Scrape type for AE64290: 0
2026-03-29 18:39:23 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-29 18:39:23 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-29 18:39:23 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK43362%27 HTTP/1.1" 200 None
2026-03-29 18:39:23 [auto1.de] INFO: Scrape type for GK43362: 2
2026-03-29 18:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0c5ea27-4335-53d3-b302-0cc37e3edbe4 with identifier: GK43362
2026-03-29 18:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0c5ea27-4335-53d3-b302-0cc37e3edbe4 with scrape type 2
2026-03-29 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0c5ea27-4335-53d3-b302-0cc37e3edbe4 with scrape type 2
2026-03-29 18:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0c5ea27-4335-53d3-b302-0cc37e3edbe4, identifier: GK43362
2026-03-29 18:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0c5ea27-4335-53d3-b302-0cc37e3edbe4 with identifier: GK43362
2026-03-29 18:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0c5ea27-4335-53d3-b302-0cc37e3edbe4 with identifier: GK43362
2026-03-29 18:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0c5ea27-4335-53d3-b302-0cc37e3edbe4 with identifier: GK43362 to the API
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:22:04Z',
'fuel_type': 'petrol',
'id': 'f0c5ea27-4335-53d3-b302-0cc37e3edbe4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK43362',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 allstreet',
'odometer': 14702,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-14',
'seller_name': None,
'title': 'Audi A1 allstreet 30 TFSI',
'transmission': 'automatic',
'trim': '',
'year': 2024}
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK43362%27 HTTP/1.1" 200 None
2026-03-29 18:39:24 [auto1.de] INFO: Saving data for GK43362: {'auction_closing_time': 1774884124.0, 'created_time': 1773431711.950617, 'last_price_update_time': 1774809564.264253}
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK43362') HTTP/1.1" 204 0
2026-03-29 18:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ85797%27 HTTP/1.1" 200 None
2026-03-29 18:39:24 [auto1.de] INFO: Scrape type for EZ85797: 0
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL88078%27 HTTP/1.1" 200 None
2026-03-29 18:39:24 [auto1.de] INFO: Scrape type for NL88078: 0
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET35150%27 HTTP/1.1" 200 None
2026-03-29 18:39:24 [auto1.de] INFO: Scrape type for ET35150: 2
2026-03-29 18:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with identifier: ET35150
2026-03-29 18:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with scrape type 2
2026-03-29 18:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with scrape type 2
2026-03-29 18:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1d8ca13-d359-5298-b3a1-bfe5fc64df8e, identifier: ET35150
2026-03-29 18:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with identifier: ET35150
2026-03-29 18:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with identifier: ET35150
2026-03-29 18:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with identifier: ET35150 to the API
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:53:21Z',
'fuel_type': 'diesel',
'id': 'f1d8ca13-d359-5298-b3a1-bfe5fc64df8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET35150',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 213103,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-21',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI BlueMotion',
'transmission': 'manual',
'trim': 'BlueMotion',
'year': 2012}
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET35150%27 HTTP/1.1" 200 None
2026-03-29 18:39:24 [auto1.de] INFO: Saving data for ET35150: {'auction_closing_time': 1774886001.0, 'created_time': 1773306993.706408, 'last_price_update_time': 1774809564.840958}
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET35150') HTTP/1.1" 204 0
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02487%27 HTTP/1.1" 200 None
2026-03-29 18:39:24 [auto1.de] INFO: Scrape type for WS02487: 0
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW19006%27 HTTP/1.1" 200 None
2026-03-29 18:39:24 [auto1.de] INFO: Scrape type for CW19006: 0
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV33173%27 HTTP/1.1" 200 None
2026-03-29 18:39:24 [auto1.de] INFO: Scrape type for NV33173: 2
2026-03-29 18:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c465186e-8268-561e-ad6b-eb0a2371b7e4 with identifier: NV33173
2026-03-29 18:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c465186e-8268-561e-ad6b-eb0a2371b7e4 with scrape type 2
2026-03-29 18:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c465186e-8268-561e-ad6b-eb0a2371b7e4 with scrape type 2
2026-03-29 18:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c465186e-8268-561e-ad6b-eb0a2371b7e4, identifier: NV33173
2026-03-29 18:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c465186e-8268-561e-ad6b-eb0a2371b7e4 with identifier: NV33173
2026-03-29 18:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c465186e-8268-561e-ad6b-eb0a2371b7e4 with identifier: NV33173
2026-03-29 18:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c465186e-8268-561e-ad6b-eb0a2371b7e4 with identifier: NV33173 to the API
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:29:48Z',
'fuel_type': 'petrol',
'id': 'c465186e-8268-561e-ad6b-eb0a2371b7e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV33173',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 106029,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-27',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2017}
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV33173%27 HTTP/1.1" 200 None
2026-03-29 18:39:25 [auto1.de] INFO: Saving data for NV33173: {'auction_closing_time': 1774884588.0, 'created_time': 1773858921.751075, 'last_price_update_time': 1774809565.327825}
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV33173') HTTP/1.1" 204 0
2026-03-29 18:39:25 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:25 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-29 18:39:25 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA55190%27 HTTP/1.1" 200 None
2026-03-29 18:39:25 [auto1.de] INFO: Scrape type for SA55190: 2
2026-03-29 18:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ccec49b-106e-53b5-b1e6-60345b9a4557 with identifier: SA55190
2026-03-29 18:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ccec49b-106e-53b5-b1e6-60345b9a4557 with scrape type 2
2026-03-29 18:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ccec49b-106e-53b5-b1e6-60345b9a4557 with scrape type 2
2026-03-29 18:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ccec49b-106e-53b5-b1e6-60345b9a4557, identifier: SA55190
2026-03-29 18:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ccec49b-106e-53b5-b1e6-60345b9a4557 with identifier: SA55190
2026-03-29 18:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ccec49b-106e-53b5-b1e6-60345b9a4557 with identifier: SA55190
2026-03-29 18:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ccec49b-106e-53b5-b1e6-60345b9a4557 with identifier: SA55190 to the API
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:01:07Z',
'fuel_type': 'petrol',
'id': '8ccec49b-106e-53b5-b1e6-60345b9a4557',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA55190',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 154146,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-31',
'seller_name': None,
'title': 'Opel Corsa 1.4 Active ecoFlex',
'transmission': 'manual',
'trim': 'Active ecoFlex',
'year': 2017}
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA55190%27 HTTP/1.1" 200 None
2026-03-29 18:39:25 [auto1.de] INFO: Saving data for SA55190: {'auction_closing_time': 1774882867.0, 'created_time': 1774293887.370727, 'last_price_update_time': 1774809565.861004}
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA55190') HTTP/1.1" 204 0
2026-03-29 18:39:25 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-29 18:39:25 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-29 18:39:25 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-29 18:39:25 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96299%27 HTTP/1.1" 200 None
2026-03-29 18:39:25 [auto1.de] INFO: Scrape type for PF96299: 2
2026-03-29 18:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbc4fbc3-f0da-5025-92a3-c519958b6b77 with identifier: PF96299
2026-03-29 18:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc4fbc3-f0da-5025-92a3-c519958b6b77 with scrape type 2
2026-03-29 18:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbc4fbc3-f0da-5025-92a3-c519958b6b77 with scrape type 2
2026-03-29 18:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbc4fbc3-f0da-5025-92a3-c519958b6b77, identifier: PF96299
2026-03-29 18:39:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:25 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-29 18:39:25 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-29 18:39:25 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-29 18:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbc4fbc3-f0da-5025-92a3-c519958b6b77 with identifier: PF96299
2026-03-29 18:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbc4fbc3-f0da-5025-92a3-c519958b6b77 with identifier: PF96299
2026-03-29 18:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbc4fbc3-f0da-5025-92a3-c519958b6b77 with identifier: PF96299 to the API
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:42:20Z',
'fuel_type': 'diesel',
'id': 'bbc4fbc3-f0da-5025-92a3-c519958b6b77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF96299',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 245018,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-08',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2013}
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96299%27 HTTP/1.1" 200 None
2026-03-29 18:39:26 [auto1.de] INFO: Saving data for PF96299: {'auction_closing_time': 1774885340.0, 'created_time': 1773860148.160139, 'last_price_update_time': 1774809566.316615}
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF96299') HTTP/1.1" 204 0
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ94089%27 HTTP/1.1" 200 None
2026-03-29 18:39:26 [auto1.de] INFO: Scrape type for EZ94089: 2
2026-03-29 18:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with identifier: EZ94089
2026-03-29 18:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with scrape type 2
2026-03-29 18:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with scrape type 2
2026-03-29 18:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99c0cb98-7ff4-5e36-812b-ef5d45be10ba, identifier: EZ94089
2026-03-29 18:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with identifier: EZ94089
2026-03-29 18:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with identifier: EZ94089
2026-03-29 18:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with identifier: EZ94089 to the API
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:26:19Z',
'fuel_type': 'petrol',
'id': '99c0cb98-7ff4-5e36-812b-ef5d45be10ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ94089',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 103194,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-21',
'seller_name': None,
'title': 'Opel Meriva 1.6 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2010}
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ94089%27 HTTP/1.1" 200 None
2026-03-29 18:39:26 [auto1.de] INFO: Saving data for EZ94089: {'auction_closing_time': 1774884379.0, 'created_time': 1774349363.88541, 'last_price_update_time': 1774809566.782051}
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ94089') HTTP/1.1" 204 0
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX05285%27 HTTP/1.1" 200 None
2026-03-29 18:39:26 [auto1.de] INFO: Scrape type for BX05285: 0
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU16473%27 HTTP/1.1" 200 None
2026-03-29 18:39:26 [auto1.de] INFO: Scrape type for KU16473: 0
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX81073%27 HTTP/1.1" 200 None
2026-03-29 18:39:26 [auto1.de] INFO: Scrape type for JX81073: 2
2026-03-29 18:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71cc290a-52bb-576e-a722-9ce68fede8f9 with identifier: JX81073
2026-03-29 18:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71cc290a-52bb-576e-a722-9ce68fede8f9 with scrape type 2
2026-03-29 18:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71cc290a-52bb-576e-a722-9ce68fede8f9 with scrape type 2
2026-03-29 18:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71cc290a-52bb-576e-a722-9ce68fede8f9, identifier: JX81073
2026-03-29 18:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71cc290a-52bb-576e-a722-9ce68fede8f9 with identifier: JX81073
2026-03-29 18:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71cc290a-52bb-576e-a722-9ce68fede8f9 with identifier: JX81073
2026-03-29 18:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71cc290a-52bb-576e-a722-9ce68fede8f9 with identifier: JX81073 to the API
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:05:49Z',
'fuel_type': 'diesel',
'id': '71cc290a-52bb-576e-a722-9ce68fede8f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX81073',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 361254,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-26',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2011}
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX81073%27 HTTP/1.1" 200 None
2026-03-29 18:39:27 [auto1.de] INFO: Saving data for JX81073: {'auction_closing_time': 1774883149.0, 'created_time': 1774263171.889573, 'last_price_update_time': 1774809567.368892}
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX81073') HTTP/1.1" 204 0
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX40120%27 HTTP/1.1" 200 None
2026-03-29 18:39:27 [auto1.de] INFO: Scrape type for JX40120: 2
2026-03-29 18:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with identifier: JX40120
2026-03-29 18:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with scrape type 2
2026-03-29 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with scrape type 2
2026-03-29 18:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c244ee9-8569-5fc0-b83f-1d9de43a67dc, identifier: JX40120
2026-03-29 18:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with identifier: JX40120
2026-03-29 18:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with identifier: JX40120
2026-03-29 18:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with identifier: JX40120 to the API
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:46:14Z',
'fuel_type': 'petrol',
'id': '0c244ee9-8569-5fc0-b83f-1d9de43a67dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX40120',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 164263,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-15',
'seller_name': None,
'title': 'Renault Twingo 1.2 Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2012}
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX40120%27 HTTP/1.1" 200 None
2026-03-29 18:39:27 [auto1.de] INFO: Saving data for JX40120: {'auction_closing_time': 1774885574.0, 'created_time': 1773776028.889085, 'last_price_update_time': 1774809567.814661}
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX40120') HTTP/1.1" 204 0
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78300%27 HTTP/1.1" 200 None
2026-03-29 18:39:27 [auto1.de] INFO: Scrape type for PL78300: 2
2026-03-29 18:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with identifier: PL78300
2026-03-29 18:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with scrape type 2
2026-03-29 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with scrape type 2
2026-03-29 18:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b682d33-830f-5f43-b6e8-30d2a9a0eaee, identifier: PL78300
2026-03-29 18:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with identifier: PL78300
2026-03-29 18:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with identifier: PL78300
2026-03-29 18:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with identifier: PL78300 to the API
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:31:58Z',
'fuel_type': 'petrol',
'id': '5b682d33-830f-5f43-b6e8-30d2a9a0eaee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL78300',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 182576,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-19',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2010}
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78300%27 HTTP/1.1" 200 None
2026-03-29 18:39:28 [auto1.de] INFO: Saving data for PL78300: {'auction_closing_time': 1774884718.0, 'created_time': 1774262332.314036, 'last_price_update_time': 1774809568.368791}
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL78300') HTTP/1.1" 204 0
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD34962%27 HTTP/1.1" 200 None
2026-03-29 18:39:28 [auto1.de] INFO: Scrape type for KD34962: 0
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES44709%27 HTTP/1.1" 200 None
2026-03-29 18:39:28 [auto1.de] INFO: Scrape type for ES44709: 0
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE69852%27 HTTP/1.1" 200 None
2026-03-29 18:39:28 [auto1.de] INFO: Scrape type for YE69852: 2
2026-03-29 18:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with identifier: YE69852
2026-03-29 18:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with scrape type 2
2026-03-29 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with scrape type 2
2026-03-29 18:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd270fc7-7388-5dbe-b8e0-a314ba978fd3, identifier: YE69852
2026-03-29 18:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with identifier: YE69852
2026-03-29 18:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with identifier: YE69852
2026-03-29 18:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with identifier: YE69852 to the API
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:47:09Z',
'fuel_type': 'diesel',
'id': 'cd270fc7-7388-5dbe-b8e0-a314ba978fd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE69852',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 162044,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-28',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Elegance 4Motion',
'transmission': 'automatic',
'trim': 'Elegance 4Motion',
'year': 2022}
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE69852%27 HTTP/1.1" 200 None
2026-03-29 18:39:28 [auto1.de] INFO: Saving data for YE69852: {'auction_closing_time': 1774885629.0, 'created_time': 1774292323.627707, 'last_price_update_time': 1774809568.833346}
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE69852') HTTP/1.1" 204 0
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59339%27 HTTP/1.1" 200 None
2026-03-29 18:39:28 [auto1.de] INFO: Scrape type for GM59339: 0
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT90816%27 HTTP/1.1" 200 None
2026-03-29 18:39:28 [auto1.de] INFO: Scrape type for PT90816: 2
2026-03-29 18:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with identifier: PT90816
2026-03-29 18:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with scrape type 2
2026-03-29 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with scrape type 2
2026-03-29 18:39:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923, identifier: PT90816
2026-03-29 18:39:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with identifier: PT90816
2026-03-29 18:39:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with identifier: PT90816
2026-03-29 18:39:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with identifier: PT90816 to the API
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:58:24Z',
'fuel_type': 'diesel',
'id': '7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT90816',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 214177,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-13',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2019}
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT90816%27 HTTP/1.1" 200 None
2026-03-29 18:39:29 [auto1.de] INFO: Saving data for PT90816: {'auction_closing_time': 1774886304.0, 'created_time': 1774607716.469401, 'last_price_update_time': 1774809569.413552}
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT90816') HTTP/1.1" 204 0
2026-03-29 18:39:29 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-29 18:39:29 [auto1.de] INFO: Found listing with ID: VS72441
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS72441%27 HTTP/1.1" 200 None
2026-03-29 18:39:29 [auto1.de] INFO: Scrape type for VS72441: 2
2026-03-29 18:39:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5ac95aa-aff8-5e6f-98b6-d15b02391b51 with identifier: VS72441
2026-03-29 18:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5ac95aa-aff8-5e6f-98b6-d15b02391b51 with scrape type 2
2026-03-29 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5ac95aa-aff8-5e6f-98b6-d15b02391b51 with scrape type 2
2026-03-29 18:39:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5ac95aa-aff8-5e6f-98b6-d15b02391b51, identifier: VS72441
2026-03-29 18:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5ac95aa-aff8-5e6f-98b6-d15b02391b51 with identifier: VS72441
2026-03-29 18:39:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5ac95aa-aff8-5e6f-98b6-d15b02391b51 with identifier: VS72441
2026-03-29 18:39:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5ac95aa-aff8-5e6f-98b6-d15b02391b51 with identifier: VS72441 to the API
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:46:43Z',
'fuel_type': 'diesel',
'id': 'c5ac95aa-aff8-5e6f-98b6-d15b02391b51',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS72441',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 230229,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-09',
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS72441%27 HTTP/1.1" 200 None
2026-03-29 18:39:29 [auto1.de] INFO: Saving data for VS72441: {'auction_closing_time': 1774885603.0, 'created_time': 1774002477.086803, 'last_price_update_time': 1774809569.945033}
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS72441') HTTP/1.1" 204 0
2026-03-29 18:39:29 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE81559%27 HTTP/1.1" 200 None
2026-03-29 18:39:29 [auto1.de] INFO: Scrape type for JE81559: 0
2026-03-29 18:39:29 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-29 18:39:29 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND35935%27 HTTP/1.1" 200 None
2026-03-29 18:39:30 [auto1.de] INFO: Scrape type for ND35935: 0
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU29731%27 HTTP/1.1" 200 None
2026-03-29 18:39:30 [auto1.de] INFO: Scrape type for HU29731: 0
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-29 18:39:30 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM19734%27 HTTP/1.1" 200 None
2026-03-29 18:39:30 [auto1.de] INFO: Scrape type for AM19734: 2
2026-03-29 18:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with identifier: AM19734
2026-03-29 18:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with scrape type 2
2026-03-29 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with scrape type 2
2026-03-29 18:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebb424d4-0ed7-5cfc-965f-05578a6c5c87, identifier: AM19734
2026-03-29 18:39:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with identifier: AM19734
2026-03-29 18:39:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with identifier: AM19734
2026-03-29 18:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with identifier: AM19734 to the API
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:44:19Z',
'fuel_type': 'petrol',
'id': 'ebb424d4-0ed7-5cfc-965f-05578a6c5c87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM19734',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra GTC',
'odometer': 92533,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-11',
'seller_name': None,
'title': 'Opel Astra GTC 1.6 SIDI Turbo Excite',
'transmission': 'manual',
'trim': 'Excite',
'year': 2018}
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM19734%27 HTTP/1.1" 200 None
2026-03-29 18:39:30 [auto1.de] INFO: Saving data for AM19734: {'auction_closing_time': 1774885459.0, 'created_time': 1774522454.559434, 'last_price_update_time': 1774809570.436846}
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM19734') HTTP/1.1" 204 0
2026-03-29 18:39:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA76308%27 HTTP/1.1" 200 None
2026-03-29 18:39:30 [auto1.de] INFO: Scrape type for MA76308: 2
2026-03-29 18:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7763ac02-d16a-5e4d-bbe7-d23acbd6f92a with identifier: MA76308
2026-03-29 18:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7763ac02-d16a-5e4d-bbe7-d23acbd6f92a with scrape type 2
2026-03-29 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7763ac02-d16a-5e4d-bbe7-d23acbd6f92a with scrape type 2
2026-03-29 18:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7763ac02-d16a-5e4d-bbe7-d23acbd6f92a, identifier: MA76308
2026-03-29 18:39:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7763ac02-d16a-5e4d-bbe7-d23acbd6f92a with identifier: MA76308
2026-03-29 18:39:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7763ac02-d16a-5e4d-bbe7-d23acbd6f92a with identifier: MA76308
2026-03-29 18:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7763ac02-d16a-5e4d-bbe7-d23acbd6f92a with identifier: MA76308 to the API
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:46:45Z',
'fuel_type': 'petrol',
'id': '7763ac02-d16a-5e4d-bbe7-d23acbd6f92a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA76308',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 190467,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-16',
'seller_name': None,
'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex 4x4',
'transmission': 'manual',
'trim': 'Innovation ecoFlex 4x4',
'year': 2013}
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA76308%27 HTTP/1.1" 200 None
2026-03-29 18:39:30 [auto1.de] INFO: Saving data for MA76308: {'auction_closing_time': 1774885605.0, 'created_time': 1774521473.730929, 'last_price_update_time': 1774809570.8414}
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA76308') HTTP/1.1" 204 0
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ52700%27 HTTP/1.1" 200 None
2026-03-29 18:39:30 [auto1.de] INFO: Scrape type for UZ52700: 0
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC25059%27 HTTP/1.1" 200 None
2026-03-29 18:39:30 [auto1.de] INFO: Scrape type for XC25059: 2
2026-03-29 18:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d6a5e6-b09b-593f-ac88-edd42ee3a823 with identifier: XC25059
2026-03-29 18:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d6a5e6-b09b-593f-ac88-edd42ee3a823 with scrape type 2
2026-03-29 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3d6a5e6-b09b-593f-ac88-edd42ee3a823 with scrape type 2
2026-03-29 18:39:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3d6a5e6-b09b-593f-ac88-edd42ee3a823, identifier: XC25059
2026-03-29 18:39:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3d6a5e6-b09b-593f-ac88-edd42ee3a823 with identifier: XC25059
2026-03-29 18:39:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3d6a5e6-b09b-593f-ac88-edd42ee3a823 with identifier: XC25059
2026-03-29 18:39:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3d6a5e6-b09b-593f-ac88-edd42ee3a823 with identifier: XC25059 to the API
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:31:33Z',
'fuel_type': 'diesel',
'id': 'c3d6a5e6-b09b-593f-ac88-edd42ee3a823',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC25059',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 192141,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-12',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2019}
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC25059%27 HTTP/1.1" 200 None
2026-03-29 18:39:31 [auto1.de] INFO: Saving data for XC25059: {'auction_closing_time': 1774884693.0, 'created_time': 1774032371.848973, 'last_price_update_time': 1774809571.711247}
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC25059') HTTP/1.1" 204 0
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82659%27 HTTP/1.1" 200 None
2026-03-29 18:39:31 [auto1.de] INFO: Scrape type for PS82659: 0
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40216%27 HTTP/1.1" 200 None
2026-03-29 18:39:31 [auto1.de] INFO: Scrape type for TX40216: 0
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH67676%27 HTTP/1.1" 200 None
2026-03-29 18:39:31 [auto1.de] INFO: Scrape type for NH67676: 2
2026-03-29 18:39:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b9b9c8f-c935-572f-affe-2848805b84a2 with identifier: NH67676
2026-03-29 18:39:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b9b9c8f-c935-572f-affe-2848805b84a2 with scrape type 2
2026-03-29 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b9b9c8f-c935-572f-affe-2848805b84a2 with scrape type 2
2026-03-29 18:39:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b9b9c8f-c935-572f-affe-2848805b84a2, identifier: NH67676
2026-03-29 18:39:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b9b9c8f-c935-572f-affe-2848805b84a2 with identifier: NH67676
2026-03-29 18:39:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b9b9c8f-c935-572f-affe-2848805b84a2 with identifier: NH67676
2026-03-29 18:39:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b9b9c8f-c935-572f-affe-2848805b84a2 with identifier: NH67676 to the API
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:52:30Z',
'fuel_type': 'diesel',
'id': '7b9b9c8f-c935-572f-affe-2848805b84a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH67676',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 169358,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-26',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Sportline 4x4',
'transmission': 'automatic',
'trim': 'Sportline 4x4',
'year': 2018}
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH67676%27 HTTP/1.1" 200 None
2026-03-29 18:39:32 [auto1.de] INFO: Saving data for NH67676: {'auction_closing_time': 1774885950.0, 'created_time': 1773387051.630934, 'last_price_update_time': 1774809572.162575}
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH67676') HTTP/1.1" 204 0
2026-03-29 18:39:32 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX22574%27 HTTP/1.1" 200 None
2026-03-29 18:39:32 [auto1.de] INFO: Scrape type for LX22574: 2
2026-03-29 18:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 819b4303-1aea-55b9-b2b3-cba9f2876e21 with identifier: LX22574
2026-03-29 18:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 819b4303-1aea-55b9-b2b3-cba9f2876e21 with scrape type 2
2026-03-29 18:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 819b4303-1aea-55b9-b2b3-cba9f2876e21 with scrape type 2
2026-03-29 18:39:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 819b4303-1aea-55b9-b2b3-cba9f2876e21, identifier: LX22574
2026-03-29 18:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 819b4303-1aea-55b9-b2b3-cba9f2876e21 with identifier: LX22574
2026-03-29 18:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 819b4303-1aea-55b9-b2b3-cba9f2876e21 with identifier: LX22574
2026-03-29 18:39:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 819b4303-1aea-55b9-b2b3-cba9f2876e21 with identifier: LX22574 to the API
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:14:51Z',
'fuel_type': 'petrol',
'id': '819b4303-1aea-55b9-b2b3-cba9f2876e21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX22574',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 110298,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-31',
'seller_name': None,
'title': 'Ford Focus 1.6 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2009}
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX22574%27 HTTP/1.1" 200 None
2026-03-29 18:39:32 [auto1.de] INFO: Saving data for LX22574: {'auction_closing_time': 1774883691.0, 'created_time': 1774522146.03296, 'last_price_update_time': 1774809572.68231}
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX22574') HTTP/1.1" 204 0
2026-03-29 18:39:32 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-29 18:39:32 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ81890%27 HTTP/1.1" 200 None
2026-03-29 18:39:32 [auto1.de] INFO: Scrape type for DJ81890: 2
2026-03-29 18:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caac9d88-d390-596a-9f59-fa11e41fe052 with identifier: DJ81890
2026-03-29 18:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caac9d88-d390-596a-9f59-fa11e41fe052 with scrape type 2
2026-03-29 18:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caac9d88-d390-596a-9f59-fa11e41fe052 with scrape type 2
2026-03-29 18:39:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caac9d88-d390-596a-9f59-fa11e41fe052, identifier: DJ81890
2026-03-29 18:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caac9d88-d390-596a-9f59-fa11e41fe052 with identifier: DJ81890
2026-03-29 18:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caac9d88-d390-596a-9f59-fa11e41fe052 with identifier: DJ81890
2026-03-29 18:39:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caac9d88-d390-596a-9f59-fa11e41fe052 with identifier: DJ81890 to the API
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:45:32Z',
'fuel_type': 'diesel',
'id': 'caac9d88-d390-596a-9f59-fa11e41fe052',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ81890',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 239152,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-22',
'seller_name': None,
'title': 'Volkswagen Scirocco 2.0 TDI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2011}
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ81890%27 HTTP/1.1" 200 None
2026-03-29 18:39:33 [auto1.de] INFO: Saving data for DJ81890: {'auction_closing_time': 1774885532.0, 'created_time': 1773381813.702166, 'last_price_update_time': 1774809573.081725}
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ81890') HTTP/1.1" 204 0
2026-03-29 18:39:33 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD30182%27 HTTP/1.1" 200 None
2026-03-29 18:39:33 [auto1.de] INFO: Scrape type for AD30182: 2
2026-03-29 18:39:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040 with identifier: AD30182
2026-03-29 18:39:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040 with scrape type 2
2026-03-29 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040 with scrape type 2
2026-03-29 18:39:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040, identifier: AD30182
2026-03-29 18:39:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040 with identifier: AD30182
2026-03-29 18:39:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040 with identifier: AD30182
2026-03-29 18:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040 with identifier: AD30182 to the API
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 67,
'expiration_date': '2026-03-30T15:41:31Z',
'fuel_type': 'petrol',
'id': 'dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD30182',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 12491,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-16',
'seller_name': None,
'title': 'Hyundai i10 1.0 Trend',
'transmission': 'automatic',
'trim': 'Trend',
'year': 2023}
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD30182%27 HTTP/1.1" 200 None
2026-03-29 18:39:33 [auto1.de] INFO: Saving data for AD30182: {'auction_closing_time': 1774885291.0, 'created_time': 1773426724.370823, 'last_price_update_time': 1774809573.47811}
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD30182') HTTP/1.1" 204 0
2026-03-29 18:39:33 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-29 18:39:33 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-29 18:39:33 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52961%27 HTTP/1.1" 200 None
2026-03-29 18:39:33 [auto1.de] INFO: Scrape type for TJ52961: 0
2026-03-29 18:39:33 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV52918%27 HTTP/1.1" 200 None
2026-03-29 18:39:33 [auto1.de] INFO: Scrape type for LV52918: 0
2026-03-29 18:39:33 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-29 18:39:33 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW08848%27 HTTP/1.1" 200 None
2026-03-29 18:39:33 [auto1.de] INFO: Scrape type for PW08848: 2
2026-03-29 18:39:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0df00137-405a-52fb-962e-912255d3c216 with identifier: PW08848
2026-03-29 18:39:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0df00137-405a-52fb-962e-912255d3c216 with scrape type 2
2026-03-29 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0df00137-405a-52fb-962e-912255d3c216 with scrape type 2
2026-03-29 18:39:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0df00137-405a-52fb-962e-912255d3c216, identifier: PW08848
2026-03-29 18:39:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0df00137-405a-52fb-962e-912255d3c216 with identifier: PW08848
2026-03-29 18:39:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0df00137-405a-52fb-962e-912255d3c216 with identifier: PW08848
2026-03-29 18:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0df00137-405a-52fb-962e-912255d3c216 with identifier: PW08848 to the API
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:18:15Z',
'fuel_type': 'diesel',
'id': '0df00137-405a-52fb-962e-912255d3c216',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW08848',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 290571,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-09',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 250 CDI T 4Matic BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T 4Matic BlueEfficiency Avantgarde',
'year': 2012}
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW08848%27 HTTP/1.1" 200 None
2026-03-29 18:39:33 [auto1.de] INFO: Saving data for PW08848: {'auction_closing_time': 1774883895.0, 'created_time': 1773428693.773969, 'last_price_update_time': 1774809573.975114}
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW08848') HTTP/1.1" 204 0
2026-03-29 18:39:33 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92844%27 HTTP/1.1" 200 None
2026-03-29 18:39:34 [auto1.de] INFO: Scrape type for YL92844: 2
2026-03-29 18:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7a430bd-5867-52e7-bb37-7078639a2673 with identifier: YL92844
2026-03-29 18:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7a430bd-5867-52e7-bb37-7078639a2673 with scrape type 2
2026-03-29 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7a430bd-5867-52e7-bb37-7078639a2673 with scrape type 2
2026-03-29 18:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7a430bd-5867-52e7-bb37-7078639a2673, identifier: YL92844
2026-03-29 18:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7a430bd-5867-52e7-bb37-7078639a2673 with identifier: YL92844
2026-03-29 18:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7a430bd-5867-52e7-bb37-7078639a2673 with identifier: YL92844
2026-03-29 18:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7a430bd-5867-52e7-bb37-7078639a2673 with identifier: YL92844 to the API
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:51:49Z',
'fuel_type': 'petrol',
'id': 'c7a430bd-5867-52e7-bb37-7078639a2673',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL92844',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 46532,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-14',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2014}
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92844%27 HTTP/1.1" 200 None
2026-03-29 18:39:34 [auto1.de] INFO: Saving data for YL92844: {'auction_closing_time': 1774885909.0, 'created_time': 1774607654.392144, 'last_price_update_time': 1774809574.431079}
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL92844') HTTP/1.1" 204 0
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK27476%27 HTTP/1.1" 200 None
2026-03-29 18:39:34 [auto1.de] INFO: Scrape type for CK27476: 0
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN68791%27 HTTP/1.1" 200 None
2026-03-29 18:39:34 [auto1.de] INFO: Scrape type for AN68791: 0
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP68179%27 HTTP/1.1" 200 None
2026-03-29 18:39:34 [auto1.de] INFO: Scrape type for SP68179: 0
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27416%27 HTTP/1.1" 200 None
2026-03-29 18:39:34 [auto1.de] INFO: Scrape type for NT27416: 0
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY58494%27 HTTP/1.1" 200 None
2026-03-29 18:39:34 [auto1.de] INFO: Scrape type for TY58494: 2
2026-03-29 18:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05ac855b-982f-5303-b3c4-a4cb8a38e986 with identifier: TY58494
2026-03-29 18:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05ac855b-982f-5303-b3c4-a4cb8a38e986 with scrape type 2
2026-03-29 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05ac855b-982f-5303-b3c4-a4cb8a38e986 with scrape type 2
2026-03-29 18:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05ac855b-982f-5303-b3c4-a4cb8a38e986, identifier: TY58494
2026-03-29 18:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05ac855b-982f-5303-b3c4-a4cb8a38e986 with identifier: TY58494
2026-03-29 18:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05ac855b-982f-5303-b3c4-a4cb8a38e986 with identifier: TY58494
2026-03-29 18:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05ac855b-982f-5303-b3c4-a4cb8a38e986 with identifier: TY58494 to the API
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:32:07Z',
'fuel_type': 'petrol',
'id': '05ac855b-982f-5303-b3c4-a4cb8a38e986',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY58494',
'listing': 'auction',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 57734,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-13',
'seller_name': None,
'title': 'Skoda Karoq 1.5 TSI ACT Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2022}
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY58494%27 HTTP/1.1" 200 None
2026-03-29 18:39:35 [auto1.de] INFO: Saving data for TY58494: {'auction_closing_time': 1774884727.0, 'created_time': 1774636239.429135, 'last_price_update_time': 1774809575.062589}
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY58494') HTTP/1.1" 204 0
2026-03-29 18:39:35 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-29 18:39:35 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM48488%27 HTTP/1.1" 200 None
2026-03-29 18:39:35 [auto1.de] INFO: Scrape type for UM48488: 0
2026-03-29 18:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:40 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:40 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-29 18:39:40 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36674%27 HTTP/1.1" 200 None
2026-03-29 18:39:40 [auto1.de] INFO: Scrape type for CD36674: 2
2026-03-29 18:39:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f75486b-1915-5a90-a228-1b787df727b5 with identifier: CD36674
2026-03-29 18:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f75486b-1915-5a90-a228-1b787df727b5 with scrape type 2
2026-03-29 18:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f75486b-1915-5a90-a228-1b787df727b5 with scrape type 2
2026-03-29 18:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f75486b-1915-5a90-a228-1b787df727b5, identifier: CD36674
2026-03-29 18:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f75486b-1915-5a90-a228-1b787df727b5 with identifier: CD36674
2026-03-29 18:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f75486b-1915-5a90-a228-1b787df727b5 with identifier: CD36674
2026-03-29 18:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f75486b-1915-5a90-a228-1b787df727b5 with identifier: CD36674 to the API
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:38:52Z',
'fuel_type': 'diesel',
'id': '8f75486b-1915-5a90-a228-1b787df727b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD36674',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 220192,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-15',
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36674%27 HTTP/1.1" 200 None
2026-03-29 18:39:40 [auto1.de] INFO: Saving data for CD36674: {'auction_closing_time': 1774885132.0, 'created_time': 1774636324.563795, 'last_price_update_time': 1774809580.789728}
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD36674') HTTP/1.1" 204 0
2026-03-29 18:39:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:40 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU37880%27 HTTP/1.1" 200 None
2026-03-29 18:39:40 [auto1.de] INFO: Scrape type for EU37880: 2
2026-03-29 18:39:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 199990d2-101a-535e-b4bf-7340d288ce39 with identifier: EU37880
2026-03-29 18:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 199990d2-101a-535e-b4bf-7340d288ce39 with scrape type 2
2026-03-29 18:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 199990d2-101a-535e-b4bf-7340d288ce39 with scrape type 2
2026-03-29 18:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 199990d2-101a-535e-b4bf-7340d288ce39, identifier: EU37880
2026-03-29 18:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 199990d2-101a-535e-b4bf-7340d288ce39 with identifier: EU37880
2026-03-29 18:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 199990d2-101a-535e-b4bf-7340d288ce39 with identifier: EU37880
2026-03-29 18:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 199990d2-101a-535e-b4bf-7340d288ce39 with identifier: EU37880 to the API
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:58:55Z',
'fuel_type': 'diesel',
'id': '199990d2-101a-535e-b4bf-7340d288ce39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU37880',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Boxer',
'odometer': 102911,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-25',
'seller_name': None,
'title': 'Peugeot Boxer 2.0 Blue-HDi 435 L3 BlueHDi 130 Kipper Edition',
'transmission': 'manual',
'trim': '435 L3 BlueHDi 130 Kipper Edition',
'year': 2018}
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU37880%27 HTTP/1.1" 200 None
2026-03-29 18:39:41 [auto1.de] INFO: Saving data for EU37880: {'auction_closing_time': 1774886335.0, 'created_time': 1774521881.722705, 'last_price_update_time': 1774809581.183592}
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU37880') HTTP/1.1" 204 0
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW62126%27 HTTP/1.1" 200 None
2026-03-29 18:39:41 [auto1.de] INFO: Scrape type for NW62126: 0
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK54405%27 HTTP/1.1" 200 None
2026-03-29 18:39:41 [auto1.de] INFO: Scrape type for SK54405: 0
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35044%27 HTTP/1.1" 200 None
2026-03-29 18:39:41 [auto1.de] INFO: Scrape type for JG35044: 0
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW05751%27 HTTP/1.1" 200 None
2026-03-29 18:39:41 [auto1.de] INFO: Scrape type for BW05751: 0
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90802%27 HTTP/1.1" 200 None
2026-03-29 18:39:41 [auto1.de] INFO: Scrape type for MT90802: 0
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV40367%27 HTTP/1.1" 200 None
2026-03-29 18:39:41 [auto1.de] INFO: Scrape type for ZV40367: 2
2026-03-29 18:39:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 343825b6-49dc-5a85-9088-4793f940efd8 with identifier: ZV40367
2026-03-29 18:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343825b6-49dc-5a85-9088-4793f940efd8 with scrape type 2
2026-03-29 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 343825b6-49dc-5a85-9088-4793f940efd8 with scrape type 2
2026-03-29 18:39:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 343825b6-49dc-5a85-9088-4793f940efd8, identifier: ZV40367
2026-03-29 18:39:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 343825b6-49dc-5a85-9088-4793f940efd8 with identifier: ZV40367
2026-03-29 18:39:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 343825b6-49dc-5a85-9088-4793f940efd8 with identifier: ZV40367
2026-03-29 18:39:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 343825b6-49dc-5a85-9088-4793f940efd8 with identifier: ZV40367 to the API
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:17:10Z',
'fuel_type': 'diesel',
'id': '343825b6-49dc-5a85-9088-4793f940efd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV40367',
'listing': 'auction',
'make': 'Kia',
'model': 'XCeed',
'odometer': 165182,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-26',
'seller_name': None,
'title': 'Kia XCeed 1.6 CRDi Mild-Hybrid Platinum Edition',
'transmission': 'automatic',
'trim': 'Platinum Edition',
'year': 2020}
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV40367%27 HTTP/1.1" 200 None
2026-03-29 18:39:41 [auto1.de] INFO: Saving data for ZV40367: {'auction_closing_time': 1774883830.0, 'created_time': 1774293764.556894, 'last_price_update_time': 1774809581.737166}
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV40367') HTTP/1.1" 204 0
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG94093%27 HTTP/1.1" 200 None
2026-03-29 18:39:41 [auto1.de] INFO: Scrape type for XG94093: 2
2026-03-29 18:39:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afcbe0b8-d993-516d-b47a-f969a069e018 with identifier: XG94093
2026-03-29 18:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afcbe0b8-d993-516d-b47a-f969a069e018 with scrape type 2
2026-03-29 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afcbe0b8-d993-516d-b47a-f969a069e018 with scrape type 2
2026-03-29 18:39:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afcbe0b8-d993-516d-b47a-f969a069e018, identifier: XG94093
2026-03-29 18:39:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afcbe0b8-d993-516d-b47a-f969a069e018 with identifier: XG94093
2026-03-29 18:39:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afcbe0b8-d993-516d-b47a-f969a069e018 with identifier: XG94093
2026-03-29 18:39:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afcbe0b8-d993-516d-b47a-f969a069e018 with identifier: XG94093 to the API
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:32:30Z',
'fuel_type': 'petrol',
'id': 'afcbe0b8-d993-516d-b47a-f969a069e018',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG94093',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 84378,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-08',
'seller_name': None,
'title': 'Hyundai i20 1.2 Select',
'transmission': 'manual',
'trim': 'Select',
'year': 2020}
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG94093%27 HTTP/1.1" 200 None
2026-03-29 18:39:42 [auto1.de] INFO: Saving data for XG94093: {'auction_closing_time': 1774884750.0, 'created_time': 1773830935.366758, 'last_price_update_time': 1774809582.328378}
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG94093') HTTP/1.1" 204 0
2026-03-29 18:39:42 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-29 18:39:42 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-29 18:39:42 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-29 18:39:42 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY58997%27 HTTP/1.1" 200 None
2026-03-29 18:39:42 [auto1.de] INFO: Scrape type for UY58997: 2
2026-03-29 18:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54791adc-5d23-549f-bd47-19b2bc5830b8 with identifier: UY58997
2026-03-29 18:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54791adc-5d23-549f-bd47-19b2bc5830b8 with scrape type 2
2026-03-29 18:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54791adc-5d23-549f-bd47-19b2bc5830b8 with scrape type 2
2026-03-29 18:39:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54791adc-5d23-549f-bd47-19b2bc5830b8, identifier: UY58997
2026-03-29 18:39:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54791adc-5d23-549f-bd47-19b2bc5830b8 with identifier: UY58997
2026-03-29 18:39:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54791adc-5d23-549f-bd47-19b2bc5830b8 with identifier: UY58997
2026-03-29 18:39:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54791adc-5d23-549f-bd47-19b2bc5830b8 with identifier: UY58997 to the API
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:45:39Z',
'fuel_type': 'petrol',
'id': '54791adc-5d23-549f-bd47-19b2bc5830b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY58997',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 211633,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-23',
'seller_name': None,
'title': 'Seat Leon 1.2 TSI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2015}
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY58997%27 HTTP/1.1" 200 None
2026-03-29 18:39:42 [auto1.de] INFO: Saving data for UY58997: {'auction_closing_time': 1774885539.0, 'created_time': 1773400151.835633, 'last_price_update_time': 1774809582.954231}
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY58997') HTTP/1.1" 204 0
2026-03-29 18:39:42 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-29 18:39:42 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY19126%27 HTTP/1.1" 200 None
2026-03-29 18:39:42 [auto1.de] INFO: Scrape type for SY19126: 2
2026-03-29 18:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbb998a-0b1e-594c-8e11-8e0b75d33d63 with identifier: SY19126
2026-03-29 18:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbb998a-0b1e-594c-8e11-8e0b75d33d63 with scrape type 2
2026-03-29 18:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdbb998a-0b1e-594c-8e11-8e0b75d33d63 with scrape type 2
2026-03-29 18:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdbb998a-0b1e-594c-8e11-8e0b75d33d63, identifier: SY19126
2026-03-29 18:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdbb998a-0b1e-594c-8e11-8e0b75d33d63 with identifier: SY19126
2026-03-29 18:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdbb998a-0b1e-594c-8e11-8e0b75d33d63 with identifier: SY19126
2026-03-29 18:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdbb998a-0b1e-594c-8e11-8e0b75d33d63 with identifier: SY19126 to the API
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:59:00Z',
'fuel_type': 'diesel',
'id': 'cdbb998a-0b1e-594c-8e11-8e0b75d33d63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY19126',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Life',
'odometer': 125706,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-12',
'seller_name': None,
'title': 'Opel Zafira Life 2.0 CDTI M Tourer L2',
'transmission': 'automatic',
'trim': 'M Tourer L2',
'year': 2022}
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY19126%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Saving data for SY19126: {'auction_closing_time': 1774886340.0, 'created_time': 1774636396.352895, 'last_price_update_time': 1774809583.357935}
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY19126') HTTP/1.1" 204 0
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: CE31107
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE31107%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Scrape type for CE31107: 2
2026-03-29 18:39:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with identifier: CE31107
2026-03-29 18:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with scrape type 2
2026-03-29 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with scrape type 2
2026-03-29 18:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3, identifier: CE31107
2026-03-29 18:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with identifier: CE31107
2026-03-29 18:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with identifier: CE31107
2026-03-29 18:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with identifier: CE31107 to the API
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:16:40Z',
'fuel_type': 'petrol',
'id': 'e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE31107',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 75293,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-20',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2017}
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE31107%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Saving data for CE31107: {'auction_closing_time': 1774883800.0, 'created_time': 1773427120.804391, 'last_price_update_time': 1774809583.763799}
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE31107') HTTP/1.1" 204 0
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN03285%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Scrape type for BN03285: 0
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04684%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Scrape type for MM04684: 2
2026-03-29 18:39:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 541bf046-305f-5b56-9571-ed738b024aed with identifier: MM04684
2026-03-29 18:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 541bf046-305f-5b56-9571-ed738b024aed with scrape type 2
2026-03-29 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 541bf046-305f-5b56-9571-ed738b024aed with scrape type 2
2026-03-29 18:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 541bf046-305f-5b56-9571-ed738b024aed, identifier: MM04684
2026-03-29 18:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 541bf046-305f-5b56-9571-ed738b024aed with identifier: MM04684
2026-03-29 18:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 541bf046-305f-5b56-9571-ed738b024aed with identifier: MM04684
2026-03-29 18:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 541bf046-305f-5b56-9571-ed738b024aed with identifier: MM04684 to the API
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:24:18Z',
'fuel_type': 'diesel',
'id': '541bf046-305f-5b56-9571-ed738b024aed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM04684',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf IV',
'odometer': 283661,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-10-01',
'seller_name': None,
'title': 'Volkswagen Golf IV 1.9 TDI Highline 4Motion',
'transmission': 'manual',
'trim': 'Highline 4Motion',
'year': 2000}
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04684%27 HTTP/1.1" 200 None
2026-03-29 18:39:44 [auto1.de] INFO: Saving data for MM04684: {'auction_closing_time': 1774884258.0, 'created_time': 1774032634.903096, 'last_price_update_time': 1774809584.212455}
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM04684') HTTP/1.1" 204 0
2026-03-29 18:39:44 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-29 18:39:44 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ04450%27 HTTP/1.1" 200 None
2026-03-29 18:39:44 [auto1.de] INFO: Scrape type for SZ04450: 0
2026-03-29 18:39:44 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG96622%27 HTTP/1.1" 200 None
2026-03-29 18:39:44 [auto1.de] INFO: Scrape type for KG96622: 0
2026-03-29 18:39:44 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-29 18:39:44 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-29 18:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:44 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:44 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-29 18:39:44 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN92851%27 HTTP/1.1" 200 None
2026-03-29 18:39:44 [auto1.de] INFO: Scrape type for FN92851: 0
2026-03-29 18:39:44 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47887%27 HTTP/1.1" 200 None
2026-03-29 18:39:44 [auto1.de] INFO: Scrape type for HF47887: 2
2026-03-29 18:39:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a38a9b04-c555-594f-951a-43675a0a24d6 with identifier: HF47887
2026-03-29 18:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a38a9b04-c555-594f-951a-43675a0a24d6 with scrape type 2
2026-03-29 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a38a9b04-c555-594f-951a-43675a0a24d6 with scrape type 2
2026-03-29 18:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a38a9b04-c555-594f-951a-43675a0a24d6, identifier: HF47887
2026-03-29 18:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a38a9b04-c555-594f-951a-43675a0a24d6 with identifier: HF47887
2026-03-29 18:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a38a9b04-c555-594f-951a-43675a0a24d6 with identifier: HF47887
2026-03-29 18:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a38a9b04-c555-594f-951a-43675a0a24d6 with identifier: HF47887 to the API
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:57:48Z',
'fuel_type': 'petrol',
'id': 'a38a9b04-c555-594f-951a-43675a0a24d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF47887',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 113018,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-31',
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47887%27 HTTP/1.1" 200 None
2026-03-29 18:39:44 [auto1.de] INFO: Saving data for HF47887: {'auction_closing_time': 1774886268.0, 'created_time': 1773344898.262217, 'last_price_update_time': 1774809584.976513}
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF47887') HTTP/1.1" 204 0
2026-03-29 18:39:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:44 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-29 18:39:44 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-29 18:39:44 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47046%27 HTTP/1.1" 200 None
2026-03-29 18:39:45 [auto1.de] INFO: Scrape type for EN47046: 2
2026-03-29 18:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with identifier: EN47046
2026-03-29 18:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with scrape type 2
2026-03-29 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with scrape type 2
2026-03-29 18:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb8a476f-fbfb-5fb0-aad4-d11096cca2f8, identifier: EN47046
2026-03-29 18:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with identifier: EN47046
2026-03-29 18:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with identifier: EN47046
2026-03-29 18:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with identifier: EN47046 to the API
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:05:24Z',
'fuel_type': 'petrol',
'id': 'bb8a476f-fbfb-5fb0-aad4-d11096cca2f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN47046',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 50733,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-09',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Comfortline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion Tech',
'year': 2014}
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47046%27 HTTP/1.1" 200 None
2026-03-29 18:39:45 [auto1.de] INFO: Saving data for EN47046: {'auction_closing_time': 1774883124.0, 'created_time': 1773304504.903672, 'last_price_update_time': 1774809585.420624}
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN47046') HTTP/1.1" 204 0
2026-03-29 18:39:45 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH62859%27 HTTP/1.1" 200 None
2026-03-29 18:39:45 [auto1.de] INFO: Scrape type for EH62859: 2
2026-03-29 18:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46ab2e5-08a6-5070-8622-2b06d986e09e with identifier: EH62859
2026-03-29 18:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46ab2e5-08a6-5070-8622-2b06d986e09e with scrape type 2
2026-03-29 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c46ab2e5-08a6-5070-8622-2b06d986e09e with scrape type 2
2026-03-29 18:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c46ab2e5-08a6-5070-8622-2b06d986e09e, identifier: EH62859
2026-03-29 18:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c46ab2e5-08a6-5070-8622-2b06d986e09e with identifier: EH62859
2026-03-29 18:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c46ab2e5-08a6-5070-8622-2b06d986e09e with identifier: EH62859
2026-03-29 18:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c46ab2e5-08a6-5070-8622-2b06d986e09e with identifier: EH62859 to the API
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 159,
'expiration_date': '2026-03-30T15:16:09Z',
'fuel_type': 'petrol',
'id': 'c46ab2e5-08a6-5070-8622-2b06d986e09e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH62859',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 84599,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-04',
'seller_name': None,
'title': 'Renault Kadjar 1.3 TCe Bose Edition',
'transmission': 'automatic',
'trim': 'Bose Edition',
'year': 2020}
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH62859%27 HTTP/1.1" 200 None
2026-03-29 18:39:45 [auto1.de] INFO: Saving data for EH62859: {'auction_closing_time': 1774883769.0, 'created_time': 1773302392.451953, 'last_price_update_time': 1774809585.981635}
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH62859') HTTP/1.1" 204 0
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP78953%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Scrape type for WP78953: 0
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU57618%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Scrape type for ZU57618: 0
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR50786%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Scrape type for PR50786: 0
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ71499%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Scrape type for ZJ71499: 0
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG74932%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Scrape type for RG74932: 0
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: BX95848
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX95848%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Scrape type for BX95848: 2
2026-03-29 18:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0 with identifier: BX95848
2026-03-29 18:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0 with scrape type 2
2026-03-29 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0 with scrape type 2
2026-03-29 18:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0, identifier: BX95848
2026-03-29 18:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0 with identifier: BX95848
2026-03-29 18:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0 with identifier: BX95848
2026-03-29 18:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0 with identifier: BX95848 to the API
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:54:31Z',
'fuel_type': 'petrol',
'id': '5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX95848',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 16835,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-09-26',
'seller_name': None,
'title': 'Opel Astra 1.2 Turbo GS',
'transmission': 'automatic',
'trim': 'GS',
'year': 2024}
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX95848%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Saving data for BX95848: {'auction_closing_time': 1774886071.0, 'created_time': 1774349171.574597, 'last_price_update_time': 1774809586.5315}
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX95848') HTTP/1.1" 204 0
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX45168%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Scrape type for LX45168: 0
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ36531%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Scrape type for DZ36531: 0
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV67104%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Scrape type for MV67104: 0
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK88230%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Scrape type for GK88230: 0
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF55359%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Scrape type for CF55359: 0
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU73518%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Scrape type for UU73518: 2
2026-03-29 18:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with identifier: UU73518
2026-03-29 18:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with scrape type 2
2026-03-29 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with scrape type 2
2026-03-29 18:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abb51e5e-6e00-5c20-9c6e-b68e2b8154a1, identifier: UU73518
2026-03-29 18:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with identifier: UU73518
2026-03-29 18:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with identifier: UU73518
2026-03-29 18:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with identifier: UU73518 to the API
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:07:52Z',
'fuel_type': 'petrol',
'id': 'abb51e5e-6e00-5c20-9c6e-b68e2b8154a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU73518',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 200590,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-08',
'seller_name': None,
'title': 'Seat Ibiza 1.2 TSI Style Salsa',
'transmission': 'manual',
'trim': 'Style Salsa',
'year': 2015}
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU73518%27 HTTP/1.1" 200 None
2026-03-29 18:39:47 [auto1.de] INFO: Saving data for UU73518: {'auction_closing_time': 1774883272.0, 'created_time': 1773685900.575337, 'last_price_update_time': 1774809587.209118}
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU73518') HTTP/1.1" 204 0
2026-03-29 18:39:47 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM77164%27 HTTP/1.1" 200 None
2026-03-29 18:39:47 [auto1.de] INFO: Scrape type for XM77164: 0
2026-03-29 18:39:47 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU35907%27 HTTP/1.1" 200 None
2026-03-29 18:39:47 [auto1.de] INFO: Scrape type for UU35907: 0
2026-03-29 18:39:47 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL38204%27 HTTP/1.1" 200 None
2026-03-29 18:39:47 [auto1.de] INFO: Scrape type for ZL38204: 0
2026-03-29 18:39:47 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-29 18:39:47 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD14897%27 HTTP/1.1" 200 None
2026-03-29 18:39:47 [auto1.de] INFO: Scrape type for HD14897: 2
2026-03-29 18:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41c581c3-0e12-5593-a40f-1af187fc8a22 with identifier: HD14897
2026-03-29 18:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c581c3-0e12-5593-a40f-1af187fc8a22 with scrape type 2
2026-03-29 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41c581c3-0e12-5593-a40f-1af187fc8a22 with scrape type 2
2026-03-29 18:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41c581c3-0e12-5593-a40f-1af187fc8a22, identifier: HD14897
2026-03-29 18:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41c581c3-0e12-5593-a40f-1af187fc8a22 with identifier: HD14897
2026-03-29 18:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41c581c3-0e12-5593-a40f-1af187fc8a22 with identifier: HD14897
2026-03-29 18:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41c581c3-0e12-5593-a40f-1af187fc8a22 with identifier: HD14897 to the API
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 382,
'expiration_date': '2026-03-30T15:18:44Z',
'fuel_type': 'diesel',
'id': '41c581c3-0e12-5593-a40f-1af187fc8a22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD14897',
'listing': 'auction',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 259189,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-21',
'seller_name': None,
'title': 'Porsche Cayenne S Diesel',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD14897%27 HTTP/1.1" 200 None
2026-03-29 18:39:47 [auto1.de] INFO: Saving data for HD14897: {'auction_closing_time': 1774883924.0, 'created_time': 1773860073.807691, 'last_price_update_time': 1774809587.703628}
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD14897') HTTP/1.1" 204 0
2026-03-29 18:39:47 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-29 18:39:47 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ93039%27 HTTP/1.1" 200 None
2026-03-29 18:39:47 [auto1.de] INFO: Scrape type for DZ93039: 0
2026-03-29 18:39:47 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91085%27 HTTP/1.1" 200 None
2026-03-29 18:39:47 [auto1.de] INFO: Scrape type for XT91085: 0
2026-03-29 18:39:47 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG38936%27 HTTP/1.1" 200 None
2026-03-29 18:39:47 [auto1.de] INFO: Scrape type for AG38936: 0
2026-03-29 18:39:47 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ15757%27 HTTP/1.1" 200 None
2026-03-29 18:39:47 [auto1.de] INFO: Scrape type for CJ15757: 2
2026-03-29 18:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09438e73-d914-53f3-bada-408f83318c2d with identifier: CJ15757
2026-03-29 18:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09438e73-d914-53f3-bada-408f83318c2d with scrape type 2
2026-03-29 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09438e73-d914-53f3-bada-408f83318c2d with scrape type 2
2026-03-29 18:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09438e73-d914-53f3-bada-408f83318c2d, identifier: CJ15757
2026-03-29 18:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09438e73-d914-53f3-bada-408f83318c2d with identifier: CJ15757
2026-03-29 18:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09438e73-d914-53f3-bada-408f83318c2d with identifier: CJ15757
2026-03-29 18:39:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09438e73-d914-53f3-bada-408f83318c2d with identifier: CJ15757 to the API
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:34:09Z',
'fuel_type': 'petrol',
'id': '09438e73-d914-53f3-bada-408f83318c2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ15757',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 80798,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-01-31',
'seller_name': None,
'title': 'Ford Mondeo 1.8 Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2000}
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ15757%27 HTTP/1.1" 200 None
2026-03-29 18:39:48 [auto1.de] INFO: Saving data for CJ15757: {'auction_closing_time': 1774884849.0, 'created_time': 1774290787.757626, 'last_price_update_time': 1774809588.327715}
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ15757') HTTP/1.1" 204 0
2026-03-29 18:39:48 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-29 18:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:49 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE67546%27 HTTP/1.1" 200 None
2026-03-29 18:39:49 [auto1.de] INFO: Scrape type for ZE67546: 2
2026-03-29 18:39:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04ddceaa-8240-5c23-99a5-b60a774b0062 with identifier: ZE67546
2026-03-29 18:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04ddceaa-8240-5c23-99a5-b60a774b0062 with scrape type 2
2026-03-29 18:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04ddceaa-8240-5c23-99a5-b60a774b0062 with scrape type 2
2026-03-29 18:39:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04ddceaa-8240-5c23-99a5-b60a774b0062, identifier: ZE67546
2026-03-29 18:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04ddceaa-8240-5c23-99a5-b60a774b0062 with identifier: ZE67546
2026-03-29 18:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04ddceaa-8240-5c23-99a5-b60a774b0062 with identifier: ZE67546
2026-03-29 18:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04ddceaa-8240-5c23-99a5-b60a774b0062 with identifier: ZE67546 to the API
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:17:37Z',
'fuel_type': 'hybrid',
'id': '04ddceaa-8240-5c23-99a5-b60a774b0062',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE67546',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 55216,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-25',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2021}
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE67546%27 HTTP/1.1" 200 None
2026-03-29 18:39:49 [auto1.de] INFO: Saving data for ZE67546: {'auction_closing_time': 1774883857.0, 'created_time': 1773428774.636892, 'last_price_update_time': 1774809589.461099}
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE67546') HTTP/1.1" 204 0
2026-03-29 18:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08315%27 HTTP/1.1" 200 None
2026-03-29 18:39:49 [auto1.de] INFO: Scrape type for GC08315: 0
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ66272%27 HTTP/1.1" 200 None
2026-03-29 18:39:49 [auto1.de] INFO: Scrape type for MJ66272: 0
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN96798%27 HTTP/1.1" 200 None
2026-03-29 18:39:49 [auto1.de] INFO: Scrape type for DN96798: 0
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX08266%27 HTTP/1.1" 200 None
2026-03-29 18:39:49 [auto1.de] INFO: Scrape type for ZX08266: 2
2026-03-29 18:39:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b042b90d-6e3c-573b-8a81-75093e4b3add with identifier: ZX08266
2026-03-29 18:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b042b90d-6e3c-573b-8a81-75093e4b3add with scrape type 2
2026-03-29 18:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b042b90d-6e3c-573b-8a81-75093e4b3add with scrape type 2
2026-03-29 18:39:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b042b90d-6e3c-573b-8a81-75093e4b3add, identifier: ZX08266
2026-03-29 18:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b042b90d-6e3c-573b-8a81-75093e4b3add with identifier: ZX08266
2026-03-29 18:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b042b90d-6e3c-573b-8a81-75093e4b3add with identifier: ZX08266
2026-03-29 18:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b042b90d-6e3c-573b-8a81-75093e4b3add with identifier: ZX08266 to the API
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:26:33Z',
'fuel_type': 'petrol',
'id': 'b042b90d-6e3c-573b-8a81-75093e4b3add',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX08266',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 141355,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-03',
'seller_name': None,
'title': 'Volvo XC40 2.0 T4 Momentum Pro AWD',
'transmission': 'automatic',
'trim': 'Momentum Pro AWD',
'year': 2019}
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX08266%27 HTTP/1.1" 200 None
2026-03-29 18:39:49 [auto1.de] INFO: Saving data for ZX08266: {'auction_closing_time': 1774884393.0, 'created_time': 1773303507.725137, 'last_price_update_time': 1774809589.996607}
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX08266') HTTP/1.1" 204 0
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA14400%27 HTTP/1.1" 200 None
2026-03-29 18:39:50 [auto1.de] INFO: Scrape type for DA14400: 0
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF58855%27 HTTP/1.1" 200 None
2026-03-29 18:39:50 [auto1.de] INFO: Scrape type for XF58855: 0
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW69940%27 HTTP/1.1" 200 None
2026-03-29 18:39:50 [auto1.de] INFO: Scrape type for BW69940: 0
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN31203%27 HTTP/1.1" 200 None
2026-03-29 18:39:50 [auto1.de] INFO: Scrape type for PN31203: 2
2026-03-29 18:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with identifier: PN31203
2026-03-29 18:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with scrape type 2
2026-03-29 18:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with scrape type 2
2026-03-29 18:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70, identifier: PN31203
2026-03-29 18:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with identifier: PN31203
2026-03-29 18:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with identifier: PN31203
2026-03-29 18:39:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with identifier: PN31203 to the API
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:52:31Z',
'fuel_type': 'diesel',
'id': '69ad4ae9-5eaa-5f68-b40c-9ee546dfee70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN31203',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 166216,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-30',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2019}
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN31203%27 HTTP/1.1" 200 None
2026-03-29 18:39:50 [auto1.de] INFO: Saving data for PN31203: {'auction_closing_time': 1774885951.0, 'created_time': 1773466901.443638, 'last_price_update_time': 1774809590.594511}
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN31203') HTTP/1.1" 204 0
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW88691%27 HTTP/1.1" 200 None
2026-03-29 18:39:50 [auto1.de] INFO: Scrape type for YW88691: 2
2026-03-29 18:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2636e10-6ba9-578c-ada5-3013d96fdaad with identifier: YW88691
2026-03-29 18:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2636e10-6ba9-578c-ada5-3013d96fdaad with scrape type 2
2026-03-29 18:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2636e10-6ba9-578c-ada5-3013d96fdaad with scrape type 2
2026-03-29 18:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2636e10-6ba9-578c-ada5-3013d96fdaad, identifier: YW88691
2026-03-29 18:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2636e10-6ba9-578c-ada5-3013d96fdaad with identifier: YW88691
2026-03-29 18:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2636e10-6ba9-578c-ada5-3013d96fdaad with identifier: YW88691
2026-03-29 18:39:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2636e10-6ba9-578c-ada5-3013d96fdaad with identifier: YW88691 to the API
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:24:13Z',
'fuel_type': 'diesel',
'id': 'e2636e10-6ba9-578c-ada5-3013d96fdaad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW88691',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 220940,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-18',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2016}
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW88691%27 HTTP/1.1" 200 None
2026-03-29 18:39:51 [auto1.de] INFO: Saving data for YW88691: {'auction_closing_time': 1774884253.0, 'created_time': 1774607879.999749, 'last_price_update_time': 1774809591.035631}
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW88691') HTTP/1.1" 204 0
2026-03-29 18:39:51 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT26189%27 HTTP/1.1" 200 None
2026-03-29 18:39:51 [auto1.de] INFO: Scrape type for JT26189: 0
2026-03-29 18:39:51 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL29302%27 HTTP/1.1" 200 None
2026-03-29 18:39:51 [auto1.de] INFO: Scrape type for GL29302: 2
2026-03-29 18:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22ed6070-9994-531d-8c93-416057fdd47e with identifier: GL29302
2026-03-29 18:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22ed6070-9994-531d-8c93-416057fdd47e with scrape type 2
2026-03-29 18:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22ed6070-9994-531d-8c93-416057fdd47e with scrape type 2
2026-03-29 18:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22ed6070-9994-531d-8c93-416057fdd47e, identifier: GL29302
2026-03-29 18:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22ed6070-9994-531d-8c93-416057fdd47e with identifier: GL29302
2026-03-29 18:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22ed6070-9994-531d-8c93-416057fdd47e with identifier: GL29302
2026-03-29 18:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22ed6070-9994-531d-8c93-416057fdd47e with identifier: GL29302 to the API
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-30T15:32:21Z',
'fuel_type': 'petrol',
'id': '22ed6070-9994-531d-8c93-416057fdd47e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL29302',
'listing': 'auction',
'make': 'Kia',
'model': 'Picanto',
'odometer': 138869,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-06',
'seller_name': None,
'title': 'Kia Picanto 1.0 Edition 7',
'transmission': 'manual',
'trim': 'Edition 7',
'year': 2016}
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL29302%27 HTTP/1.1" 200 None
2026-03-29 18:39:51 [auto1.de] INFO: Saving data for GL29302: {'auction_closing_time': 1774884741.0, 'created_time': 1774521385.417426, 'last_price_update_time': 1774809591.563067}
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL29302') HTTP/1.1" 204 0
2026-03-29 18:39:51 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-29 18:39:51 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF85943%27 HTTP/1.1" 200 None
2026-03-29 18:39:51 [auto1.de] INFO: Scrape type for BF85943: 2
2026-03-29 18:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba42525d-36c6-5ad9-9430-e809d1e47c8a with identifier: BF85943
2026-03-29 18:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba42525d-36c6-5ad9-9430-e809d1e47c8a with scrape type 2
2026-03-29 18:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba42525d-36c6-5ad9-9430-e809d1e47c8a with scrape type 2
2026-03-29 18:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba42525d-36c6-5ad9-9430-e809d1e47c8a, identifier: BF85943
2026-03-29 18:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba42525d-36c6-5ad9-9430-e809d1e47c8a with identifier: BF85943
2026-03-29 18:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba42525d-36c6-5ad9-9430-e809d1e47c8a with identifier: BF85943
2026-03-29 18:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba42525d-36c6-5ad9-9430-e809d1e47c8a with identifier: BF85943 to the API
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:04:58Z',
'fuel_type': 'diesel',
'id': 'ba42525d-36c6-5ad9-9430-e809d1e47c8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF85943',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 150257,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-26',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2019}
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF85943%27 HTTP/1.1" 200 None
2026-03-29 18:39:52 [auto1.de] INFO: Saving data for BF85943: {'auction_closing_time': 1774883098.0, 'created_time': 1773303743.454613, 'last_price_update_time': 1774809592.032326}
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF85943') HTTP/1.1" 204 0
2026-03-29 18:39:52 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-29 18:39:52 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44518%27 HTTP/1.1" 200 None
2026-03-29 18:39:52 [auto1.de] INFO: Scrape type for YH44518: 2
2026-03-29 18:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with identifier: YH44518
2026-03-29 18:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with scrape type 2
2026-03-29 18:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with scrape type 2
2026-03-29 18:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7b33f1f-bbf1-5f55-928b-1d4c8b426094, identifier: YH44518
2026-03-29 18:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with identifier: YH44518
2026-03-29 18:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with identifier: YH44518
2026-03-29 18:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with identifier: YH44518 to the API
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:43:52Z',
'fuel_type': 'petrol',
'id': 'd7b33f1f-bbf1-5f55-928b-1d4c8b426094',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH44518',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 11414,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-02-09',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2025}
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44518%27 HTTP/1.1" 200 None
2026-03-29 18:39:52 [auto1.de] INFO: Saving data for YH44518: {'auction_closing_time': 1774885432.0, 'created_time': 1773858701.891021, 'last_price_update_time': 1774809592.471353}
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH44518') HTTP/1.1" 204 0
2026-03-29 18:39:52 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM46602%27 HTTP/1.1" 200 None
2026-03-29 18:39:52 [auto1.de] INFO: Scrape type for LM46602: 0
2026-03-29 18:39:52 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA16942%27 HTTP/1.1" 200 None
2026-03-29 18:39:52 [auto1.de] INFO: Scrape type for HA16942: 2
2026-03-29 18:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14ccf64c-505d-5ce3-b9ce-c541f4f7ed47 with identifier: HA16942
2026-03-29 18:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14ccf64c-505d-5ce3-b9ce-c541f4f7ed47 with scrape type 2
2026-03-29 18:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14ccf64c-505d-5ce3-b9ce-c541f4f7ed47 with scrape type 2
2026-03-29 18:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14ccf64c-505d-5ce3-b9ce-c541f4f7ed47, identifier: HA16942
2026-03-29 18:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14ccf64c-505d-5ce3-b9ce-c541f4f7ed47 with identifier: HA16942
2026-03-29 18:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14ccf64c-505d-5ce3-b9ce-c541f4f7ed47 with identifier: HA16942
2026-03-29 18:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14ccf64c-505d-5ce3-b9ce-c541f4f7ed47 with identifier: HA16942 to the API
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:02:26Z',
'fuel_type': 'petrol',
'id': '14ccf64c-505d-5ce3-b9ce-c541f4f7ed47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA16942',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 120283,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-12',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2009}
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA16942%27 HTTP/1.1" 200 None
2026-03-29 18:39:52 [auto1.de] INFO: Saving data for HA16942: {'auction_closing_time': 1774882946.0, 'created_time': 1774522491.297355, 'last_price_update_time': 1774809592.915259}
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA16942') HTTP/1.1" 204 0
2026-03-29 18:39:52 [auto1.de] INFO: Found listing with ID: EE67524
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE67524%27 HTTP/1.1" 200 None
2026-03-29 18:39:52 [auto1.de] INFO: Scrape type for EE67524: 2
2026-03-29 18:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06f4565f-287b-59db-bf45-84986f23d96d with identifier: EE67524
2026-03-29 18:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06f4565f-287b-59db-bf45-84986f23d96d with scrape type 2
2026-03-29 18:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06f4565f-287b-59db-bf45-84986f23d96d with scrape type 2
2026-03-29 18:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06f4565f-287b-59db-bf45-84986f23d96d, identifier: EE67524
2026-03-29 18:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06f4565f-287b-59db-bf45-84986f23d96d with identifier: EE67524
2026-03-29 18:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06f4565f-287b-59db-bf45-84986f23d96d with identifier: EE67524
2026-03-29 18:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06f4565f-287b-59db-bf45-84986f23d96d with identifier: EE67524 to the API
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:25:33Z',
'fuel_type': 'petrol',
'id': '06f4565f-287b-59db-bf45-84986f23d96d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE67524',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 164779,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-08',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.4 Turbo Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2015}
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE67524%27 HTTP/1.1" 200 None
2026-03-29 18:39:53 [auto1.de] INFO: Saving data for EE67524: {'auction_closing_time': 1774884333.0, 'created_time': 1774031778.177104, 'last_price_update_time': 1774809593.369845}
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE67524') HTTP/1.1" 204 0
2026-03-29 18:39:53 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-29 18:39:53 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY57936%27 HTTP/1.1" 200 None
2026-03-29 18:39:53 [auto1.de] INFO: Scrape type for VY57936: 2
2026-03-29 18:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3 with identifier: VY57936
2026-03-29 18:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3 with scrape type 2
2026-03-29 18:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3 with scrape type 2
2026-03-29 18:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3, identifier: VY57936
2026-03-29 18:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3 with identifier: VY57936
2026-03-29 18:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3 with identifier: VY57936
2026-03-29 18:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3 with identifier: VY57936 to the API
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:54:01Z',
'fuel_type': 'diesel',
'id': '659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY57936',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 181731,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-03',
'seller_name': None,
'title': 'BMW 2er 220d Gran Tourer xDrive Advantage',
'transmission': 'automatic',
'trim': 'xDrive Advantage',
'year': 2017}
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY57936%27 HTTP/1.1" 200 None
2026-03-29 18:39:53 [auto1.de] INFO: Saving data for VY57936: {'auction_closing_time': 1774886041.0, 'created_time': 1773468036.378788, 'last_price_update_time': 1774809593.785389}
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY57936') HTTP/1.1" 204 0
2026-03-29 18:39:53 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85569%27 HTTP/1.1" 200 None
2026-03-29 18:39:53 [auto1.de] INFO: Scrape type for AJ85569: 2
2026-03-29 18:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f0491a4-301d-5a14-9fc0-017fd1969586 with identifier: AJ85569
2026-03-29 18:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f0491a4-301d-5a14-9fc0-017fd1969586 with scrape type 2
2026-03-29 18:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f0491a4-301d-5a14-9fc0-017fd1969586 with scrape type 2
2026-03-29 18:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f0491a4-301d-5a14-9fc0-017fd1969586, identifier: AJ85569
2026-03-29 18:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f0491a4-301d-5a14-9fc0-017fd1969586 with identifier: AJ85569
2026-03-29 18:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f0491a4-301d-5a14-9fc0-017fd1969586 with identifier: AJ85569
2026-03-29 18:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f0491a4-301d-5a14-9fc0-017fd1969586 with identifier: AJ85569 to the API
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:20:58Z',
'fuel_type': 'diesel',
'id': '6f0491a4-301d-5a14-9fc0-017fd1969586',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ85569',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 76827,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-04',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid 320 L1 Tourneo Titanium X',
'transmission': 'manual',
'trim': '320 L1 Tourneo Titanium X',
'year': 2020}
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85569%27 HTTP/1.1" 200 None
2026-03-29 18:39:54 [auto1.de] INFO: Saving data for AJ85569: {'auction_closing_time': 1774884058.0, 'created_time': 1773135031.474286, 'last_price_update_time': 1774809594.304735}
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ85569') HTTP/1.1" 204 0
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78642%27 HTTP/1.1" 200 None
2026-03-29 18:39:54 [auto1.de] INFO: Scrape type for VH78642: 0
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL30108%27 HTTP/1.1" 200 None
2026-03-29 18:39:54 [auto1.de] INFO: Scrape type for FL30108: 0
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-29 18:39:54 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM69189%27 HTTP/1.1" 200 None
2026-03-29 18:39:54 [auto1.de] INFO: Scrape type for UM69189: 0
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG74955%27 HTTP/1.1" 200 None
2026-03-29 18:39:54 [auto1.de] INFO: Scrape type for NG74955: 2
2026-03-29 18:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8b9b66f-03aa-5432-a3de-9b881425e62d with identifier: NG74955
2026-03-29 18:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b9b66f-03aa-5432-a3de-9b881425e62d with scrape type 2
2026-03-29 18:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8b9b66f-03aa-5432-a3de-9b881425e62d with scrape type 2
2026-03-29 18:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8b9b66f-03aa-5432-a3de-9b881425e62d, identifier: NG74955
2026-03-29 18:39:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8b9b66f-03aa-5432-a3de-9b881425e62d with identifier: NG74955
2026-03-29 18:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8b9b66f-03aa-5432-a3de-9b881425e62d with identifier: NG74955
2026-03-29 18:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8b9b66f-03aa-5432-a3de-9b881425e62d with identifier: NG74955 to the API
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:44:21Z',
'fuel_type': 'petrol',
'id': 'd8b9b66f-03aa-5432-a3de-9b881425e62d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG74955',
'listing': 'auction',
'make': 'Mazda',
'model': '6',
'odometer': 177082,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-08-16',
'seller_name': None,
'title': 'Mazda 6 2.3 Active Plus Sport',
'transmission': 'automatic',
'trim': 'Active Plus Sport',
'year': 2007}
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG74955%27 HTTP/1.1" 200 None
2026-03-29 18:39:54 [auto1.de] INFO: Saving data for NG74955: {'auction_closing_time': 1774885461.0, 'created_time': 1774549898.137163, 'last_price_update_time': 1774809594.77985}
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG74955') HTTP/1.1" 204 0
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61675%27 HTTP/1.1" 200 None
2026-03-29 18:39:54 [auto1.de] INFO: Scrape type for GL61675: 0
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW59742%27 HTTP/1.1" 200 None
2026-03-29 18:39:54 [auto1.de] INFO: Scrape type for CW59742: 2
2026-03-29 18:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc7c1e35-d42d-5997-bd20-ad05c7b63589 with identifier: CW59742
2026-03-29 18:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc7c1e35-d42d-5997-bd20-ad05c7b63589 with scrape type 2
2026-03-29 18:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc7c1e35-d42d-5997-bd20-ad05c7b63589 with scrape type 2
2026-03-29 18:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc7c1e35-d42d-5997-bd20-ad05c7b63589, identifier: CW59742
2026-03-29 18:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc7c1e35-d42d-5997-bd20-ad05c7b63589 with identifier: CW59742
2026-03-29 18:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc7c1e35-d42d-5997-bd20-ad05c7b63589 with identifier: CW59742
2026-03-29 18:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc7c1e35-d42d-5997-bd20-ad05c7b63589 with identifier: CW59742 to the API
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:48:47Z',
'fuel_type': 'diesel',
'id': 'fc7c1e35-d42d-5997-bd20-ad05c7b63589',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW59742',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 274134,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-22',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2014}
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW59742%27 HTTP/1.1" 200 None
2026-03-29 18:39:55 [auto1.de] INFO: Saving data for CW59742: {'auction_closing_time': 1774885727.0, 'created_time': 1773467233.793212, 'last_price_update_time': 1774809595.23747}
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW59742') HTTP/1.1" 204 0
2026-03-29 18:39:55 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06132%27 HTTP/1.1" 200 None
2026-03-29 18:39:55 [auto1.de] INFO: Scrape type for BW06132: 2
2026-03-29 18:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05b5c9cd-4470-5647-bb3e-99797974a306 with identifier: BW06132
2026-03-29 18:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05b5c9cd-4470-5647-bb3e-99797974a306 with scrape type 2
2026-03-29 18:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05b5c9cd-4470-5647-bb3e-99797974a306 with scrape type 2
2026-03-29 18:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05b5c9cd-4470-5647-bb3e-99797974a306, identifier: BW06132
2026-03-29 18:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05b5c9cd-4470-5647-bb3e-99797974a306 with identifier: BW06132
2026-03-29 18:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05b5c9cd-4470-5647-bb3e-99797974a306 with identifier: BW06132
2026-03-29 18:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05b5c9cd-4470-5647-bb3e-99797974a306 with identifier: BW06132 to the API
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:11:54Z',
'fuel_type': 'petrol',
'id': '05b5c9cd-4470-5647-bb3e-99797974a306',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW06132',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 216018,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-25',
'seller_name': None,
'title': 'Ford Focus 1.6 Concept',
'transmission': 'manual',
'trim': 'Concept',
'year': 2011}
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06132%27 HTTP/1.1" 200 None
2026-03-29 18:39:55 [auto1.de] INFO: Saving data for BW06132: {'auction_closing_time': 1774883514.0, 'created_time': 1774118508.152529, 'last_price_update_time': 1774809595.771939}
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW06132') HTTP/1.1" 204 0
2026-03-29 18:39:55 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC26510%27 HTTP/1.1" 200 None
2026-03-29 18:39:55 [auto1.de] INFO: Scrape type for TC26510: 2
2026-03-29 18:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce01dc7d-9804-5e8d-85aa-6c26279a8344 with identifier: TC26510
2026-03-29 18:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce01dc7d-9804-5e8d-85aa-6c26279a8344 with scrape type 2
2026-03-29 18:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce01dc7d-9804-5e8d-85aa-6c26279a8344 with scrape type 2
2026-03-29 18:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce01dc7d-9804-5e8d-85aa-6c26279a8344, identifier: TC26510
2026-03-29 18:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce01dc7d-9804-5e8d-85aa-6c26279a8344 with identifier: TC26510
2026-03-29 18:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce01dc7d-9804-5e8d-85aa-6c26279a8344 with identifier: TC26510
2026-03-29 18:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce01dc7d-9804-5e8d-85aa-6c26279a8344 with identifier: TC26510 to the API
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:52:01Z',
'fuel_type': 'diesel',
'id': 'ce01dc7d-9804-5e8d-85aa-6c26279a8344',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC26510',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 239286,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-25',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC26510%27 HTTP/1.1" 200 None
2026-03-29 18:39:56 [auto1.de] INFO: Saving data for TC26510: {'auction_closing_time': 1774885921.0, 'created_time': 1773685901.418214, 'last_price_update_time': 1774809596.245193}
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TC26510') HTTP/1.1" 204 0
2026-03-29 18:39:56 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV11727%27 HTTP/1.1" 200 None
2026-03-29 18:39:56 [auto1.de] INFO: Scrape type for TV11727: 2
2026-03-29 18:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dea8b217-5d60-5c42-ae50-137a48d1420d with identifier: TV11727
2026-03-29 18:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dea8b217-5d60-5c42-ae50-137a48d1420d with scrape type 2
2026-03-29 18:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dea8b217-5d60-5c42-ae50-137a48d1420d with scrape type 2
2026-03-29 18:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dea8b217-5d60-5c42-ae50-137a48d1420d, identifier: TV11727
2026-03-29 18:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dea8b217-5d60-5c42-ae50-137a48d1420d with identifier: TV11727
2026-03-29 18:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dea8b217-5d60-5c42-ae50-137a48d1420d with identifier: TV11727
2026-03-29 18:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dea8b217-5d60-5c42-ae50-137a48d1420d with identifier: TV11727 to the API
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:19:26Z',
'fuel_type': 'petrol',
'id': 'dea8b217-5d60-5c42-ae50-137a48d1420d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV11727',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 121447,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-23',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
'transmission': 'automatic',
'trim': '4Matic Exclusive',
'year': 2018}
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV11727%27 HTTP/1.1" 200 None
2026-03-29 18:39:56 [auto1.de] INFO: Saving data for TV11727: {'auction_closing_time': 1774883966.0, 'created_time': 1773401041.48768, 'last_price_update_time': 1774809596.723413}
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV11727') HTTP/1.1" 204 0
2026-03-29 18:39:56 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP32439%27 HTTP/1.1" 200 None
2026-03-29 18:39:56 [auto1.de] INFO: Scrape type for FP32439: 0
2026-03-29 18:39:56 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY67779%27 HTTP/1.1" 200 None
2026-03-29 18:39:56 [auto1.de] INFO: Scrape type for KY67779: 0
2026-03-29 18:39:56 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ94391%27 HTTP/1.1" 200 None
2026-03-29 18:39:56 [auto1.de] INFO: Scrape type for WJ94391: 0
2026-03-29 18:39:56 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM78395%27 HTTP/1.1" 200 None
2026-03-29 18:39:56 [auto1.de] INFO: Scrape type for KM78395: 0
2026-03-29 18:39:56 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR86063%27 HTTP/1.1" 200 None
2026-03-29 18:39:56 [auto1.de] INFO: Scrape type for GR86063: 2
2026-03-29 18:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7de6619-83d8-5976-bb53-a9b4512f9c09 with identifier: GR86063
2026-03-29 18:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7de6619-83d8-5976-bb53-a9b4512f9c09 with scrape type 2
2026-03-29 18:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7de6619-83d8-5976-bb53-a9b4512f9c09 with scrape type 2
2026-03-29 18:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7de6619-83d8-5976-bb53-a9b4512f9c09, identifier: GR86063
2026-03-29 18:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7de6619-83d8-5976-bb53-a9b4512f9c09 with identifier: GR86063
2026-03-29 18:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7de6619-83d8-5976-bb53-a9b4512f9c09 with identifier: GR86063
2026-03-29 18:39:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7de6619-83d8-5976-bb53-a9b4512f9c09 with identifier: GR86063 to the API
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:05:32Z',
'fuel_type': 'diesel',
'id': 'c7de6619-83d8-5976-bb53-a9b4512f9c09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR86063',
'listing': 'auction',
'make': 'Citroen',
'model': 'C5',
'odometer': 207463,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-22',
'seller_name': None,
'title': 'Citroen C5 2.0 HDi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2009}
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR86063%27 HTTP/1.1" 200 None
2026-03-29 18:39:57 [auto1.de] INFO: Saving data for GR86063: {'auction_closing_time': 1774883132.0, 'created_time': 1773305461.178113, 'last_price_update_time': 1774809597.258147}
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR86063') HTTP/1.1" 204 0
2026-03-29 18:39:57 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-29 18:39:57 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW85167%27 HTTP/1.1" 200 None
2026-03-29 18:39:57 [auto1.de] INFO: Scrape type for LW85167: 2
2026-03-29 18:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 261d0056-5646-5775-a315-3a07f46f6bd2 with identifier: LW85167
2026-03-29 18:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 261d0056-5646-5775-a315-3a07f46f6bd2 with scrape type 2
2026-03-29 18:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 261d0056-5646-5775-a315-3a07f46f6bd2 with scrape type 2
2026-03-29 18:39:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 261d0056-5646-5775-a315-3a07f46f6bd2, identifier: LW85167
2026-03-29 18:39:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 261d0056-5646-5775-a315-3a07f46f6bd2 with identifier: LW85167
2026-03-29 18:39:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 261d0056-5646-5775-a315-3a07f46f6bd2 with identifier: LW85167
2026-03-29 18:39:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 261d0056-5646-5775-a315-3a07f46f6bd2 with identifier: LW85167 to the API
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-30T15:59:57Z',
'fuel_type': 'petrol',
'id': '261d0056-5646-5775-a315-3a07f46f6bd2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW85167',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Splash',
'odometer': 216673,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-30',
'seller_name': None,
'title': 'Suzuki Splash 1.0 Club',
'transmission': 'manual',
'trim': 'Club',
'year': 2008}
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW85167%27 HTTP/1.1" 200 None
2026-03-29 18:39:57 [auto1.de] INFO: Saving data for LW85167: {'auction_closing_time': 1774886397.0, 'created_time': 1774002760.477739, 'last_price_update_time': 1774809597.679753}
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW85167') HTTP/1.1" 204 0
2026-03-29 18:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:57 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-29 18:39:57 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH78050%27 HTTP/1.1" 200 None
2026-03-29 18:39:57 [auto1.de] INFO: Scrape type for UH78050: 0
2026-03-29 18:39:57 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-29 18:39:57 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL85877%27 HTTP/1.1" 200 None
2026-03-29 18:39:57 [auto1.de] INFO: Scrape type for JL85877: 2
2026-03-29 18:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43ad86a0-6ed1-530a-b59e-086a73c4447a with identifier: JL85877
2026-03-29 18:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43ad86a0-6ed1-530a-b59e-086a73c4447a with scrape type 2
2026-03-29 18:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43ad86a0-6ed1-530a-b59e-086a73c4447a with scrape type 2
2026-03-29 18:39:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43ad86a0-6ed1-530a-b59e-086a73c4447a, identifier: JL85877
2026-03-29 18:39:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43ad86a0-6ed1-530a-b59e-086a73c4447a with identifier: JL85877
2026-03-29 18:39:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43ad86a0-6ed1-530a-b59e-086a73c4447a with identifier: JL85877
2026-03-29 18:39:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43ad86a0-6ed1-530a-b59e-086a73c4447a with identifier: JL85877 to the API
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:34:20Z',
'fuel_type': 'petrol',
'id': '43ad86a0-6ed1-530a-b59e-086a73c4447a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL85877',
'listing': 'auction',
'make': 'BMW',
'model': 'Z4',
'odometer': 12895,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-23',
'seller_name': None,
'title': 'BMW Z4 M40i',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL85877%27 HTTP/1.1" 200 None
2026-03-29 18:39:58 [auto1.de] INFO: Saving data for JL85877: {'auction_closing_time': 1774884860.0, 'created_time': 1774292599.413499, 'last_price_update_time': 1774809598.164751}
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL85877') HTTP/1.1" 204 0
2026-03-29 18:39:58 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-29 18:39:58 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-29 18:39:58 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW13893%27 HTTP/1.1" 200 None
2026-03-29 18:39:58 [auto1.de] INFO: Scrape type for CW13893: 0
2026-03-29 18:39:58 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-29 18:39:58 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR31322%27 HTTP/1.1" 200 None
2026-03-29 18:39:58 [auto1.de] INFO: Scrape type for DR31322: 0
2026-03-29 18:39:58 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ09014%27 HTTP/1.1" 200 None
2026-03-29 18:39:58 [auto1.de] INFO: Scrape type for TJ09014: 2
2026-03-29 18:39:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc1c64b5-5d1d-515f-935e-e862c2967eb0 with identifier: TJ09014
2026-03-29 18:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc1c64b5-5d1d-515f-935e-e862c2967eb0 with scrape type 2
2026-03-29 18:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc1c64b5-5d1d-515f-935e-e862c2967eb0 with scrape type 2
2026-03-29 18:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc1c64b5-5d1d-515f-935e-e862c2967eb0, identifier: TJ09014
2026-03-29 18:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc1c64b5-5d1d-515f-935e-e862c2967eb0 with identifier: TJ09014
2026-03-29 18:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc1c64b5-5d1d-515f-935e-e862c2967eb0 with identifier: TJ09014
2026-03-29 18:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc1c64b5-5d1d-515f-935e-e862c2967eb0 with identifier: TJ09014 to the API
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:10:08Z',
'fuel_type': 'gas',
'id': 'bc1c64b5-5d1d-515f-935e-e862c2967eb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ09014',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 18617,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-16',
'seller_name': None,
'title': 'Dacia Duster 1.0 TCe LPG Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2020}
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ09014%27 HTTP/1.1" 200 None
2026-03-29 18:39:58 [auto1.de] INFO: Saving data for TJ09014: {'auction_closing_time': 1774883408.0, 'created_time': 1774293516.267784, 'last_price_update_time': 1774809598.725754}
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ09014') HTTP/1.1" 204 0
2026-03-29 18:39:58 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:58 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25367%27 HTTP/1.1" 200 None
2026-03-29 18:39:58 [auto1.de] INFO: Scrape type for TA25367: 2
2026-03-29 18:39:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with identifier: TA25367
2026-03-29 18:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with scrape type 2
2026-03-29 18:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with scrape type 2
2026-03-29 18:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf71b327-e82d-5cef-afeb-feb0ae5d4c17, identifier: TA25367
2026-03-29 18:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with identifier: TA25367
2026-03-29 18:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with identifier: TA25367
2026-03-29 18:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with identifier: TA25367 to the API
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:24:25Z',
'fuel_type': 'petrol',
'id': 'cf71b327-e82d-5cef-afeb-feb0ae5d4c17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA25367',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 145336,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-09-30',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 240 Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 1998}
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25367%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Saving data for TA25367: {'auction_closing_time': 1774884265.0, 'created_time': 1774032971.618361, 'last_price_update_time': 1774809599.196507}
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA25367') HTTP/1.1" 204 0
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW70056%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Scrape type for PW70056: 0
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM91292%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Scrape type for SM91292: 2
2026-03-29 18:39:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d6c92ab-2942-5e8d-9cea-a5d483e0694b with identifier: SM91292
2026-03-29 18:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d6c92ab-2942-5e8d-9cea-a5d483e0694b with scrape type 2
2026-03-29 18:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d6c92ab-2942-5e8d-9cea-a5d483e0694b with scrape type 2
2026-03-29 18:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d6c92ab-2942-5e8d-9cea-a5d483e0694b, identifier: SM91292
2026-03-29 18:39:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML19559%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Scrape type for ML19559: 0
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL26903%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Scrape type for AL26903: 0
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL58412%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Scrape type for HL58412: 0
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD35771%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Scrape type for AD35771: 0
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU21621%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Scrape type for KU21621: 0
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR77795%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Scrape type for SR77795: 2
2026-03-29 18:39:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7518fbbd-4d69-5c89-9ef8-db9b44759098 with identifier: SR77795
2026-03-29 18:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7518fbbd-4d69-5c89-9ef8-db9b44759098 with scrape type 2
2026-03-29 18:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7518fbbd-4d69-5c89-9ef8-db9b44759098 with scrape type 2
2026-03-29 18:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7518fbbd-4d69-5c89-9ef8-db9b44759098, identifier: SR77795
2026-03-29 18:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d6c92ab-2942-5e8d-9cea-a5d483e0694b with identifier: SM91292
2026-03-29 18:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d6c92ab-2942-5e8d-9cea-a5d483e0694b with identifier: SM91292
2026-03-29 18:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d6c92ab-2942-5e8d-9cea-a5d483e0694b with identifier: SM91292 to the API
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:19:47Z',
'fuel_type': 'petrol',
'id': '2d6c92ab-2942-5e8d-9cea-a5d483e0694b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM91292',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 136220,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-22',
'seller_name': None,
'title': 'BMW 1er 116i Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2015}
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM91292%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Saving data for SM91292: {'auction_closing_time': 1774883987.0, 'created_time': 1773136782.948044, 'last_price_update_time': 1774809599.806393}
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM91292') HTTP/1.1" 204 0
2026-03-29 18:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7518fbbd-4d69-5c89-9ef8-db9b44759098 with identifier: SR77795
2026-03-29 18:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7518fbbd-4d69-5c89-9ef8-db9b44759098 with identifier: SR77795
2026-03-29 18:40:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7518fbbd-4d69-5c89-9ef8-db9b44759098 with identifier: SR77795 to the API
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:11:45Z',
'fuel_type': 'diesel',
'id': '7518fbbd-4d69-5c89-9ef8-db9b44759098',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR77795',
'listing': 'auction',
'make': 'Ford',
'model': 'Edge',
'odometer': 104063,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-12',
'seller_name': None,
'title': 'Ford Edge 2.0 TDCi Bi-Turbo Vignale 4x4',
'transmission': 'automatic',
'trim': 'Vignale 4x4',
'year': 2017}
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR77795%27 HTTP/1.1" 200 None
2026-03-29 18:40:00 [auto1.de] INFO: Saving data for SR77795: {'auction_closing_time': 1774883505.0, 'created_time': 1773467835.394671, 'last_price_update_time': 1774809600.279399}
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR77795') HTTP/1.1" 204 0
2026-03-29 18:40:00 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-29 18:40:00 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-29 18:40:00 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ71323%27 HTTP/1.1" 200 None
2026-03-29 18:40:00 [auto1.de] INFO: Scrape type for FZ71323: 2
2026-03-29 18:40:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69e83444-8747-5e75-8a01-38773a8e683b with identifier: FZ71323
2026-03-29 18:40:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69e83444-8747-5e75-8a01-38773a8e683b with scrape type 2
2026-03-29 18:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69e83444-8747-5e75-8a01-38773a8e683b with scrape type 2
2026-03-29 18:40:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69e83444-8747-5e75-8a01-38773a8e683b, identifier: FZ71323
2026-03-29 18:40:00 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN78353%27 HTTP/1.1" 200 None
2026-03-29 18:40:00 [auto1.de] INFO: Scrape type for PN78353: 2
2026-03-29 18:40:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2882ead9-6548-5a70-b55a-27c3ca669719 with identifier: PN78353
2026-03-29 18:40:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2882ead9-6548-5a70-b55a-27c3ca669719 with scrape type 2
2026-03-29 18:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2882ead9-6548-5a70-b55a-27c3ca669719 with scrape type 2
2026-03-29 18:40:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2882ead9-6548-5a70-b55a-27c3ca669719, identifier: PN78353
2026-03-29 18:40:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69e83444-8747-5e75-8a01-38773a8e683b with identifier: FZ71323
2026-03-29 18:40:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69e83444-8747-5e75-8a01-38773a8e683b with identifier: FZ71323
2026-03-29 18:40:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69e83444-8747-5e75-8a01-38773a8e683b with identifier: FZ71323 to the API
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:27:08Z',
'fuel_type': 'diesel',
'id': '69e83444-8747-5e75-8a01-38773a8e683b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ71323',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 106775,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-13',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 250 d EDITION lang',
'transmission': 'automatic',
'trim': 'EDITION lang',
'year': 2022}
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ71323%27 HTTP/1.1" 200 None
2026-03-29 18:40:00 [auto1.de] INFO: Saving data for FZ71323: {'auction_closing_time': 1774884428.0, 'created_time': 1774521401.434355, 'last_price_update_time': 1774809600.812324}
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ71323') HTTP/1.1" 204 0
2026-03-29 18:40:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2882ead9-6548-5a70-b55a-27c3ca669719 with identifier: PN78353
2026-03-29 18:40:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2882ead9-6548-5a70-b55a-27c3ca669719 with identifier: PN78353
2026-03-29 18:40:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2882ead9-6548-5a70-b55a-27c3ca669719 with identifier: PN78353 to the API
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:06:47Z',
'fuel_type': 'diesel',
'id': '2882ead9-6548-5a70-b55a-27c3ca669719',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN78353',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 240723,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-24',
'seller_name': None,
'title': 'BMW 5er 525d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2013}
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN78353%27 HTTP/1.1" 200 None
2026-03-29 18:40:01 [auto1.de] INFO: Saving data for PN78353: {'auction_closing_time': 1774883207.0, 'created_time': 1772542908.176571, 'last_price_update_time': 1774809601.225067}
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN78353') HTTP/1.1" 204 0
2026-03-29 18:40:01 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH37368%27 HTTP/1.1" 200 None
2026-03-29 18:40:01 [auto1.de] INFO: Scrape type for AH37368: 2
2026-03-29 18:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8879a54d-d2db-59b0-9d1a-a931b7781478 with identifier: AH37368
2026-03-29 18:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8879a54d-d2db-59b0-9d1a-a931b7781478 with scrape type 2
2026-03-29 18:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8879a54d-d2db-59b0-9d1a-a931b7781478 with scrape type 2
2026-03-29 18:40:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8879a54d-d2db-59b0-9d1a-a931b7781478, identifier: AH37368
2026-03-29 18:40:01 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF52264%27 HTTP/1.1" 200 None
2026-03-29 18:40:01 [auto1.de] INFO: Scrape type for TF52264: 2
2026-03-29 18:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4428ba84-f3e1-5194-bd76-54dfe1495501 with identifier: TF52264
2026-03-29 18:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4428ba84-f3e1-5194-bd76-54dfe1495501 with scrape type 2
2026-03-29 18:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4428ba84-f3e1-5194-bd76-54dfe1495501 with scrape type 2
2026-03-29 18:40:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4428ba84-f3e1-5194-bd76-54dfe1495501, identifier: TF52264
2026-03-29 18:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8879a54d-d2db-59b0-9d1a-a931b7781478 with identifier: AH37368
2026-03-29 18:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8879a54d-d2db-59b0-9d1a-a931b7781478 with identifier: AH37368
2026-03-29 18:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8879a54d-d2db-59b0-9d1a-a931b7781478 with identifier: AH37368 to the API
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:06:07Z',
'fuel_type': 'diesel',
'id': '8879a54d-d2db-59b0-9d1a-a931b7781478',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH37368',
'listing': 'auction',
'make': 'Mazda',
'model': '6',
'odometer': 203164,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-20',
'seller_name': None,
'title': 'Mazda 6 2.2 Turbodiesel Sports-Line',
'transmission': 'automatic',
'trim': 'Sports-Line',
'year': 2014}
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH37368%27 HTTP/1.1" 200 None
2026-03-29 18:40:01 [auto1.de] INFO: Saving data for AH37368: {'auction_closing_time': 1774883167.0, 'created_time': 1773859368.864012, 'last_price_update_time': 1774809601.861602}
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH37368') HTTP/1.1" 204 0
2026-03-29 18:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4428ba84-f3e1-5194-bd76-54dfe1495501 with identifier: TF52264
2026-03-29 18:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4428ba84-f3e1-5194-bd76-54dfe1495501 with identifier: TF52264
2026-03-29 18:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4428ba84-f3e1-5194-bd76-54dfe1495501 with identifier: TF52264 to the API
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:19:57Z',
'fuel_type': 'diesel',
'id': '4428ba84-f3e1-5194-bd76-54dfe1495501',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF52264',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 150948,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-23',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2011}
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF52264%27 HTTP/1.1" 200 None
2026-03-29 18:40:02 [auto1.de] INFO: Saving data for TF52264: {'auction_closing_time': 1774883997.0, 'created_time': 1773400604.75493, 'last_price_update_time': 1774809602.296057}
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF52264') HTTP/1.1" 204 0
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF84485%27 HTTP/1.1" 200 None
2026-03-29 18:40:02 [auto1.de] INFO: Scrape type for EF84485: 2
2026-03-29 18:40:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c982a3e-2731-5426-8c0b-064a6c424c1f with identifier: EF84485
2026-03-29 18:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c982a3e-2731-5426-8c0b-064a6c424c1f with scrape type 2
2026-03-29 18:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c982a3e-2731-5426-8c0b-064a6c424c1f with scrape type 2
2026-03-29 18:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c982a3e-2731-5426-8c0b-064a6c424c1f, identifier: EF84485
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-29 18:40:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c982a3e-2731-5426-8c0b-064a6c424c1f with identifier: EF84485
2026-03-29 18:40:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c982a3e-2731-5426-8c0b-064a6c424c1f with identifier: EF84485
2026-03-29 18:40:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c982a3e-2731-5426-8c0b-064a6c424c1f with identifier: EF84485 to the API
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:48:00Z',
'fuel_type': 'diesel',
'id': '0c982a3e-2731-5426-8c0b-064a6c424c1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF84485',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-05-31',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 220 CDI Ambiente',
'transmission': 'automatic',
'trim': 'Ambiente',
'year': 2001}
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF84485%27 HTTP/1.1" 200 None
2026-03-29 18:40:02 [auto1.de] INFO: Saving data for EF84485: {'auction_closing_time': 1774885680.0, 'created_time': 1773303603.844099, 'last_price_update_time': 1774809602.752623}
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF84485') HTTP/1.1" 204 0
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT68659%27 HTTP/1.1" 200 None
2026-03-29 18:40:02 [auto1.de] INFO: Scrape type for TT68659: 0
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG87318%27 HTTP/1.1" 200 None
2026-03-29 18:40:02 [auto1.de] INFO: Scrape type for EG87318: 0
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF48601%27 HTTP/1.1" 200 None
2026-03-29 18:40:02 [auto1.de] INFO: Scrape type for HF48601: 0
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC45623%27 HTTP/1.1" 200 None
2026-03-29 18:40:02 [auto1.de] INFO: Scrape type for WC45623: 0
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG77695%27 HTTP/1.1" 200 None
2026-03-29 18:40:02 [auto1.de] INFO: Scrape type for EG77695: 2
2026-03-29 18:40:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ea253c7-168e-5368-afdd-be01a1b6f0e4 with identifier: EG77695
2026-03-29 18:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ea253c7-168e-5368-afdd-be01a1b6f0e4 with scrape type 2
2026-03-29 18:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ea253c7-168e-5368-afdd-be01a1b6f0e4 with scrape type 2
2026-03-29 18:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ea253c7-168e-5368-afdd-be01a1b6f0e4, identifier: EG77695
2026-03-29 18:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ea253c7-168e-5368-afdd-be01a1b6f0e4 with identifier: EG77695
2026-03-29 18:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ea253c7-168e-5368-afdd-be01a1b6f0e4 with identifier: EG77695
2026-03-29 18:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ea253c7-168e-5368-afdd-be01a1b6f0e4 with identifier: EG77695 to the API
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:14:21Z',
'fuel_type': 'diesel',
'id': '1ea253c7-168e-5368-afdd-be01a1b6f0e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG77695',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 301136,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-17',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG77695%27 HTTP/1.1" 200 None
2026-03-29 18:40:03 [auto1.de] INFO: Saving data for EG77695: {'auction_closing_time': 1774883661.0, 'created_time': 1774118551.779824, 'last_price_update_time': 1774809603.36851}
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG77695') HTTP/1.1" 204 0
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: VL71663
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA73417%27 HTTP/1.1" 200 None
2026-03-29 18:40:03 [auto1.de] INFO: Scrape type for BA73417: 2
2026-03-29 18:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d1e964c-8882-515d-b2cd-eb22d01542e7 with identifier: BA73417
2026-03-29 18:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d1e964c-8882-515d-b2cd-eb22d01542e7 with scrape type 2
2026-03-29 18:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d1e964c-8882-515d-b2cd-eb22d01542e7 with scrape type 2
2026-03-29 18:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d1e964c-8882-515d-b2cd-eb22d01542e7, identifier: BA73417
2026-03-29 18:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d1e964c-8882-515d-b2cd-eb22d01542e7 with identifier: BA73417
2026-03-29 18:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d1e964c-8882-515d-b2cd-eb22d01542e7 with identifier: BA73417
2026-03-29 18:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d1e964c-8882-515d-b2cd-eb22d01542e7 with identifier: BA73417 to the API
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:40:43Z',
'fuel_type': 'diesel',
'id': '9d1e964c-8882-515d-b2cd-eb22d01542e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA73417',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Freelander',
'odometer': 161202,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-08',
'seller_name': None,
'title': 'Land Rover Freelander 2.2 Td4 E',
'transmission': 'manual',
'trim': 'E',
'year': 2012}
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA73417%27 HTTP/1.1" 200 None
2026-03-29 18:40:03 [auto1.de] INFO: Saving data for BA73417: {'auction_closing_time': 1774885243.0, 'created_time': 1774294210.947705, 'last_price_update_time': 1774809603.862106}
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA73417') HTTP/1.1" 204 0
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH26233%27 HTTP/1.1" 200 None
2026-03-29 18:40:03 [auto1.de] INFO: Scrape type for VH26233: 0
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW23670%27 HTTP/1.1" 200 None
2026-03-29 18:40:04 [auto1.de] INFO: Scrape type for DW23670: 2
2026-03-29 18:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09229703-dce0-55c9-9182-c8b672313250 with identifier: DW23670
2026-03-29 18:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09229703-dce0-55c9-9182-c8b672313250 with scrape type 2
2026-03-29 18:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09229703-dce0-55c9-9182-c8b672313250 with scrape type 2
2026-03-29 18:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09229703-dce0-55c9-9182-c8b672313250, identifier: DW23670
2026-03-29 18:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09229703-dce0-55c9-9182-c8b672313250 with identifier: DW23670
2026-03-29 18:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09229703-dce0-55c9-9182-c8b672313250 with identifier: DW23670
2026-03-29 18:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09229703-dce0-55c9-9182-c8b672313250 with identifier: DW23670 to the API
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:50:11Z',
'fuel_type': 'diesel',
'id': '09229703-dce0-55c9-9182-c8b672313250',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW23670',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 50519,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-05',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
'transmission': 'manual',
'trim': '350 L3 Trend',
'year': 2023}
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW23670%27 HTTP/1.1" 200 None
2026-03-29 18:40:04 [auto1.de] INFO: Saving data for DW23670: {'auction_closing_time': 1774885811.0, 'created_time': 1774607676.978056, 'last_price_update_time': 1774809604.459787}
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW23670') HTTP/1.1" 204 0
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-29 18:40:04 [auto1.de] INFO: Scrape type for XN26192: 2
2026-03-29 18:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with identifier: XN26192
2026-03-29 18:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with scrape type 2
2026-03-29 18:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with scrape type 2
2026-03-29 18:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3, identifier: XN26192
2026-03-29 18:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with identifier: XN26192
2026-03-29 18:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with identifier: XN26192
2026-03-29 18:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with identifier: XN26192 to the API
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:09:52Z',
'fuel_type': 'diesel',
'id': 'a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN26192',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 228004,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-27',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2012}
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-29 18:40:04 [auto1.de] INFO: Saving data for XN26192: {'auction_closing_time': 1774883392.0, 'created_time': 1773830829.297293, 'last_price_update_time': 1774809604.924515}
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN26192') HTTP/1.1" 204 0
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA19353%27 HTTP/1.1" 200 None
2026-03-29 18:40:04 [auto1.de] INFO: Scrape type for WA19353: 2
2026-03-29 18:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872 with identifier: WA19353
2026-03-29 18:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872 with scrape type 2
2026-03-29 18:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872 with scrape type 2
2026-03-29 18:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872, identifier: WA19353
2026-03-29 18:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872 with identifier: WA19353
2026-03-29 18:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872 with identifier: WA19353
2026-03-29 18:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872 with identifier: WA19353 to the API
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:14:59Z',
'fuel_type': 'petrol',
'id': 'a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA19353',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 109832,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-29',
'seller_name': None,
'title': 'Audi A1 Sportback 1.0 TFSI',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA19353%27 HTTP/1.1" 200 None
2026-03-29 18:40:05 [auto1.de] INFO: Saving data for WA19353: {'auction_closing_time': 1774883699.0, 'created_time': 1774522065.347772, 'last_price_update_time': 1774809605.332124}
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA19353') HTTP/1.1" 204 0
2026-03-29 18:40:05 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13477%27 HTTP/1.1" 200 None
2026-03-29 18:40:05 [auto1.de] INFO: Scrape type for UY13477: 2
2026-03-29 18:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with identifier: UY13477
2026-03-29 18:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with scrape type 2
2026-03-29 18:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with scrape type 2
2026-03-29 18:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4, identifier: UY13477
2026-03-29 18:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with identifier: UY13477
2026-03-29 18:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with identifier: UY13477
2026-03-29 18:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with identifier: UY13477 to the API
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:57:42Z',
'fuel_type': 'petrol',
'id': '4bf5f630-2a72-5211-aa24-f6dda42ac5a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY13477',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 156419,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-04',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13477%27 HTTP/1.1" 200 None
2026-03-29 18:40:05 [auto1.de] INFO: Saving data for UY13477: {'auction_closing_time': 1774886262.0, 'created_time': 1774608335.531029, 'last_price_update_time': 1774809605.804599}
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY13477') HTTP/1.1" 204 0
2026-03-29 18:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:05 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-29 18:40:05 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59511%27 HTTP/1.1" 200 None
2026-03-29 18:40:05 [auto1.de] INFO: Scrape type for GM59511: 2
2026-03-29 18:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with identifier: GM59511
2026-03-29 18:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with scrape type 2
2026-03-29 18:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with scrape type 2
2026-03-29 18:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06, identifier: GM59511
2026-03-29 18:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with identifier: GM59511
2026-03-29 18:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with identifier: GM59511
2026-03-29 18:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with identifier: GM59511 to the API
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:28:28Z',
'fuel_type': 'petrol',
'id': '1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM59511',
'listing': 'auction',
'make': 'Nissan',
'model': 'Pulsar',
'odometer': 202277,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-25',
'seller_name': None,
'title': 'Nissan Pulsar 1.6 Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2018}
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59511%27 HTTP/1.1" 200 None
2026-03-29 18:40:06 [auto1.de] INFO: Saving data for GM59511: {'auction_closing_time': 1774884508.0, 'created_time': 1773772236.151639, 'last_price_update_time': 1774809606.345309}
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM59511') HTTP/1.1" 204 0
2026-03-29 18:40:06 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR46383%27 HTTP/1.1" 200 None
2026-03-29 18:40:06 [auto1.de] INFO: Scrape type for RR46383: 0
2026-03-29 18:40:06 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL15649%27 HTTP/1.1" 200 None
2026-03-29 18:40:06 [auto1.de] INFO: Scrape type for ZL15649: 2
2026-03-29 18:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with identifier: ZL15649
2026-03-29 18:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with scrape type 2
2026-03-29 18:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with scrape type 2
2026-03-29 18:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20, identifier: ZL15649
2026-03-29 18:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with identifier: ZL15649
2026-03-29 18:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with identifier: ZL15649
2026-03-29 18:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with identifier: ZL15649 to the API
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:32:18Z',
'fuel_type': 'diesel',
'id': 'ab86ac41-15e4-5a0a-95d5-ebcacf93ad20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL15649',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 158866,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-28',
'seller_name': None,
'title': 'Dacia Duster 1.5 Blue dCi Prestige 4x4',
'transmission': 'manual',
'trim': 'Prestige 4x4',
'year': 2019}
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL15649%27 HTTP/1.1" 200 None
2026-03-29 18:40:06 [auto1.de] INFO: Saving data for ZL15649: {'auction_closing_time': 1774884738.0, 'created_time': 1774608062.530867, 'last_price_update_time': 1774809606.796897}
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL15649') HTTP/1.1" 204 0
2026-03-29 18:40:06 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:06 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 11 pages/min), scraped 819 items (at 106 items/min)
2026-03-29 18:40:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:40:06 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-29 18:40:06 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL86865%27 HTTP/1.1" 200 None
2026-03-29 18:40:06 [auto1.de] INFO: Scrape type for BL86865: 2
2026-03-29 18:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2000dfd-135c-5f32-97bd-030268e7db8f with identifier: BL86865
2026-03-29 18:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2000dfd-135c-5f32-97bd-030268e7db8f with scrape type 2
2026-03-29 18:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2000dfd-135c-5f32-97bd-030268e7db8f with scrape type 2
2026-03-29 18:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2000dfd-135c-5f32-97bd-030268e7db8f, identifier: BL86865
2026-03-29 18:40:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2000dfd-135c-5f32-97bd-030268e7db8f with identifier: BL86865
2026-03-29 18:40:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2000dfd-135c-5f32-97bd-030268e7db8f with identifier: BL86865
2026-03-29 18:40:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2000dfd-135c-5f32-97bd-030268e7db8f with identifier: BL86865 to the API
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:15:35Z',
'fuel_type': 'petrol',
'id': 'a2000dfd-135c-5f32-97bd-030268e7db8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL86865',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 148314,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-27',
'seller_name': None,
'title': 'Renault Clio 0.9 Energy Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2016}
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL86865%27 HTTP/1.1" 200 None
2026-03-29 18:40:07 [auto1.de] INFO: Saving data for BL86865: {'auction_closing_time': 1774883735.0, 'created_time': 1774521355.092971, 'last_price_update_time': 1774809607.284588}
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL86865') HTTP/1.1" 204 0
2026-03-29 18:40:07 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-29 18:40:07 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR74961%27 HTTP/1.1" 200 None
2026-03-29 18:40:07 [auto1.de] INFO: Scrape type for TR74961: 0
2026-03-29 18:40:07 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-29 18:40:07 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR51449%27 HTTP/1.1" 200 None
2026-03-29 18:40:07 [auto1.de] INFO: Scrape type for SR51449: 2
2026-03-29 18:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with identifier: SR51449
2026-03-29 18:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with scrape type 2
2026-03-29 18:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with scrape type 2
2026-03-29 18:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c21292a-26b5-5ba9-a20f-dfc5c034abd2, identifier: SR51449
2026-03-29 18:40:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with identifier: SR51449
2026-03-29 18:40:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with identifier: SR51449
2026-03-29 18:40:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with identifier: SR51449 to the API
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:51:31Z',
'fuel_type': 'gas',
'id': '8c21292a-26b5-5ba9-a20f-dfc5c034abd2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR51449',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 165129,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-04',
'seller_name': None,
'title': 'Audi A4 2.0 TFSI g-tron Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR51449%27 HTTP/1.1" 200 None
2026-03-29 18:40:07 [auto1.de] INFO: Saving data for SR51449: {'auction_closing_time': 1774885891.0, 'created_time': 1773772563.981637, 'last_price_update_time': 1774809607.738265}
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR51449') HTTP/1.1" 204 0
2026-03-29 18:40:07 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-29 18:40:07 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN73396%27 HTTP/1.1" 200 None
2026-03-29 18:40:07 [auto1.de] INFO: Scrape type for EN73396: 2
2026-03-29 18:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48bb1e7b-555c-54bf-be9e-76d810558871 with identifier: EN73396
2026-03-29 18:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48bb1e7b-555c-54bf-be9e-76d810558871 with scrape type 2
2026-03-29 18:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48bb1e7b-555c-54bf-be9e-76d810558871 with scrape type 2
2026-03-29 18:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48bb1e7b-555c-54bf-be9e-76d810558871, identifier: EN73396
2026-03-29 18:40:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48bb1e7b-555c-54bf-be9e-76d810558871 with identifier: EN73396
2026-03-29 18:40:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48bb1e7b-555c-54bf-be9e-76d810558871 with identifier: EN73396
2026-03-29 18:40:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48bb1e7b-555c-54bf-be9e-76d810558871 with identifier: EN73396 to the API
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 55,
'expiration_date': '2026-03-30T15:56:33Z',
'fuel_type': 'diesel',
'id': '48bb1e7b-555c-54bf-be9e-76d810558871',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN73396',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 127811,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-29',
'seller_name': None,
'title': 'Smart fortwo 0.8 CDI Passion',
'transmission': 'automatic',
'trim': 'Passion',
'year': 2011}
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN73396%27 HTTP/1.1" 200 None
2026-03-29 18:40:08 [auto1.de] INFO: Saving data for EN73396: {'auction_closing_time': 1774886193.0, 'created_time': 1774521339.526447, 'last_price_update_time': 1774809608.148479}
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN73396') HTTP/1.1" 204 0
2026-03-29 18:40:08 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-29 18:40:08 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB52035%27 HTTP/1.1" 200 None
2026-03-29 18:40:08 [auto1.de] INFO: Scrape type for CB52035: 0
2026-03-29 18:40:08 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD56030%27 HTTP/1.1" 200 None
2026-03-29 18:40:08 [auto1.de] INFO: Scrape type for XD56030: 2
2026-03-29 18:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 920fc047-d5f4-5b40-be89-e2eae8ec086d with identifier: XD56030
2026-03-29 18:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 920fc047-d5f4-5b40-be89-e2eae8ec086d with scrape type 2
2026-03-29 18:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 920fc047-d5f4-5b40-be89-e2eae8ec086d with scrape type 2
2026-03-29 18:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 920fc047-d5f4-5b40-be89-e2eae8ec086d, identifier: XD56030
2026-03-29 18:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 920fc047-d5f4-5b40-be89-e2eae8ec086d with identifier: XD56030
2026-03-29 18:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 920fc047-d5f4-5b40-be89-e2eae8ec086d with identifier: XD56030
2026-03-29 18:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 920fc047-d5f4-5b40-be89-e2eae8ec086d with identifier: XD56030 to the API
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:16:47Z',
'fuel_type': 'petrol',
'id': '920fc047-d5f4-5b40-be89-e2eae8ec086d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD56030',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 115828,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-17',
'seller_name': None,
'title': 'Hyundai i30 1.4 FIFA World Cup Edition',
'transmission': 'manual',
'trim': 'FIFA World Cup Edition',
'year': 2014}
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD56030%27 HTTP/1.1" 200 None
2026-03-29 18:40:08 [auto1.de] INFO: Saving data for XD56030: {'auction_closing_time': 1774883807.0, 'created_time': 1773134834.795738, 'last_price_update_time': 1774809608.60584}
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD56030') HTTP/1.1" 204 0
2026-03-29 18:40:08 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-29 18:40:08 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR53906%27 HTTP/1.1" 200 None
2026-03-29 18:40:08 [auto1.de] INFO: Scrape type for BR53906: 0
2026-03-29 18:40:08 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89680%27 HTTP/1.1" 200 None
2026-03-29 18:40:08 [auto1.de] INFO: Scrape type for CC89680: 2
2026-03-29 18:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e630a218-7e39-5e7d-9622-3e994f3d8c27 with identifier: CC89680
2026-03-29 18:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e630a218-7e39-5e7d-9622-3e994f3d8c27 with scrape type 2
2026-03-29 18:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e630a218-7e39-5e7d-9622-3e994f3d8c27 with scrape type 2
2026-03-29 18:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e630a218-7e39-5e7d-9622-3e994f3d8c27, identifier: CC89680
2026-03-29 18:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e630a218-7e39-5e7d-9622-3e994f3d8c27 with identifier: CC89680
2026-03-29 18:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e630a218-7e39-5e7d-9622-3e994f3d8c27 with identifier: CC89680
2026-03-29 18:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e630a218-7e39-5e7d-9622-3e994f3d8c27 with identifier: CC89680 to the API
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:27:22Z',
'fuel_type': 'diesel',
'id': 'e630a218-7e39-5e7d-9622-3e994f3d8c27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC89680',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 150208,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-01',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion BlueMotion Tech',
'year': 2012}
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89680%27 HTTP/1.1" 200 None
2026-03-29 18:40:09 [auto1.de] INFO: Saving data for CC89680: {'auction_closing_time': 1774884442.0, 'created_time': 1773775349.992967, 'last_price_update_time': 1774809609.203459}
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC89680') HTTP/1.1" 204 0
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP12343%27 HTTP/1.1" 200 None
2026-03-29 18:40:09 [auto1.de] INFO: Scrape type for UP12343: 0
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF42870%27 HTTP/1.1" 200 None
2026-03-29 18:40:09 [auto1.de] INFO: Scrape type for YF42870: 2
2026-03-29 18:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with identifier: YF42870
2026-03-29 18:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with scrape type 2
2026-03-29 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with scrape type 2
2026-03-29 18:40:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22fa2fb4-7dde-567c-bf1f-357452f9d8c5, identifier: YF42870
2026-03-29 18:40:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with identifier: YF42870
2026-03-29 18:40:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with identifier: YF42870
2026-03-29 18:40:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with identifier: YF42870 to the API
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:41:40Z',
'fuel_type': 'diesel',
'id': '22fa2fb4-7dde-567c-bf1f-357452f9d8c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF42870',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 236141,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-11',
'seller_name': None,
'title': 'BMW 5er 530d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF42870%27 HTTP/1.1" 200 None
2026-03-29 18:40:09 [auto1.de] INFO: Saving data for YF42870: {'auction_closing_time': 1774885300.0, 'created_time': 1773859512.128462, 'last_price_update_time': 1774809609.711205}
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF42870') HTTP/1.1" 204 0
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX02891%27 HTTP/1.1" 200 None
2026-03-29 18:40:09 [auto1.de] INFO: Scrape type for MX02891: 0
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ98191%27 HTTP/1.1" 200 None
2026-03-29 18:40:09 [auto1.de] INFO: Scrape type for FJ98191: 0
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN55022%27 HTTP/1.1" 200 None
2026-03-29 18:40:09 [auto1.de] INFO: Scrape type for JN55022: 2
2026-03-29 18:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3340f424-39bb-5272-bff3-6733715f9dcb with identifier: JN55022
2026-03-29 18:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3340f424-39bb-5272-bff3-6733715f9dcb with scrape type 2
2026-03-29 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3340f424-39bb-5272-bff3-6733715f9dcb with scrape type 2
2026-03-29 18:40:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3340f424-39bb-5272-bff3-6733715f9dcb, identifier: JN55022
2026-03-29 18:40:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3340f424-39bb-5272-bff3-6733715f9dcb with identifier: JN55022
2026-03-29 18:40:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3340f424-39bb-5272-bff3-6733715f9dcb with identifier: JN55022
2026-03-29 18:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3340f424-39bb-5272-bff3-6733715f9dcb with identifier: JN55022 to the API
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:20:37Z',
'fuel_type': 'diesel',
'id': '3340f424-39bb-5272-bff3-6733715f9dcb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN55022',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 205598,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-31',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS 4x4',
'transmission': 'automatic',
'trim': 'RS 4x4',
'year': 2017}
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN55022%27 HTTP/1.1" 200 None
2026-03-29 18:40:10 [auto1.de] INFO: Saving data for JN55022: {'auction_closing_time': 1774884037.0, 'created_time': 1774521450.307439, 'last_price_update_time': 1774809610.258552}
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN55022') HTTP/1.1" 204 0
2026-03-29 18:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:10 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG10067%27 HTTP/1.1" 200 None
2026-03-29 18:40:10 [auto1.de] INFO: Scrape type for SG10067: 0
2026-03-29 18:40:10 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-29 18:40:10 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB55712%27 HTTP/1.1" 200 None
2026-03-29 18:40:10 [auto1.de] INFO: Scrape type for KB55712: 0
2026-03-29 18:40:10 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM77424%27 HTTP/1.1" 200 None
2026-03-29 18:40:10 [auto1.de] INFO: Scrape type for EM77424: 2
2026-03-29 18:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a506948-05d1-5a08-bf36-eba8c20d31df with identifier: EM77424
2026-03-29 18:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a506948-05d1-5a08-bf36-eba8c20d31df with scrape type 2
2026-03-29 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a506948-05d1-5a08-bf36-eba8c20d31df with scrape type 2
2026-03-29 18:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a506948-05d1-5a08-bf36-eba8c20d31df, identifier: EM77424
2026-03-29 18:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a506948-05d1-5a08-bf36-eba8c20d31df with identifier: EM77424
2026-03-29 18:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a506948-05d1-5a08-bf36-eba8c20d31df with identifier: EM77424
2026-03-29 18:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a506948-05d1-5a08-bf36-eba8c20d31df with identifier: EM77424 to the API
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:07:21Z',
'fuel_type': 'petrol',
'id': '8a506948-05d1-5a08-bf36-eba8c20d31df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM77424',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 50980,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-06',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM77424%27 HTTP/1.1" 200 None
2026-03-29 18:40:10 [auto1.de] INFO: Saving data for EM77424: {'auction_closing_time': 1774883241.0, 'created_time': 1774549867.436668, 'last_price_update_time': 1774809610.676381}
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM77424') HTTP/1.1" 204 0
2026-03-29 18:40:10 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-29 18:40:10 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-29 18:40:10 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-29 18:40:10 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-29 18:40:10 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG24182%27 HTTP/1.1" 200 None
2026-03-29 18:40:10 [auto1.de] INFO: Scrape type for DG24182: 0
2026-03-29 18:40:10 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73879%27 HTTP/1.1" 200 None
2026-03-29 18:40:10 [auto1.de] INFO: Scrape type for CV73879: 2
2026-03-29 18:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3b4fbfb-1b1c-55b1-99ca-614b77f75375 with identifier: CV73879
2026-03-29 18:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3b4fbfb-1b1c-55b1-99ca-614b77f75375 with scrape type 2
2026-03-29 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3b4fbfb-1b1c-55b1-99ca-614b77f75375 with scrape type 2
2026-03-29 18:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3b4fbfb-1b1c-55b1-99ca-614b77f75375, identifier: CV73879
2026-03-29 18:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3b4fbfb-1b1c-55b1-99ca-614b77f75375 with identifier: CV73879
2026-03-29 18:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3b4fbfb-1b1c-55b1-99ca-614b77f75375 with identifier: CV73879
2026-03-29 18:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3b4fbfb-1b1c-55b1-99ca-614b77f75375 with identifier: CV73879 to the API
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:30:27Z',
'fuel_type': 'diesel',
'id': 'e3b4fbfb-1b1c-55b1-99ca-614b77f75375',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV73879',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Citan',
'odometer': 197614,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-01',
'seller_name': None,
'title': 'Mercedes-Benz Citan 111 CDI extralang Tourer Edition',
'transmission': 'manual',
'trim': 'extralang Tourer Edition',
'year': 2017}
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73879%27 HTTP/1.1" 200 None
2026-03-29 18:40:11 [auto1.de] INFO: Saving data for CV73879: {'auction_closing_time': 1774884627.0, 'created_time': 1774521331.716074, 'last_price_update_time': 1774809611.12553}
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV73879') HTTP/1.1" 204 0
2026-03-29 18:40:11 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH69099%27 HTTP/1.1" 200 None
2026-03-29 18:40:11 [auto1.de] INFO: Scrape type for CH69099: 0
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17910%27 HTTP/1.1" 200 None
2026-03-29 18:40:11 [auto1.de] INFO: Scrape type for WL17910: 0
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM25348%27 HTTP/1.1" 200 None
2026-03-29 18:40:11 [auto1.de] INFO: Scrape type for PM25348: 0
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS03842%27 HTTP/1.1" 200 None
2026-03-29 18:40:11 [auto1.de] INFO: Scrape type for HS03842: 0
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS26605%27 HTTP/1.1" 200 None
2026-03-29 18:40:11 [auto1.de] INFO: Scrape type for BS26605: 2
2026-03-29 18:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with identifier: BS26605
2026-03-29 18:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with scrape type 2
2026-03-29 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with scrape type 2
2026-03-29 18:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 341d79e4-ad46-5a01-9a2a-a1d12f14feaf, identifier: BS26605
2026-03-29 18:40:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with identifier: BS26605
2026-03-29 18:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with identifier: BS26605
2026-03-29 18:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with identifier: BS26605 to the API
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:48:43Z',
'fuel_type': 'diesel',
'id': '341d79e4-ad46-5a01-9a2a-a1d12f14feaf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS26605',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 219300,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-18',
'seller_name': None,
'title': 'BMW X1 xDrive 25d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2018}
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS26605%27 HTTP/1.1" 200 None
2026-03-29 18:40:11 [auto1.de] INFO: Saving data for BS26605: {'auction_closing_time': 1774885723.0, 'created_time': 1773776013.509787, 'last_price_update_time': 1774809611.790808}
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS26605') HTTP/1.1" 204 0
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS09258%27 HTTP/1.1" 200 None
2026-03-29 18:40:11 [auto1.de] INFO: Scrape type for JS09258: 2
2026-03-29 18:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28d4a52d-59b9-5655-8331-910348559829 with identifier: JS09258
2026-03-29 18:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28d4a52d-59b9-5655-8331-910348559829 with scrape type 2
2026-03-29 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28d4a52d-59b9-5655-8331-910348559829 with scrape type 2
2026-03-29 18:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28d4a52d-59b9-5655-8331-910348559829, identifier: JS09258
2026-03-29 18:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28d4a52d-59b9-5655-8331-910348559829 with identifier: JS09258
2026-03-29 18:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28d4a52d-59b9-5655-8331-910348559829 with identifier: JS09258
2026-03-29 18:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28d4a52d-59b9-5655-8331-910348559829 with identifier: JS09258 to the API
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:38:38Z',
'fuel_type': 'diesel',
'id': '28d4a52d-59b9-5655-8331-910348559829',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS09258',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 159105,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-30',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Scout 4x4',
'transmission': 'automatic',
'trim': 'Scout 4x4',
'year': 2016}
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS09258%27 HTTP/1.1" 200 None
2026-03-29 18:40:12 [auto1.de] INFO: Saving data for JS09258: {'auction_closing_time': 1774885118.0, 'created_time': 1774118556.004386, 'last_price_update_time': 1774809612.211978}
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS09258') HTTP/1.1" 204 0
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD60404%27 HTTP/1.1" 200 None
2026-03-29 18:40:12 [auto1.de] INFO: Scrape type for GD60404: 2
2026-03-29 18:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66780655-43eb-5105-8a6f-d6ffb7db9def with identifier: GD60404
2026-03-29 18:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66780655-43eb-5105-8a6f-d6ffb7db9def with scrape type 2
2026-03-29 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66780655-43eb-5105-8a6f-d6ffb7db9def with scrape type 2
2026-03-29 18:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66780655-43eb-5105-8a6f-d6ffb7db9def, identifier: GD60404
2026-03-29 18:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66780655-43eb-5105-8a6f-d6ffb7db9def with identifier: GD60404
2026-03-29 18:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66780655-43eb-5105-8a6f-d6ffb7db9def with identifier: GD60404
2026-03-29 18:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66780655-43eb-5105-8a6f-d6ffb7db9def with identifier: GD60404 to the API
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:31:34Z',
'fuel_type': 'petrol',
'id': '66780655-43eb-5105-8a6f-d6ffb7db9def',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD60404',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 87225,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-23',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 220 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2019}
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD60404%27 HTTP/1.1" 200 None
2026-03-29 18:40:12 [auto1.de] INFO: Saving data for GD60404: {'auction_closing_time': 1774884694.0, 'created_time': 1774290920.610145, 'last_price_update_time': 1774809612.688137}
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD60404') HTTP/1.1" 204 0
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ67594%27 HTTP/1.1" 200 None
2026-03-29 18:40:12 [auto1.de] INFO: Scrape type for TJ67594: 2
2026-03-29 18:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eef27ea-db7d-5f8b-b6af-a18637003549 with identifier: TJ67594
2026-03-29 18:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eef27ea-db7d-5f8b-b6af-a18637003549 with scrape type 2
2026-03-29 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eef27ea-db7d-5f8b-b6af-a18637003549 with scrape type 2
2026-03-29 18:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6eef27ea-db7d-5f8b-b6af-a18637003549, identifier: TJ67594
2026-03-29 18:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6eef27ea-db7d-5f8b-b6af-a18637003549 with identifier: TJ67594
2026-03-29 18:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6eef27ea-db7d-5f8b-b6af-a18637003549 with identifier: TJ67594
2026-03-29 18:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6eef27ea-db7d-5f8b-b6af-a18637003549 with identifier: TJ67594 to the API
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:18:04Z',
'fuel_type': 'petrol',
'id': '6eef27ea-db7d-5f8b-b6af-a18637003549',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ67594',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 80681,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-30',
'seller_name': None,
'title': 'Ford S-Max 1.5 EcoBoost ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2018}
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ67594%27 HTTP/1.1" 200 None
2026-03-29 18:40:13 [auto1.de] INFO: Saving data for TJ67594: {'auction_closing_time': 1774883884.0, 'created_time': 1773859362.653042, 'last_price_update_time': 1774809613.240303}
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ67594') HTTP/1.1" 204 0
2026-03-29 18:40:13 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-29 18:40:13 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-29 18:40:13 [auto1.de] INFO: Scrape type for TL45864: 2
2026-03-29 18:40:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with identifier: TL45864
2026-03-29 18:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with scrape type 2
2026-03-29 18:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with scrape type 2
2026-03-29 18:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9912a6b1-651e-56a7-ba17-8ee1a975cea1, identifier: TL45864
2026-03-29 18:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with identifier: TL45864
2026-03-29 18:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with identifier: TL45864
2026-03-29 18:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with identifier: TL45864 to the API
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:08:23Z',
'fuel_type': 'petrol',
'id': '9912a6b1-651e-56a7-ba17-8ee1a975cea1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL45864',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 100299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-30',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.0 TSI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2017}
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-29 18:40:13 [auto1.de] INFO: Saving data for TL45864: {'auction_closing_time': 1774883303.0, 'created_time': 1774607640.727272, 'last_price_update_time': 1774809613.71761}
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL45864') HTTP/1.1" 204 0
2026-03-29 18:40:13 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-29 18:40:13 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF09149%27 HTTP/1.1" 200 None
2026-03-29 18:40:13 [auto1.de] INFO: Scrape type for CF09149: 0
2026-03-29 18:40:13 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT43931%27 HTTP/1.1" 200 None
2026-03-29 18:40:13 [auto1.de] INFO: Scrape type for VT43931: 2
2026-03-29 18:40:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0262f5e3-9373-5b5a-92fc-83d43777773a with identifier: VT43931
2026-03-29 18:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0262f5e3-9373-5b5a-92fc-83d43777773a with scrape type 2
2026-03-29 18:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0262f5e3-9373-5b5a-92fc-83d43777773a with scrape type 2
2026-03-29 18:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0262f5e3-9373-5b5a-92fc-83d43777773a, identifier: VT43931
2026-03-29 18:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0262f5e3-9373-5b5a-92fc-83d43777773a with identifier: VT43931
2026-03-29 18:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0262f5e3-9373-5b5a-92fc-83d43777773a with identifier: VT43931
2026-03-29 18:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0262f5e3-9373-5b5a-92fc-83d43777773a with identifier: VT43931 to the API
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 201,
'expiration_date': '2026-03-30T15:35:10Z',
'fuel_type': 'diesel',
'id': '0262f5e3-9373-5b5a-92fc-83d43777773a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT43931',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 47470,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-25',
'seller_name': None,
'title': 'BMW 5er 520d Mild-Hybrid M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2023}
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT43931%27 HTTP/1.1" 200 None
2026-03-29 18:40:14 [auto1.de] INFO: Saving data for VT43931: {'auction_closing_time': 1774884910.0, 'created_time': 1774521839.610755, 'last_price_update_time': 1774809614.163464}
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT43931') HTTP/1.1" 204 0
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV28684%27 HTTP/1.1" 200 None
2026-03-29 18:40:14 [auto1.de] INFO: Scrape type for GV28684: 0
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU47356%27 HTTP/1.1" 200 None
2026-03-29 18:40:14 [auto1.de] INFO: Scrape type for MU47356: 2
2026-03-29 18:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 413eb418-b3b2-5960-868b-079f17a54777 with identifier: MU47356
2026-03-29 18:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 413eb418-b3b2-5960-868b-079f17a54777 with scrape type 2
2026-03-29 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 413eb418-b3b2-5960-868b-079f17a54777 with scrape type 2
2026-03-29 18:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 413eb418-b3b2-5960-868b-079f17a54777, identifier: MU47356
2026-03-29 18:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 413eb418-b3b2-5960-868b-079f17a54777 with identifier: MU47356
2026-03-29 18:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 413eb418-b3b2-5960-868b-079f17a54777 with identifier: MU47356
2026-03-29 18:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 413eb418-b3b2-5960-868b-079f17a54777 with identifier: MU47356 to the API
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:26:27Z',
'fuel_type': 'diesel',
'id': '413eb418-b3b2-5960-868b-079f17a54777',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU47356',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 128572,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-22',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 250 d T BlueTEC AMG Line',
'transmission': 'automatic',
'trim': 'T BlueTEC AMG Line',
'year': 2016}
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU47356%27 HTTP/1.1" 200 None
2026-03-29 18:40:14 [auto1.de] INFO: Saving data for MU47356: {'auction_closing_time': 1774884387.0, 'created_time': 1773829837.628076, 'last_price_update_time': 1774809614.63945}
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU47356') HTTP/1.1" 204 0
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS13064%27 HTTP/1.1" 200 None
2026-03-29 18:40:14 [auto1.de] INFO: Scrape type for YS13064: 2
2026-03-29 18:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1d0c80b-d4ae-5cc4-a782-626d2367a789 with identifier: YS13064
2026-03-29 18:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1d0c80b-d4ae-5cc4-a782-626d2367a789 with scrape type 2
2026-03-29 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1d0c80b-d4ae-5cc4-a782-626d2367a789 with scrape type 2
2026-03-29 18:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1d0c80b-d4ae-5cc4-a782-626d2367a789, identifier: YS13064
2026-03-29 18:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1d0c80b-d4ae-5cc4-a782-626d2367a789 with identifier: YS13064
2026-03-29 18:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1d0c80b-d4ae-5cc4-a782-626d2367a789 with identifier: YS13064
2026-03-29 18:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1d0c80b-d4ae-5cc4-a782-626d2367a789 with identifier: YS13064 to the API
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:57:25Z',
'fuel_type': 'petrol',
'id': 'd1d0c80b-d4ae-5cc4-a782-626d2367a789',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS13064',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 98483,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-30',
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive pure',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive pure',
'year': 2012}
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS13064%27 HTTP/1.1" 200 None
2026-03-29 18:40:15 [auto1.de] INFO: Saving data for YS13064: {'auction_closing_time': 1774886245.0, 'created_time': 1774607860.201718, 'last_price_update_time': 1774809615.177612}
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS13064') HTTP/1.1" 204 0
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ59637%27 HTTP/1.1" 200 None
2026-03-29 18:40:15 [auto1.de] INFO: Scrape type for VJ59637: 2
2026-03-29 18:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1593f713-0c60-5a04-bfeb-ece73a5967f1 with identifier: VJ59637
2026-03-29 18:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1593f713-0c60-5a04-bfeb-ece73a5967f1 with scrape type 2
2026-03-29 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1593f713-0c60-5a04-bfeb-ece73a5967f1 with scrape type 2
2026-03-29 18:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1593f713-0c60-5a04-bfeb-ece73a5967f1, identifier: VJ59637
2026-03-29 18:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1593f713-0c60-5a04-bfeb-ece73a5967f1 with identifier: VJ59637
2026-03-29 18:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1593f713-0c60-5a04-bfeb-ece73a5967f1 with identifier: VJ59637
2026-03-29 18:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1593f713-0c60-5a04-bfeb-ece73a5967f1 with identifier: VJ59637 to the API
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:10:49Z',
'fuel_type': 'petrol',
'id': '1593f713-0c60-5a04-bfeb-ece73a5967f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ59637',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'up!',
'odometer': 183003,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-02',
'seller_name': None,
'title': 'Volkswagen up! 1.0 Move up!',
'transmission': 'manual',
'trim': 'Move',
'year': 2012}
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ59637%27 HTTP/1.1" 200 None
2026-03-29 18:40:15 [auto1.de] INFO: Saving data for VJ59637: {'auction_closing_time': 1774883449.0, 'created_time': 1774118752.266114, 'last_price_update_time': 1774809615.57789}
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ59637') HTTP/1.1" 204 0
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU53643%27 HTTP/1.1" 200 None
2026-03-29 18:40:15 [auto1.de] INFO: Scrape type for UU53643: 0
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL16221%27 HTTP/1.1" 200 None
2026-03-29 18:40:15 [auto1.de] INFO: Scrape type for VL16221: 2
2026-03-29 18:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78695a34-f65d-54c3-9d90-da9a1f75177b with identifier: VL16221
2026-03-29 18:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78695a34-f65d-54c3-9d90-da9a1f75177b with scrape type 2
2026-03-29 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78695a34-f65d-54c3-9d90-da9a1f75177b with scrape type 2
2026-03-29 18:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78695a34-f65d-54c3-9d90-da9a1f75177b, identifier: VL16221
2026-03-29 18:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78695a34-f65d-54c3-9d90-da9a1f75177b with identifier: VL16221
2026-03-29 18:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78695a34-f65d-54c3-9d90-da9a1f75177b with identifier: VL16221
2026-03-29 18:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78695a34-f65d-54c3-9d90-da9a1f75177b with identifier: VL16221 to the API
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:23:39Z',
'fuel_type': 'diesel',
'id': '78695a34-f65d-54c3-9d90-da9a1f75177b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL16221',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40',
'odometer': 103450,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-15',
'seller_name': None,
'title': 'Volvo V40 2.0 D3 R-Design',
'transmission': 'automatic',
'trim': 'R-Design',
'year': 2019}
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL16221%27 HTTP/1.1" 200 None
2026-03-29 18:40:16 [auto1.de] INFO: Saving data for VL16221: {'auction_closing_time': 1774884219.0, 'created_time': 1774291736.668782, 'last_price_update_time': 1774809616.042818}
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL16221') HTTP/1.1" 204 0
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ56060%27 HTTP/1.1" 200 None
2026-03-29 18:40:16 [auto1.de] INFO: Scrape type for SZ56060: 0
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF02392%27 HTTP/1.1" 200 None
2026-03-29 18:40:16 [auto1.de] INFO: Scrape type for MF02392: 0
2026-03-29 18:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:16 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH95980%27 HTTP/1.1" 200 None
2026-03-29 18:40:16 [auto1.de] INFO: Scrape type for AH95980: 2
2026-03-29 18:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4adea14b-accc-50ee-8651-ac60449ee690 with identifier: AH95980
2026-03-29 18:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4adea14b-accc-50ee-8651-ac60449ee690 with scrape type 2
2026-03-29 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4adea14b-accc-50ee-8651-ac60449ee690 with scrape type 2
2026-03-29 18:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4adea14b-accc-50ee-8651-ac60449ee690, identifier: AH95980
2026-03-29 18:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4adea14b-accc-50ee-8651-ac60449ee690 with identifier: AH95980
2026-03-29 18:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4adea14b-accc-50ee-8651-ac60449ee690 with identifier: AH95980
2026-03-29 18:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4adea14b-accc-50ee-8651-ac60449ee690 with identifier: AH95980 to the API
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:06:04Z',
'fuel_type': 'diesel',
'id': '4adea14b-accc-50ee-8651-ac60449ee690',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH95980',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 179753,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-01',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
'transmission': 'manual',
'trim': 'Allure Pack',
'year': 2022}
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH95980%27 HTTP/1.1" 200 None
2026-03-29 18:40:16 [auto1.de] INFO: Saving data for AH95980: {'auction_closing_time': 1774883164.0, 'created_time': 1773400587.35671, 'last_price_update_time': 1774809616.734005}
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH95980') HTTP/1.1" 204 0
2026-03-29 18:40:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX28269%27 HTTP/1.1" 200 None
2026-03-29 18:40:16 [auto1.de] INFO: Scrape type for NX28269: 0
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60688%27 HTTP/1.1" 200 None
2026-03-29 18:40:16 [auto1.de] INFO: Scrape type for PC60688: 0
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH44526%27 HTTP/1.1" 200 None
2026-03-29 18:40:16 [auto1.de] INFO: Scrape type for DH44526: 0
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD00860%27 HTTP/1.1" 200 None
2026-03-29 18:40:16 [auto1.de] INFO: Scrape type for YD00860: 0
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM62598%27 HTTP/1.1" 200 None
2026-03-29 18:40:16 [auto1.de] INFO: Scrape type for XM62598: 2
2026-03-29 18:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac98c68d-0c56-58a4-be10-88fa949d6da3 with identifier: XM62598
2026-03-29 18:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac98c68d-0c56-58a4-be10-88fa949d6da3 with scrape type 2
2026-03-29 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac98c68d-0c56-58a4-be10-88fa949d6da3 with scrape type 2
2026-03-29 18:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac98c68d-0c56-58a4-be10-88fa949d6da3, identifier: XM62598
2026-03-29 18:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac98c68d-0c56-58a4-be10-88fa949d6da3 with identifier: XM62598
2026-03-29 18:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac98c68d-0c56-58a4-be10-88fa949d6da3 with identifier: XM62598
2026-03-29 18:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac98c68d-0c56-58a4-be10-88fa949d6da3 with identifier: XM62598 to the API
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:06:40Z',
'fuel_type': 'diesel',
'id': 'ac98c68d-0c56-58a4-be10-88fa949d6da3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM62598',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 160561,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-28',
'seller_name': None,
'title': 'BMW 5er 530d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2011}
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM62598%27 HTTP/1.1" 200 None
2026-03-29 18:40:17 [auto1.de] INFO: Saving data for XM62598: {'auction_closing_time': 1774883200.0, 'created_time': 1773859175.463235, 'last_price_update_time': 1774809617.28218}
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM62598') HTTP/1.1" 204 0
2026-03-29 18:40:17 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-29 18:40:17 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-29 18:40:17 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-29 18:40:17 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-29 18:40:17 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG28857%27 HTTP/1.1" 200 None
2026-03-29 18:40:17 [auto1.de] INFO: Scrape type for MG28857: 2
2026-03-29 18:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb7b2ff8-dfd6-5474-a272-fc07e37979fd with identifier: MG28857
2026-03-29 18:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb7b2ff8-dfd6-5474-a272-fc07e37979fd with scrape type 2
2026-03-29 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb7b2ff8-dfd6-5474-a272-fc07e37979fd with scrape type 2
2026-03-29 18:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb7b2ff8-dfd6-5474-a272-fc07e37979fd, identifier: MG28857
2026-03-29 18:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb7b2ff8-dfd6-5474-a272-fc07e37979fd with identifier: MG28857
2026-03-29 18:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb7b2ff8-dfd6-5474-a272-fc07e37979fd with identifier: MG28857
2026-03-29 18:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb7b2ff8-dfd6-5474-a272-fc07e37979fd with identifier: MG28857 to the API
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 440,
'expiration_date': '2026-03-30T15:52:44Z',
'fuel_type': 'petrol',
'id': 'bb7b2ff8-dfd6-5474-a272-fc07e37979fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG28857',
'listing': 'auction',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 178285,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-01',
'seller_name': None,
'title': 'Porsche Cayenne GTS',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG28857%27 HTTP/1.1" 200 None
2026-03-29 18:40:17 [auto1.de] INFO: Saving data for MG28857: {'auction_closing_time': 1774885964.0, 'created_time': 1773340408.249628, 'last_price_update_time': 1774809617.844568}
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG28857') HTTP/1.1" 204 0
2026-03-29 18:40:17 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-29 18:40:17 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-29 18:40:17 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-29 18:40:17 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-29 18:40:17 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR06917%27 HTTP/1.1" 200 None
2026-03-29 18:40:17 [auto1.de] INFO: Scrape type for LR06917: 2
2026-03-29 18:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a761a09-404b-5f6d-973f-a77d7fd03a97 with identifier: LR06917
2026-03-29 18:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a761a09-404b-5f6d-973f-a77d7fd03a97 with scrape type 2
2026-03-29 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a761a09-404b-5f6d-973f-a77d7fd03a97 with scrape type 2
2026-03-29 18:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a761a09-404b-5f6d-973f-a77d7fd03a97, identifier: LR06917
2026-03-29 18:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a761a09-404b-5f6d-973f-a77d7fd03a97 with identifier: LR06917
2026-03-29 18:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a761a09-404b-5f6d-973f-a77d7fd03a97 with identifier: LR06917
2026-03-29 18:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a761a09-404b-5f6d-973f-a77d7fd03a97 with identifier: LR06917 to the API
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:59:45Z',
'fuel_type': 'diesel',
'id': '3a761a09-404b-5f6d-973f-a77d7fd03a97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR06917',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 247027,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-23',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
'transmission': 'automatic',
'trim': 'GTD BlueMotion Tech',
'year': 2015}
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR06917%27 HTTP/1.1" 200 None
2026-03-29 18:40:18 [auto1.de] INFO: Saving data for LR06917: {'auction_closing_time': 1774886385.0, 'created_time': 1773859875.735783, 'last_price_update_time': 1774809618.301307}
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR06917') HTTP/1.1" 204 0
2026-03-29 18:40:18 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-29 18:40:18 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-29 18:40:18 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-29 18:40:18 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE57150%27 HTTP/1.1" 200 None
2026-03-29 18:40:18 [auto1.de] INFO: Scrape type for UE57150: 2
2026-03-29 18:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with identifier: UE57150
2026-03-29 18:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with scrape type 2
2026-03-29 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with scrape type 2
2026-03-29 18:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80e08f92-033f-5fd1-aa5d-b3fe5341ee53, identifier: UE57150
2026-03-29 18:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with identifier: UE57150
2026-03-29 18:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with identifier: UE57150
2026-03-29 18:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with identifier: UE57150 to the API
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:41:44Z',
'fuel_type': 'diesel',
'id': '80e08f92-033f-5fd1-aa5d-b3fe5341ee53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE57150',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 97526,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-20',
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
'transmission': 'automatic',
'trim': 'SE AWD',
'year': 2018}
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE57150%27 HTTP/1.1" 200 None
2026-03-29 18:40:18 [auto1.de] INFO: Saving data for UE57150: {'auction_closing_time': 1774885304.0, 'created_time': 1773305943.13069, 'last_price_update_time': 1774809618.775624}
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE57150') HTTP/1.1" 204 0
2026-03-29 18:40:18 [auto1.de] INFO: Found listing with ID: HJ77178
2026-03-29 18:40:18 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-29 18:40:18 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL79730%27 HTTP/1.1" 200 None
2026-03-29 18:40:18 [auto1.de] INFO: Scrape type for VL79730: 0
2026-03-29 18:40:18 [auto1.de] INFO: Found listing with ID: JX01740
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX01740%27 HTTP/1.1" 200 None
2026-03-29 18:40:18 [auto1.de] INFO: Scrape type for JX01740: 2
2026-03-29 18:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b909f28-33f7-5267-94b7-d835ef702a1b with identifier: JX01740
2026-03-29 18:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b909f28-33f7-5267-94b7-d835ef702a1b with scrape type 2
2026-03-29 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b909f28-33f7-5267-94b7-d835ef702a1b with scrape type 2
2026-03-29 18:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b909f28-33f7-5267-94b7-d835ef702a1b, identifier: JX01740
2026-03-29 18:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b909f28-33f7-5267-94b7-d835ef702a1b with identifier: JX01740
2026-03-29 18:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b909f28-33f7-5267-94b7-d835ef702a1b with identifier: JX01740
2026-03-29 18:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b909f28-33f7-5267-94b7-d835ef702a1b with identifier: JX01740 to the API
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:27:22Z',
'fuel_type': 'diesel',
'id': '6b909f28-33f7-5267-94b7-d835ef702a1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX01740',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 151112,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-04',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Highline BlueMotion Tech',
'year': 2017}
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX01740%27 HTTP/1.1" 200 None
2026-03-29 18:40:19 [auto1.de] INFO: Saving data for JX01740: {'auction_closing_time': 1774884442.0, 'created_time': 1773774802.423346, 'last_price_update_time': 1774809619.301828}
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX01740') HTTP/1.1" 204 0
2026-03-29 18:40:19 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-29 18:40:19 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY50821%27 HTTP/1.1" 200 None
2026-03-29 18:40:19 [auto1.de] INFO: Scrape type for CY50821: 0
2026-03-29 18:40:19 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-29 18:40:19 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-29 18:40:19 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-29 18:40:19 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-29 18:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:20 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:20 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-29 18:40:20 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD98070%27 HTTP/1.1" 200 None
2026-03-29 18:40:20 [auto1.de] INFO: Scrape type for BD98070: 2
2026-03-29 18:40:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da481d76-a4db-5111-b8f6-98b933fae6b2 with identifier: BD98070
2026-03-29 18:40:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da481d76-a4db-5111-b8f6-98b933fae6b2 with scrape type 2
2026-03-29 18:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da481d76-a4db-5111-b8f6-98b933fae6b2 with scrape type 2
2026-03-29 18:40:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da481d76-a4db-5111-b8f6-98b933fae6b2, identifier: BD98070
2026-03-29 18:40:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da481d76-a4db-5111-b8f6-98b933fae6b2 with identifier: BD98070
2026-03-29 18:40:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da481d76-a4db-5111-b8f6-98b933fae6b2 with identifier: BD98070
2026-03-29 18:40:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da481d76-a4db-5111-b8f6-98b933fae6b2 with identifier: BD98070 to the API
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:40:58Z',
'fuel_type': 'petrol',
'id': 'da481d76-a4db-5111-b8f6-98b933fae6b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD98070',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 22905,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-27',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid T AMG Line',
'transmission': 'automatic',
'trim': 'T AMG Line',
'year': 2022}
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD98070%27 HTTP/1.1" 200 None
2026-03-29 18:40:20 [auto1.de] INFO: Saving data for BD98070: {'auction_closing_time': 1774885258.0, 'created_time': 1773428943.479344, 'last_price_update_time': 1774809620.733882}
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD98070') HTTP/1.1" 204 0
2026-03-29 18:40:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:20 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-29 18:40:20 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-29 18:40:20 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-29 18:40:20 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00076%27 HTTP/1.1" 200 None
2026-03-29 18:40:20 [auto1.de] INFO: Scrape type for PH00076: 2
2026-03-29 18:40:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2 with identifier: PH00076
2026-03-29 18:40:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2 with scrape type 2
2026-03-29 18:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2 with scrape type 2
2026-03-29 18:40:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2, identifier: PH00076
2026-03-29 18:40:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2 with identifier: PH00076
2026-03-29 18:40:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2 with identifier: PH00076
2026-03-29 18:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2 with identifier: PH00076 to the API
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 325,
'expiration_date': '2026-03-30T15:45:09Z',
'fuel_type': 'diesel',
'id': '01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH00076',
'listing': 'auction',
'make': 'Audi',
'model': 'SQ5',
'odometer': 224743,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-08',
'seller_name': None,
'title': 'Audi SQ5 3.0 V6 TDI quattro Competition',
'transmission': 'automatic',
'trim': 'quattro Competition',
'year': 2015}
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00076%27 HTTP/1.1" 200 None
2026-03-29 18:40:21 [auto1.de] INFO: Saving data for PH00076: {'auction_closing_time': 1774885509.0, 'created_time': 1773830285.249546, 'last_price_update_time': 1774809621.279269}
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH00076') HTTP/1.1" 204 0
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50420%27 HTTP/1.1" 200 None
2026-03-29 18:40:21 [auto1.de] INFO: Scrape type for AD50420: 2
2026-03-29 18:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9035798-f94c-545b-839c-746f45769d3c with identifier: AD50420
2026-03-29 18:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9035798-f94c-545b-839c-746f45769d3c with scrape type 2
2026-03-29 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9035798-f94c-545b-839c-746f45769d3c with scrape type 2
2026-03-29 18:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9035798-f94c-545b-839c-746f45769d3c, identifier: AD50420
2026-03-29 18:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9035798-f94c-545b-839c-746f45769d3c with identifier: AD50420
2026-03-29 18:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9035798-f94c-545b-839c-746f45769d3c with identifier: AD50420
2026-03-29 18:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9035798-f94c-545b-839c-746f45769d3c with identifier: AD50420 to the API
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:15:46Z',
'fuel_type': 'petrol',
'id': 'a9035798-f94c-545b-839c-746f45769d3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD50420',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 163541,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-24',
'seller_name': None,
'title': 'Mazda CX-3 2.0 Sports-Line',
'transmission': 'manual',
'trim': 'Sports-Line',
'year': 2017}
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50420%27 HTTP/1.1" 200 None
2026-03-29 18:40:21 [auto1.de] INFO: Saving data for AD50420: {'auction_closing_time': 1774883746.0, 'created_time': 1774521667.533898, 'last_price_update_time': 1774809621.699245}
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD50420') HTTP/1.1" 204 0
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: XY17081
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH10138%27 HTTP/1.1" 200 None
2026-03-29 18:40:21 [auto1.de] INFO: Scrape type for UH10138: 0
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN93862%27 HTTP/1.1" 200 None
2026-03-29 18:40:21 [auto1.de] INFO: Scrape type for LN93862: 2
2026-03-29 18:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be9b86c0-6aad-5de7-bebe-e9a32193b367 with identifier: LN93862
2026-03-29 18:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be9b86c0-6aad-5de7-bebe-e9a32193b367 with scrape type 2
2026-03-29 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be9b86c0-6aad-5de7-bebe-e9a32193b367 with scrape type 2
2026-03-29 18:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be9b86c0-6aad-5de7-bebe-e9a32193b367, identifier: LN93862
2026-03-29 18:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be9b86c0-6aad-5de7-bebe-e9a32193b367 with identifier: LN93862
2026-03-29 18:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be9b86c0-6aad-5de7-bebe-e9a32193b367 with identifier: LN93862
2026-03-29 18:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be9b86c0-6aad-5de7-bebe-e9a32193b367 with identifier: LN93862 to the API
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:38:05Z',
'fuel_type': 'petrol',
'id': 'be9b86c0-6aad-5de7-bebe-e9a32193b367',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN93862',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 124052,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-05',
'seller_name': None,
'title': 'BMW 1er 118i Edition M Sport Shadow',
'transmission': 'automatic',
'trim': 'Edition M Sport Shadow',
'year': 2018}
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN93862%27 HTTP/1.1" 200 None
2026-03-29 18:40:22 [auto1.de] INFO: Saving data for LN93862: {'auction_closing_time': 1774885085.0, 'created_time': 1774522028.738425, 'last_price_update_time': 1774809622.128615}
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN93862') HTTP/1.1" 204 0
2026-03-29 18:40:22 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF91540%27 HTTP/1.1" 200 None
2026-03-29 18:40:22 [auto1.de] INFO: Scrape type for ZF91540: 0
2026-03-29 18:40:22 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-29 18:40:22 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE85774%27 HTTP/1.1" 200 None
2026-03-29 18:40:22 [auto1.de] INFO: Scrape type for DE85774: 2
2026-03-29 18:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with identifier: DE85774
2026-03-29 18:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with scrape type 2
2026-03-29 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with scrape type 2
2026-03-29 18:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f46ea9d-e12f-5120-b499-a62ec61d5e5f, identifier: DE85774
2026-03-29 18:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with identifier: DE85774
2026-03-29 18:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with identifier: DE85774
2026-03-29 18:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with identifier: DE85774 to the API
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:40:08Z',
'fuel_type': 'petrol',
'id': '5f46ea9d-e12f-5120-b499-a62ec61d5e5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE85774',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 176084,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-31',
'seller_name': None,
'title': "Kia cee'd 1.6 Spirit",
'transmission': 'manual',
'trim': 'Spirit',
'year': 2009}
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE85774%27 HTTP/1.1" 200 None
2026-03-29 18:40:22 [auto1.de] INFO: Saving data for DE85774: {'auction_closing_time': 1774885208.0, 'created_time': 1773859923.758039, 'last_price_update_time': 1774809622.695478}
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE85774') HTTP/1.1" 204 0
2026-03-29 18:40:22 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET59047%27 HTTP/1.1" 200 None
2026-03-29 18:40:22 [auto1.de] INFO: Scrape type for ET59047: 0
2026-03-29 18:40:22 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-29 18:40:22 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-29 18:40:22 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR76788%27 HTTP/1.1" 200 None
2026-03-29 18:40:22 [auto1.de] INFO: Scrape type for BR76788: 2
2026-03-29 18:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f645e6db-676f-559d-8c38-0bac708f8059 with identifier: BR76788
2026-03-29 18:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f645e6db-676f-559d-8c38-0bac708f8059 with scrape type 2
2026-03-29 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f645e6db-676f-559d-8c38-0bac708f8059 with scrape type 2
2026-03-29 18:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f645e6db-676f-559d-8c38-0bac708f8059, identifier: BR76788
2026-03-29 18:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f645e6db-676f-559d-8c38-0bac708f8059 with identifier: BR76788
2026-03-29 18:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f645e6db-676f-559d-8c38-0bac708f8059 with identifier: BR76788
2026-03-29 18:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f645e6db-676f-559d-8c38-0bac708f8059 with identifier: BR76788 to the API
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:34:43Z',
'fuel_type': 'petrol',
'id': 'f645e6db-676f-559d-8c38-0bac708f8059',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR76788',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 193704,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-20',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2012}
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR76788%27 HTTP/1.1" 200 None
2026-03-29 18:40:23 [auto1.de] INFO: Saving data for BR76788: {'auction_closing_time': 1774884883.0, 'created_time': 1773304689.771843, 'last_price_update_time': 1774809623.177159}
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR76788') HTTP/1.1" 204 0
2026-03-29 18:40:23 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-29 18:40:23 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL76152%27 HTTP/1.1" 200 None
2026-03-29 18:40:23 [auto1.de] INFO: Scrape type for ZL76152: 2
2026-03-29 18:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d38d383-9e06-5511-a737-bad9cc168a9f with identifier: ZL76152
2026-03-29 18:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d38d383-9e06-5511-a737-bad9cc168a9f with scrape type 2
2026-03-29 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d38d383-9e06-5511-a737-bad9cc168a9f with scrape type 2
2026-03-29 18:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d38d383-9e06-5511-a737-bad9cc168a9f, identifier: ZL76152
2026-03-29 18:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d38d383-9e06-5511-a737-bad9cc168a9f with identifier: ZL76152
2026-03-29 18:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d38d383-9e06-5511-a737-bad9cc168a9f with identifier: ZL76152
2026-03-29 18:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d38d383-9e06-5511-a737-bad9cc168a9f with identifier: ZL76152 to the API
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:20:35Z',
'fuel_type': 'petrol',
'id': '8d38d383-9e06-5511-a737-bad9cc168a9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL76152',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 105595,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-27',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 250 CGI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2011}
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL76152%27 HTTP/1.1" 200 None
2026-03-29 18:40:23 [auto1.de] INFO: Saving data for ZL76152: {'auction_closing_time': 1774884035.0, 'created_time': 1773860325.950857, 'last_price_update_time': 1774809623.616524}
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL76152') HTTP/1.1" 204 0
2026-03-29 18:40:23 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-29 18:40:23 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA85998%27 HTTP/1.1" 200 None
2026-03-29 18:40:23 [auto1.de] INFO: Scrape type for PA85998: 2
2026-03-29 18:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ae1811e-78e3-526d-8183-9a67084a9e5d with identifier: PA85998
2026-03-29 18:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ae1811e-78e3-526d-8183-9a67084a9e5d with scrape type 2
2026-03-29 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ae1811e-78e3-526d-8183-9a67084a9e5d with scrape type 2
2026-03-29 18:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ae1811e-78e3-526d-8183-9a67084a9e5d, identifier: PA85998
2026-03-29 18:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ae1811e-78e3-526d-8183-9a67084a9e5d with identifier: PA85998
2026-03-29 18:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ae1811e-78e3-526d-8183-9a67084a9e5d with identifier: PA85998
2026-03-29 18:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ae1811e-78e3-526d-8183-9a67084a9e5d with identifier: PA85998 to the API
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 457,
'expiration_date': '2026-03-30T15:41:05Z',
'fuel_type': 'petrol',
'id': '1ae1811e-78e3-526d-8183-9a67084a9e5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA85998',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 86426,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-28',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 53 AMG Mild-Hybrid T 4Matic+',
'transmission': 'automatic',
'trim': 'T 4Matic+',
'year': 2019}
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA85998%27 HTTP/1.1" 200 None
2026-03-29 18:40:24 [auto1.de] INFO: Saving data for PA85998: {'auction_closing_time': 1774885265.0, 'created_time': 1774608306.619479, 'last_price_update_time': 1774809624.066699}
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA85998') HTTP/1.1" 204 0
2026-03-29 18:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:24 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-29 18:40:24 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-29 18:40:24 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE32009%27 HTTP/1.1" 200 None
2026-03-29 18:40:24 [auto1.de] INFO: Scrape type for SE32009: 2
2026-03-29 18:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1388515-9030-558e-8089-f77320185b27 with identifier: SE32009
2026-03-29 18:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1388515-9030-558e-8089-f77320185b27 with scrape type 2
2026-03-29 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1388515-9030-558e-8089-f77320185b27 with scrape type 2
2026-03-29 18:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1388515-9030-558e-8089-f77320185b27, identifier: SE32009
2026-03-29 18:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1388515-9030-558e-8089-f77320185b27 with identifier: SE32009
2026-03-29 18:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1388515-9030-558e-8089-f77320185b27 with identifier: SE32009
2026-03-29 18:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1388515-9030-558e-8089-f77320185b27 with identifier: SE32009 to the API
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:27:25Z',
'fuel_type': 'diesel',
'id': 'd1388515-9030-558e-8089-f77320185b27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE32009',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 284650,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-09',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Cup BlueMotion Tech',
'transmission': 'manual',
'trim': 'Cup BlueMotion Tech',
'year': 2015}
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE32009%27 HTTP/1.1" 200 None
2026-03-29 18:40:24 [auto1.de] INFO: Saving data for SE32009: {'auction_closing_time': 1774884445.0, 'created_time': 1773775854.531316, 'last_price_update_time': 1774809624.614585}
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE32009') HTTP/1.1" 204 0
2026-03-29 18:40:24 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT76935%27 HTTP/1.1" 200 None
2026-03-29 18:40:24 [auto1.de] INFO: Scrape type for VT76935: 2
2026-03-29 18:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e37bf0ce-5ada-5e23-93e6-46c5e633e60d with identifier: VT76935
2026-03-29 18:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d with scrape type 2
2026-03-29 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d with scrape type 2
2026-03-29 18:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e37bf0ce-5ada-5e23-93e6-46c5e633e60d, identifier: VT76935
2026-03-29 18:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e37bf0ce-5ada-5e23-93e6-46c5e633e60d with identifier: VT76935
2026-03-29 18:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e37bf0ce-5ada-5e23-93e6-46c5e633e60d with identifier: VT76935
2026-03-29 18:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e37bf0ce-5ada-5e23-93e6-46c5e633e60d with identifier: VT76935 to the API
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:12:29Z',
'fuel_type': 'petrol',
'id': 'e37bf0ce-5ada-5e23-93e6-46c5e633e60d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT76935',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 129056,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-11',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2017}
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT76935%27 HTTP/1.1" 200 None
2026-03-29 18:40:25 [auto1.de] INFO: Saving data for VT76935: {'auction_closing_time': 1774883549.0, 'created_time': 1774607671.781345, 'last_price_update_time': 1774809625.042396}
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT76935') HTTP/1.1" 204 0
2026-03-29 18:40:25 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP07103%27 HTTP/1.1" 200 None
2026-03-29 18:40:25 [auto1.de] INFO: Scrape type for AP07103: 2
2026-03-29 18:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 906a92da-1e98-569a-97b9-7425e6b624e0 with identifier: AP07103
2026-03-29 18:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 906a92da-1e98-569a-97b9-7425e6b624e0 with scrape type 2
2026-03-29 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 906a92da-1e98-569a-97b9-7425e6b624e0 with scrape type 2
2026-03-29 18:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 906a92da-1e98-569a-97b9-7425e6b624e0, identifier: AP07103
2026-03-29 18:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 906a92da-1e98-569a-97b9-7425e6b624e0 with identifier: AP07103
2026-03-29 18:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 906a92da-1e98-569a-97b9-7425e6b624e0 with identifier: AP07103
2026-03-29 18:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 906a92da-1e98-569a-97b9-7425e6b624e0 with identifier: AP07103 to the API
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:52:02Z',
'fuel_type': 'diesel',
'id': '906a92da-1e98-569a-97b9-7425e6b624e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP07103',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 278782,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-07',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi Trend',
'transmission': 'automatic',
'trim': 'Trend',
'year': 2013}
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP07103%27 HTTP/1.1" 200 None
2026-03-29 18:40:25 [auto1.de] INFO: Saving data for AP07103: {'auction_closing_time': 1774885922.0, 'created_time': 1774522050.354785, 'last_price_update_time': 1774809625.435147}
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP07103') HTTP/1.1" 204 0
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM37202%27 HTTP/1.1" 200 None
2026-03-29 18:40:25 [auto1.de] INFO: Scrape type for ZM37202: 0
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT61440%27 HTTP/1.1" 200 None
2026-03-29 18:40:25 [auto1.de] INFO: Scrape type for HT61440: 0
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF23160%27 HTTP/1.1" 200 None
2026-03-29 18:40:25 [auto1.de] INFO: Scrape type for PF23160: 0
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS78773%27 HTTP/1.1" 200 None
2026-03-29 18:40:25 [auto1.de] INFO: Scrape type for CS78773: 2
2026-03-29 18:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77506400-ac21-5c1a-ae33-3ef21331301e with identifier: CS78773
2026-03-29 18:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77506400-ac21-5c1a-ae33-3ef21331301e with scrape type 2
2026-03-29 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77506400-ac21-5c1a-ae33-3ef21331301e with scrape type 2
2026-03-29 18:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77506400-ac21-5c1a-ae33-3ef21331301e, identifier: CS78773
2026-03-29 18:40:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE16908%27 HTTP/1.1" 200 None
2026-03-29 18:40:25 [auto1.de] INFO: Scrape type for BE16908: 0
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH64089%27 HTTP/1.1" 200 None
2026-03-29 18:40:25 [auto1.de] INFO: Scrape type for JH64089: 2
2026-03-29 18:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1add5594-0ecd-56d2-956f-b1d0287220e9 with identifier: JH64089
2026-03-29 18:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1add5594-0ecd-56d2-956f-b1d0287220e9 with scrape type 2
2026-03-29 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1add5594-0ecd-56d2-956f-b1d0287220e9 with scrape type 2
2026-03-29 18:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1add5594-0ecd-56d2-956f-b1d0287220e9, identifier: JH64089
2026-03-29 18:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77506400-ac21-5c1a-ae33-3ef21331301e with identifier: CS78773
2026-03-29 18:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77506400-ac21-5c1a-ae33-3ef21331301e with identifier: CS78773
2026-03-29 18:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77506400-ac21-5c1a-ae33-3ef21331301e with identifier: CS78773 to the API
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:44:15Z',
'fuel_type': 'diesel',
'id': '77506400-ac21-5c1a-ae33-3ef21331301e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS78773',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 204323,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-31',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 HDi XTR',
'transmission': 'manual',
'trim': 'XTR',
'year': 2009}
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS78773%27 HTTP/1.1" 200 None
2026-03-29 18:40:26 [auto1.de] INFO: Saving data for CS78773: {'auction_closing_time': 1774885455.0, 'created_time': 1774521332.886892, 'last_price_update_time': 1774809626.016608}
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS78773') HTTP/1.1" 204 0
2026-03-29 18:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1add5594-0ecd-56d2-956f-b1d0287220e9 with identifier: JH64089
2026-03-29 18:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1add5594-0ecd-56d2-956f-b1d0287220e9 with identifier: JH64089
2026-03-29 18:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1add5594-0ecd-56d2-956f-b1d0287220e9 with identifier: JH64089 to the API
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 194,
'expiration_date': '2026-03-30T15:36:48Z',
'fuel_type': 'diesel',
'id': '1add5594-0ecd-56d2-956f-b1d0287220e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH64089',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 125910,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-09',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2021}
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH64089%27 HTTP/1.1" 200 None
2026-03-29 18:40:26 [auto1.de] INFO: Saving data for JH64089: {'auction_closing_time': 1774885008.0, 'created_time': 1773467447.264691, 'last_price_update_time': 1774809626.445332}
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH64089') HTTP/1.1" 204 0
2026-03-29 18:40:26 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-29 18:40:26 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-29 18:40:26 [auto1.de] INFO: Found listing with ID: XC20802
2026-03-29 18:40:26 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY15812%27 HTTP/1.1" 200 None
2026-03-29 18:40:26 [auto1.de] INFO: Scrape type for NY15812: 0
2026-03-29 18:40:26 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW48203%27 HTTP/1.1" 200 None
2026-03-29 18:40:26 [auto1.de] INFO: Scrape type for UW48203: 0
2026-03-29 18:40:26 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00325%27 HTTP/1.1" 200 None
2026-03-29 18:40:26 [auto1.de] INFO: Scrape type for YC00325: 0
2026-03-29 18:40:26 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB92999%27 HTTP/1.1" 200 None
2026-03-29 18:40:26 [auto1.de] INFO: Scrape type for EB92999: 2
2026-03-29 18:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95713ae8-6435-5868-b6af-fd757137e7ab with identifier: EB92999
2026-03-29 18:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95713ae8-6435-5868-b6af-fd757137e7ab with scrape type 2
2026-03-29 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95713ae8-6435-5868-b6af-fd757137e7ab with scrape type 2
2026-03-29 18:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95713ae8-6435-5868-b6af-fd757137e7ab, identifier: EB92999
2026-03-29 18:40:26 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY26864%27 HTTP/1.1" 200 None
2026-03-29 18:40:26 [auto1.de] INFO: Scrape type for GY26864: 2
2026-03-29 18:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7882e127-1b01-5045-8bef-b3bb50b2c615 with identifier: GY26864
2026-03-29 18:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7882e127-1b01-5045-8bef-b3bb50b2c615 with scrape type 2
2026-03-29 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7882e127-1b01-5045-8bef-b3bb50b2c615 with scrape type 2
2026-03-29 18:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7882e127-1b01-5045-8bef-b3bb50b2c615, identifier: GY26864
2026-03-29 18:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95713ae8-6435-5868-b6af-fd757137e7ab with identifier: EB92999
2026-03-29 18:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95713ae8-6435-5868-b6af-fd757137e7ab with identifier: EB92999
2026-03-29 18:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95713ae8-6435-5868-b6af-fd757137e7ab with identifier: EB92999 to the API
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:42:21Z',
'fuel_type': 'petrol',
'id': '95713ae8-6435-5868-b6af-fd757137e7ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB92999',
'listing': 'auction',
'make': 'Volvo',
'model': 'C70',
'odometer': 165515,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-08-27',
'seller_name': None,
'title': 'Volvo C70 2.4 Summum',
'transmission': 'manual',
'trim': 'Summum',
'year': 2007}
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB92999%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Saving data for EB92999: {'auction_closing_time': 1774885341.0, 'created_time': 1773226219.991848, 'last_price_update_time': 1774809627.03939}
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB92999') HTTP/1.1" 204 0
2026-03-29 18:40:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7882e127-1b01-5045-8bef-b3bb50b2c615 with identifier: GY26864
2026-03-29 18:40:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7882e127-1b01-5045-8bef-b3bb50b2c615 with identifier: GY26864
2026-03-29 18:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7882e127-1b01-5045-8bef-b3bb50b2c615 with identifier: GY26864 to the API
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 380,
'expiration_date': '2026-03-30T15:31:01Z',
'fuel_type': 'petrol',
'id': '7882e127-1b01-5045-8bef-b3bb50b2c615',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY26864',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 145492,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-13',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 45 Shooting Brake AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2016}
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY26864%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Saving data for GY26864: {'auction_closing_time': 1774884661.0, 'created_time': 1773226949.831073, 'last_price_update_time': 1774809627.38024}
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY26864') HTTP/1.1" 204 0
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ27680%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Scrape type for YJ27680: 2
2026-03-29 18:40:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with identifier: YJ27680
2026-03-29 18:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with scrape type 2
2026-03-29 18:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with scrape type 2
2026-03-29 18:40:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e75d858-f9bb-5b21-b204-2ad75b7e9729, identifier: YJ27680
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX47183%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Scrape type for MX47183: 0
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-29 18:40:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with identifier: YJ27680
2026-03-29 18:40:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with identifier: YJ27680
2026-03-29 18:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with identifier: YJ27680 to the API
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:50:54Z',
'fuel_type': 'petrol',
'id': '5e75d858-f9bb-5b21-b204-2ad75b7e9729',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ27680',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 100742,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-15',
'seller_name': None,
'title': 'Peugeot Partner 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2017}
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ27680%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Saving data for YJ27680: {'auction_closing_time': 1774885854.0, 'created_time': 1774636315.867659, 'last_price_update_time': 1774809627.791195}
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ27680') HTTP/1.1" 204 0
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58420%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Scrape type for TE58420: 0
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY23363%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Scrape type for EY23363: 2
2026-03-29 18:40:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce794b4e-dd87-54f2-ad08-1756f787878e with identifier: EY23363
2026-03-29 18:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce794b4e-dd87-54f2-ad08-1756f787878e with scrape type 2
2026-03-29 18:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce794b4e-dd87-54f2-ad08-1756f787878e with scrape type 2
2026-03-29 18:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce794b4e-dd87-54f2-ad08-1756f787878e, identifier: EY23363
2026-03-29 18:40:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce794b4e-dd87-54f2-ad08-1756f787878e with identifier: EY23363
2026-03-29 18:40:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce794b4e-dd87-54f2-ad08-1756f787878e with identifier: EY23363
2026-03-29 18:40:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce794b4e-dd87-54f2-ad08-1756f787878e with identifier: EY23363 to the API
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:00:24Z',
'fuel_type': 'petrol',
'id': 'ce794b4e-dd87-54f2-ad08-1756f787878e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY23363',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 41202,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-29',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid T 4Matic Avantgarde',
'transmission': 'automatic',
'trim': 'T 4Matic Avantgarde',
'year': 2021}
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY23363%27 HTTP/1.1" 200 None
2026-03-29 18:40:28 [auto1.de] INFO: Saving data for EY23363: {'auction_closing_time': 1774882824.0, 'created_time': 1774292904.383755, 'last_price_update_time': 1774809628.362411}
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY23363') HTTP/1.1" 204 0
2026-03-29 18:40:28 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV21869%27 HTTP/1.1" 200 None
2026-03-29 18:40:28 [auto1.de] INFO: Scrape type for HV21869: 0
2026-03-29 18:40:28 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-29 18:40:28 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG63962%27 HTTP/1.1" 200 None
2026-03-29 18:40:28 [auto1.de] INFO: Scrape type for PG63962: 0
2026-03-29 18:40:28 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53261%27 HTTP/1.1" 200 None
2026-03-29 18:40:28 [auto1.de] INFO: Scrape type for KL53261: 2
2026-03-29 18:40:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75b34864-2364-59c2-a9c5-b94e2c1576f7 with identifier: KL53261
2026-03-29 18:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75b34864-2364-59c2-a9c5-b94e2c1576f7 with scrape type 2
2026-03-29 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75b34864-2364-59c2-a9c5-b94e2c1576f7 with scrape type 2
2026-03-29 18:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75b34864-2364-59c2-a9c5-b94e2c1576f7, identifier: KL53261
2026-03-29 18:40:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75b34864-2364-59c2-a9c5-b94e2c1576f7 with identifier: KL53261
2026-03-29 18:40:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75b34864-2364-59c2-a9c5-b94e2c1576f7 with identifier: KL53261
2026-03-29 18:40:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75b34864-2364-59c2-a9c5-b94e2c1576f7 with identifier: KL53261 to the API
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 250,
'expiration_date': '2026-03-30T15:29:23Z',
'fuel_type': 'petrol',
'id': '75b34864-2364-59c2-a9c5-b94e2c1576f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL53261',
'listing': 'auction',
'make': 'Volvo',
'model': 'S60',
'odometer': 53881,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-08',
'seller_name': None,
'title': 'Volvo S60 2.0 B5 Mild-Hybrid Ultimate Dark AWD',
'transmission': 'automatic',
'trim': 'Ultimate Dark AWD',
'year': 2024}
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53261%27 HTTP/1.1" 200 None
2026-03-29 18:40:28 [auto1.de] INFO: Saving data for KL53261: {'auction_closing_time': 1774884563.0, 'created_time': 1774608202.326095, 'last_price_update_time': 1774809628.86375}
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL53261') HTTP/1.1" 204 0
2026-03-29 18:40:28 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK06356%27 HTTP/1.1" 200 None
2026-03-29 18:40:28 [auto1.de] INFO: Scrape type for WK06356: 0
2026-03-29 18:40:28 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU56386%27 HTTP/1.1" 200 None
2026-03-29 18:40:28 [auto1.de] INFO: Scrape type for LU56386: 2
2026-03-29 18:40:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e52eee6-958a-5cd9-b543-fec0895527fc with identifier: LU56386
2026-03-29 18:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e52eee6-958a-5cd9-b543-fec0895527fc with scrape type 2
2026-03-29 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e52eee6-958a-5cd9-b543-fec0895527fc with scrape type 2
2026-03-29 18:40:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e52eee6-958a-5cd9-b543-fec0895527fc, identifier: LU56386
2026-03-29 18:40:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e52eee6-958a-5cd9-b543-fec0895527fc with identifier: LU56386
2026-03-29 18:40:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e52eee6-958a-5cd9-b543-fec0895527fc with identifier: LU56386
2026-03-29 18:40:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e52eee6-958a-5cd9-b543-fec0895527fc with identifier: LU56386 to the API
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:01:24Z',
'fuel_type': 'diesel',
'id': '2e52eee6-958a-5cd9-b543-fec0895527fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU56386',
'listing': 'auction',
'make': 'BMW',
'model': 'X2',
'odometer': 154887,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-11',
'seller_name': None,
'title': 'BMW X2 xDrive 20d M Sport X',
'transmission': 'automatic',
'trim': 'M Sport X',
'year': 2019}
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU56386%27 HTTP/1.1" 200 None
2026-03-29 18:40:29 [auto1.de] INFO: Saving data for LU56386: {'auction_closing_time': 1774882884.0, 'created_time': 1773303136.929144, 'last_price_update_time': 1774809629.299865}
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU56386') HTTP/1.1" 204 0
2026-03-29 18:40:29 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77518%27 HTTP/1.1" 200 None
2026-03-29 18:40:29 [auto1.de] INFO: Scrape type for LC77518: 0
2026-03-29 18:40:29 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-29 18:40:29 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU69800%27 HTTP/1.1" 200 None
2026-03-29 18:40:29 [auto1.de] INFO: Scrape type for DU69800: 0
2026-03-29 18:40:29 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH07700%27 HTTP/1.1" 200 None
2026-03-29 18:40:29 [auto1.de] INFO: Scrape type for AH07700: 0
2026-03-29 18:40:29 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-29 18:40:29 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-29 18:40:29 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-29 18:40:29 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-29 18:40:29 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65181%27 HTTP/1.1" 200 None
2026-03-29 18:40:29 [auto1.de] INFO: Scrape type for YG65181: 0
2026-03-29 18:40:29 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-29 18:40:29 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-29 18:40:29 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF84640%27 HTTP/1.1" 200 None
2026-03-29 18:40:29 [auto1.de] INFO: Scrape type for AF84640: 2
2026-03-29 18:40:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9b7e388-c022-57dc-b851-aa7af4031680 with identifier: AF84640
2026-03-29 18:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9b7e388-c022-57dc-b851-aa7af4031680 with scrape type 2
2026-03-29 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9b7e388-c022-57dc-b851-aa7af4031680 with scrape type 2
2026-03-29 18:40:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9b7e388-c022-57dc-b851-aa7af4031680, identifier: AF84640
2026-03-29 18:40:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9b7e388-c022-57dc-b851-aa7af4031680 with identifier: AF84640
2026-03-29 18:40:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9b7e388-c022-57dc-b851-aa7af4031680 with identifier: AF84640
2026-03-29 18:40:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9b7e388-c022-57dc-b851-aa7af4031680 with identifier: AF84640 to the API
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:13:44Z',
'fuel_type': 'diesel',
'id': 'f9b7e388-c022-57dc-b851-aa7af4031680',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF84640',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 42309,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-23',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Elegance 4Motion',
'transmission': 'automatic',
'trim': 'Elegance 4Motion',
'year': 2022}
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF84640%27 HTTP/1.1" 200 None
2026-03-29 18:40:29 [auto1.de] INFO: Saving data for AF84640: {'auction_closing_time': 1774883624.0, 'created_time': 1774118799.64419, 'last_price_update_time': 1774809629.840119}
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF84640') HTTP/1.1" 204 0
2026-03-29 18:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:30 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:30 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY87564%27 HTTP/1.1" 200 None
2026-03-29 18:40:30 [auto1.de] INFO: Scrape type for WY87564: 2
2026-03-29 18:40:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with identifier: WY87564
2026-03-29 18:40:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with scrape type 2
2026-03-29 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with scrape type 2
2026-03-29 18:40:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b, identifier: WY87564
2026-03-29 18:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with identifier: WY87564
2026-03-29 18:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with identifier: WY87564
2026-03-29 18:40:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with identifier: WY87564 to the API
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:54:41Z',
'fuel_type': 'petrol',
'id': 'b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY87564',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 161857,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-12',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2008}
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY87564%27 HTTP/1.1" 200 None
2026-03-29 18:40:31 [auto1.de] INFO: Saving data for WY87564: {'auction_closing_time': 1774886081.0, 'created_time': 1774607763.032955, 'last_price_update_time': 1774809631.454438}
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY87564') HTTP/1.1" 204 0
2026-03-29 18:40:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:31 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-29 18:40:31 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18754%27 HTTP/1.1" 200 None
2026-03-29 18:40:31 [auto1.de] INFO: Scrape type for BW18754: 2
2026-03-29 18:40:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 817b8bd8-7ade-5c1c-9197-da2b177c3918 with identifier: BW18754
2026-03-29 18:40:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 817b8bd8-7ade-5c1c-9197-da2b177c3918 with scrape type 2
2026-03-29 18:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 817b8bd8-7ade-5c1c-9197-da2b177c3918 with scrape type 2
2026-03-29 18:40:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 817b8bd8-7ade-5c1c-9197-da2b177c3918, identifier: BW18754
2026-03-29 18:40:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 817b8bd8-7ade-5c1c-9197-da2b177c3918 with identifier: BW18754
2026-03-29 18:40:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 817b8bd8-7ade-5c1c-9197-da2b177c3918 with identifier: BW18754
2026-03-29 18:40:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 817b8bd8-7ade-5c1c-9197-da2b177c3918 with identifier: BW18754 to the API
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:39:50Z',
'fuel_type': 'petrol',
'id': '817b8bd8-7ade-5c1c-9197-da2b177c3918',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW18754',
'listing': 'auction',
'make': 'Honda',
'model': 'Accord',
'odometer': 138476,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-11-11',
'seller_name': None,
'title': 'Honda Accord 2.4 VTEC Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2009}
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18754%27 HTTP/1.1" 200 None
2026-03-29 18:40:31 [auto1.de] INFO: Saving data for BW18754: {'auction_closing_time': 1774885190.0, 'created_time': 1772544544.427147, 'last_price_update_time': 1774809631.906553}
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW18754') HTTP/1.1" 204 0
2026-03-29 18:40:31 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-29 18:40:31 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-29 18:40:31 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-29 18:40:31 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-29 18:40:31 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ21000%27 HTTP/1.1" 200 None
2026-03-29 18:40:31 [auto1.de] INFO: Scrape type for GZ21000: 2
2026-03-29 18:40:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42b317e8-d76b-512c-94dd-9baafe31877b with identifier: GZ21000
2026-03-29 18:40:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42b317e8-d76b-512c-94dd-9baafe31877b with scrape type 2
2026-03-29 18:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42b317e8-d76b-512c-94dd-9baafe31877b with scrape type 2
2026-03-29 18:40:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42b317e8-d76b-512c-94dd-9baafe31877b, identifier: GZ21000
2026-03-29 18:40:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42b317e8-d76b-512c-94dd-9baafe31877b with identifier: GZ21000
2026-03-29 18:40:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42b317e8-d76b-512c-94dd-9baafe31877b with identifier: GZ21000
2026-03-29 18:40:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42b317e8-d76b-512c-94dd-9baafe31877b with identifier: GZ21000 to the API
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:05Z',
'fuel_type': 'petrol',
'id': '42b317e8-d76b-512c-94dd-9baafe31877b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ21000',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 126461,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-28',
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2017}
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ21000%27 HTTP/1.1" 200 None
2026-03-29 18:40:32 [auto1.de] INFO: Saving data for GZ21000: {'auction_closing_time': 1774882985.0, 'created_time': 1774636361.765101, 'last_price_update_time': 1774809632.332968}
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ21000') HTTP/1.1" 204 0
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP94559%27 HTTP/1.1" 200 None
2026-03-29 18:40:32 [auto1.de] INFO: Scrape type for GP94559: 2
2026-03-29 18:40:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb3fb60-321d-57ce-ae03-01438262cbc3 with identifier: GP94559
2026-03-29 18:40:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb3fb60-321d-57ce-ae03-01438262cbc3 with scrape type 2
2026-03-29 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efb3fb60-321d-57ce-ae03-01438262cbc3 with scrape type 2
2026-03-29 18:40:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efb3fb60-321d-57ce-ae03-01438262cbc3, identifier: GP94559
2026-03-29 18:40:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efb3fb60-321d-57ce-ae03-01438262cbc3 with identifier: GP94559
2026-03-29 18:40:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efb3fb60-321d-57ce-ae03-01438262cbc3 with identifier: GP94559
2026-03-29 18:40:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efb3fb60-321d-57ce-ae03-01438262cbc3 with identifier: GP94559 to the API
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:22:19Z',
'fuel_type': 'petrol',
'id': 'efb3fb60-321d-57ce-ae03-01438262cbc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP94559',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 39064,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-22',
'seller_name': None,
'title': 'Volkswagen Beetle 2.0 TSI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2013}
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP94559%27 HTTP/1.1" 200 None
2026-03-29 18:40:32 [auto1.de] INFO: Saving data for GP94559: {'auction_closing_time': 1774884139.0, 'created_time': 1773426823.154575, 'last_price_update_time': 1774809632.750413}
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP94559') HTTP/1.1" 204 0
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM28187%27 HTTP/1.1" 200 None
2026-03-29 18:40:32 [auto1.de] INFO: Scrape type for YM28187: 2
2026-03-29 18:40:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abd055fb-d3ec-56d5-ae56-745aea36fed8 with identifier: YM28187
2026-03-29 18:40:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abd055fb-d3ec-56d5-ae56-745aea36fed8 with scrape type 2
2026-03-29 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abd055fb-d3ec-56d5-ae56-745aea36fed8 with scrape type 2
2026-03-29 18:40:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abd055fb-d3ec-56d5-ae56-745aea36fed8, identifier: YM28187
2026-03-29 18:40:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abd055fb-d3ec-56d5-ae56-745aea36fed8 with identifier: YM28187
2026-03-29 18:40:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abd055fb-d3ec-56d5-ae56-745aea36fed8 with identifier: YM28187
2026-03-29 18:40:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abd055fb-d3ec-56d5-ae56-745aea36fed8 with identifier: YM28187 to the API
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:06:12Z',
'fuel_type': 'diesel',
'id': 'abd055fb-d3ec-56d5-ae56-745aea36fed8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM28187',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 315309,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-22',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Trendline BlueMotion',
'transmission': 'automatic',
'trim': 'Trendline BlueMotion',
'year': 2012}
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM28187%27 HTTP/1.1" 200 None
2026-03-29 18:40:33 [auto1.de] INFO: Saving data for YM28187: {'auction_closing_time': 1774883172.0, 'created_time': 1774032102.134897, 'last_price_update_time': 1774809633.184976}
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM28187') HTTP/1.1" 204 0
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14818%27 HTTP/1.1" 200 None
2026-03-29 18:40:33 [auto1.de] INFO: Scrape type for VX14818: 2
2026-03-29 18:40:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with identifier: VX14818
2026-03-29 18:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with scrape type 2
2026-03-29 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with scrape type 2
2026-03-29 18:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1, identifier: VX14818
2026-03-29 18:40:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with identifier: VX14818
2026-03-29 18:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with identifier: VX14818
2026-03-29 18:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with identifier: VX14818 to the API
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:08:10Z',
'fuel_type': 'petrol',
'id': '0a87f512-0a7f-5131-9ee0-e5d1de9e35c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX14818',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 115326,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-21',
'seller_name': None,
'title': 'Opel Corsa 1.4 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14818%27 HTTP/1.1" 200 None
2026-03-29 18:40:33 [auto1.de] INFO: Saving data for VX14818: {'auction_closing_time': 1774883290.0, 'created_time': 1773775608.932776, 'last_price_update_time': 1774809633.740123}
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX14818') HTTP/1.1" 204 0
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP02035%27 HTTP/1.1" 200 None
2026-03-29 18:40:33 [auto1.de] INFO: Scrape type for WP02035: 0
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE75344%27 HTTP/1.1" 200 None
2026-03-29 18:40:33 [auto1.de] INFO: Scrape type for ZE75344: 2
2026-03-29 18:40:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0b3edc3-54ee-5d10-a257-8964ec12603e with identifier: ZE75344
2026-03-29 18:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0b3edc3-54ee-5d10-a257-8964ec12603e with scrape type 2
2026-03-29 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0b3edc3-54ee-5d10-a257-8964ec12603e with scrape type 2
2026-03-29 18:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0b3edc3-54ee-5d10-a257-8964ec12603e, identifier: ZE75344
2026-03-29 18:40:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0b3edc3-54ee-5d10-a257-8964ec12603e with identifier: ZE75344
2026-03-29 18:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0b3edc3-54ee-5d10-a257-8964ec12603e with identifier: ZE75344
2026-03-29 18:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0b3edc3-54ee-5d10-a257-8964ec12603e with identifier: ZE75344 to the API
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:23:37Z',
'fuel_type': 'petrol',
'id': 'd0b3edc3-54ee-5d10-a257-8964ec12603e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE75344',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 220560,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-30',
'seller_name': None,
'title': 'Volkswagen Touran 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE75344%27 HTTP/1.1" 200 None
2026-03-29 18:40:34 [auto1.de] INFO: Saving data for ZE75344: {'auction_closing_time': 1774884217.0, 'created_time': 1774608339.267499, 'last_price_update_time': 1774809634.197938}
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE75344') HTTP/1.1" 204 0
2026-03-29 18:40:34 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-29 18:40:34 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY81223%27 HTTP/1.1" 200 None
2026-03-29 18:40:34 [auto1.de] INFO: Scrape type for AY81223: 0
2026-03-29 18:40:34 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA26329%27 HTTP/1.1" 200 None
2026-03-29 18:40:34 [auto1.de] INFO: Scrape type for GA26329: 2
2026-03-29 18:40:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5802b382-5b34-5132-8e3e-aef61e3dd92f with identifier: GA26329
2026-03-29 18:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5802b382-5b34-5132-8e3e-aef61e3dd92f with scrape type 2
2026-03-29 18:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5802b382-5b34-5132-8e3e-aef61e3dd92f with scrape type 2
2026-03-29 18:40:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5802b382-5b34-5132-8e3e-aef61e3dd92f, identifier: GA26329
2026-03-29 18:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5802b382-5b34-5132-8e3e-aef61e3dd92f with identifier: GA26329
2026-03-29 18:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5802b382-5b34-5132-8e3e-aef61e3dd92f with identifier: GA26329
2026-03-29 18:40:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5802b382-5b34-5132-8e3e-aef61e3dd92f with identifier: GA26329 to the API
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-30T15:22:17Z',
'fuel_type': 'petrol',
'id': '5802b382-5b34-5132-8e3e-aef61e3dd92f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA26329',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 156840,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-03',
'seller_name': None,
'title': 'Nissan Juke 1.6 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2012}
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA26329%27 HTTP/1.1" 200 None
2026-03-29 18:40:34 [auto1.de] INFO: Saving data for GA26329: {'auction_closing_time': 1774884137.0, 'created_time': 1773138515.917524, 'last_price_update_time': 1774809634.724412}
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA26329') HTTP/1.1" 204 0
2026-03-29 18:40:34 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW15462%27 HTTP/1.1" 200 None
2026-03-29 18:40:34 [auto1.de] INFO: Scrape type for FW15462: 2
2026-03-29 18:40:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83671081-7c85-55e2-9e1a-c19b2d67a221 with identifier: FW15462
2026-03-29 18:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83671081-7c85-55e2-9e1a-c19b2d67a221 with scrape type 2
2026-03-29 18:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83671081-7c85-55e2-9e1a-c19b2d67a221 with scrape type 2
2026-03-29 18:40:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83671081-7c85-55e2-9e1a-c19b2d67a221, identifier: FW15462
2026-03-29 18:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83671081-7c85-55e2-9e1a-c19b2d67a221 with identifier: FW15462
2026-03-29 18:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83671081-7c85-55e2-9e1a-c19b2d67a221 with identifier: FW15462
2026-03-29 18:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83671081-7c85-55e2-9e1a-c19b2d67a221 with identifier: FW15462 to the API
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:14:57Z',
'fuel_type': 'diesel',
'id': '83671081-7c85-55e2-9e1a-c19b2d67a221',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW15462',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia',
'odometer': 261456,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-02',
'seller_name': None,
'title': 'Opel Insignia 2.0 CDTI Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2012}
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW15462%27 HTTP/1.1" 200 None
2026-03-29 18:40:35 [auto1.de] INFO: Saving data for FW15462: {'auction_closing_time': 1774883697.0, 'created_time': 1774118597.909569, 'last_price_update_time': 1774809635.239392}
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW15462') HTTP/1.1" 204 0
2026-03-29 18:40:35 [auto1.de] INFO: Found listing with ID: UA03321
2026-03-29 18:40:35 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-29 18:40:35 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-29 18:40:35 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH97983%27 HTTP/1.1" 200 None
2026-03-29 18:40:35 [auto1.de] INFO: Scrape type for AH97983: 2
2026-03-29 18:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with identifier: AH97983
2026-03-29 18:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with scrape type 2
2026-03-29 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with scrape type 2
2026-03-29 18:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951, identifier: AH97983
2026-03-29 18:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with identifier: AH97983
2026-03-29 18:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with identifier: AH97983
2026-03-29 18:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with identifier: AH97983 to the API
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:22:25Z',
'fuel_type': 'diesel',
'id': 'cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH97983',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 173774,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-09',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH97983%27 HTTP/1.1" 200 None
2026-03-29 18:40:35 [auto1.de] INFO: Saving data for AH97983: {'auction_closing_time': 1774884145.0, 'created_time': 1773399961.892188, 'last_price_update_time': 1774809635.725689}
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH97983') HTTP/1.1" 204 0
2026-03-29 18:40:35 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-29 18:40:35 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW82351%27 HTTP/1.1" 200 None
2026-03-29 18:40:35 [auto1.de] INFO: Scrape type for DW82351: 2
2026-03-29 18:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0 with identifier: DW82351
2026-03-29 18:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0 with scrape type 2
2026-03-29 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0 with scrape type 2
2026-03-29 18:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0, identifier: DW82351
2026-03-29 18:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0 with identifier: DW82351
2026-03-29 18:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0 with identifier: DW82351
2026-03-29 18:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0 with identifier: DW82351 to the API
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:31:04Z',
'fuel_type': 'hybrid',
'id': '3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW82351',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 31654,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-06',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 250e AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2020}
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW82351%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Saving data for DW82351: {'auction_closing_time': 1774884664.0, 'created_time': 1774549860.863351, 'last_price_update_time': 1774809636.146451}
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW82351') HTTP/1.1" 204 0
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK16564%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for ZK16564: 0
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP64585%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for NP64585: 0
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW33443%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for RW33443: 0
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK41294%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for AK41294: 0
2026-03-29 18:40:36 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ25575%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for EJ25575: 0
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG01443%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for EG01443: 2
2026-03-29 18:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19c138f-460c-535d-869f-4eec7e1c6d68 with identifier: EG01443
2026-03-29 18:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19c138f-460c-535d-869f-4eec7e1c6d68 with scrape type 2
2026-03-29 18:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b19c138f-460c-535d-869f-4eec7e1c6d68 with scrape type 2
2026-03-29 18:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b19c138f-460c-535d-869f-4eec7e1c6d68, identifier: EG01443
2026-03-29 18:40:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b19c138f-460c-535d-869f-4eec7e1c6d68 with identifier: EG01443
2026-03-29 18:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b19c138f-460c-535d-869f-4eec7e1c6d68 with identifier: EG01443
2026-03-29 18:40:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b19c138f-460c-535d-869f-4eec7e1c6d68 with identifier: EG01443 to the API
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:11:28Z',
'fuel_type': 'diesel',
'id': 'b19c138f-460c-535d-869f-4eec7e1c6d68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG01443',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 216114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-08',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 HDi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2010}
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG01443%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Saving data for EG01443: {'auction_closing_time': 1774883488.0, 'created_time': 1774349808.324643, 'last_price_update_time': 1774809636.686022}
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG01443') HTTP/1.1" 204 0
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE86723%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for XE86723: 0
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX31727%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for ZX31727: 0
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU04688%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for ZU04688: 0
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF09730%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for BF09730: 0
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA06342%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for JA06342: 2
2026-03-29 18:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fb65382-5a5d-5408-982f-47aaf084ee68 with identifier: JA06342
2026-03-29 18:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fb65382-5a5d-5408-982f-47aaf084ee68 with scrape type 2
2026-03-29 18:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fb65382-5a5d-5408-982f-47aaf084ee68 with scrape type 2
2026-03-29 18:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fb65382-5a5d-5408-982f-47aaf084ee68, identifier: JA06342
2026-03-29 18:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fb65382-5a5d-5408-982f-47aaf084ee68 with identifier: JA06342
2026-03-29 18:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fb65382-5a5d-5408-982f-47aaf084ee68 with identifier: JA06342
2026-03-29 18:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fb65382-5a5d-5408-982f-47aaf084ee68 with identifier: JA06342 to the API
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:39:32Z',
'fuel_type': 'petrol',
'id': '9fb65382-5a5d-5408-982f-47aaf084ee68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA06342',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 20755,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-05',
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2024}
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA06342%27 HTTP/1.1" 200 None
2026-03-29 18:40:37 [auto1.de] INFO: Saving data for JA06342: {'auction_closing_time': 1774885172.0, 'created_time': 1773306904.182167, 'last_price_update_time': 1774809637.293293}
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA06342') HTTP/1.1" 204 0
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB64458%27 HTTP/1.1" 200 None
2026-03-29 18:40:37 [auto1.de] INFO: Scrape type for NB64458: 0
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR91039%27 HTTP/1.1" 200 None
2026-03-29 18:40:37 [auto1.de] INFO: Scrape type for PR91039: 0
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV47016%27 HTTP/1.1" 200 None
2026-03-29 18:40:37 [auto1.de] INFO: Scrape type for BV47016: 2
2026-03-29 18:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67dac53d-45c6-5d07-98d4-bbc43186c703 with identifier: BV47016
2026-03-29 18:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67dac53d-45c6-5d07-98d4-bbc43186c703 with scrape type 2
2026-03-29 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67dac53d-45c6-5d07-98d4-bbc43186c703 with scrape type 2
2026-03-29 18:40:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67dac53d-45c6-5d07-98d4-bbc43186c703, identifier: BV47016
2026-03-29 18:40:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67dac53d-45c6-5d07-98d4-bbc43186c703 with identifier: BV47016
2026-03-29 18:40:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67dac53d-45c6-5d07-98d4-bbc43186c703 with identifier: BV47016
2026-03-29 18:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67dac53d-45c6-5d07-98d4-bbc43186c703 with identifier: BV47016 to the API
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:06:07Z',
'fuel_type': 'petrol',
'id': '67dac53d-45c6-5d07-98d4-bbc43186c703',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV47016',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 57688,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-28',
'seller_name': None,
'title': 'Renault Kadjar 1.3 TCe Black Edition',
'transmission': 'automatic',
'trim': 'Black Edition',
'year': 2021}
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV47016%27 HTTP/1.1" 200 None
2026-03-29 18:40:37 [auto1.de] INFO: Saving data for BV47016: {'auction_closing_time': 1774883167.0, 'created_time': 1773469072.383074, 'last_price_update_time': 1774809637.853672}
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV47016') HTTP/1.1" 204 0
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY22077%27 HTTP/1.1" 200 None
2026-03-29 18:40:37 [auto1.de] INFO: Scrape type for ZY22077: 0
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53222%27 HTTP/1.1" 200 None
2026-03-29 18:40:37 [auto1.de] INFO: Scrape type for GK53222: 2
2026-03-29 18:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with identifier: GK53222
2026-03-29 18:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with scrape type 2
2026-03-29 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with scrape type 2
2026-03-29 18:40:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f6b90a9-f227-5897-8d1f-0d66eacebe13, identifier: GK53222
2026-03-29 18:40:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with identifier: GK53222
2026-03-29 18:40:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with identifier: GK53222
2026-03-29 18:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with identifier: GK53222 to the API
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:42:11Z',
'fuel_type': 'petrol',
'id': '4f6b90a9-f227-5897-8d1f-0d66eacebe13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK53222',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 61292,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-18',
'seller_name': None,
'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2019}
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53222%27 HTTP/1.1" 200 None
2026-03-29 18:40:38 [auto1.de] INFO: Saving data for GK53222: {'auction_closing_time': 1774885331.0, 'created_time': 1773776049.702604, 'last_price_update_time': 1774809638.331035}
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK53222') HTTP/1.1" 204 0
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC50370%27 HTTP/1.1" 200 None
2026-03-29 18:40:38 [auto1.de] INFO: Scrape type for YC50370: 2
2026-03-29 18:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c37afce-6f2f-5a08-a48b-40582aeccdc7 with identifier: YC50370
2026-03-29 18:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c37afce-6f2f-5a08-a48b-40582aeccdc7 with scrape type 2
2026-03-29 18:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c37afce-6f2f-5a08-a48b-40582aeccdc7 with scrape type 2
2026-03-29 18:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c37afce-6f2f-5a08-a48b-40582aeccdc7, identifier: YC50370
2026-03-29 18:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c37afce-6f2f-5a08-a48b-40582aeccdc7 with identifier: YC50370
2026-03-29 18:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c37afce-6f2f-5a08-a48b-40582aeccdc7 with identifier: YC50370
2026-03-29 18:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c37afce-6f2f-5a08-a48b-40582aeccdc7 with identifier: YC50370 to the API
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 285,
'expiration_date': '2026-03-30T15:59:32Z',
'fuel_type': 'diesel',
'id': '8c37afce-6f2f-5a08-a48b-40582aeccdc7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC50370',
'listing': 'auction',
'make': 'Audi',
'model': 'A8',
'odometer': 210860,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-19',
'seller_name': None,
'title': 'Audi A8 3.0 TDI Mild-Hybrid L 50 quattro',
'transmission': 'automatic',
'trim': 'L 50 quattro',
'year': 2020}
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC50370%27 HTTP/1.1" 200 None
2026-03-29 18:40:38 [auto1.de] INFO: Saving data for YC50370: {'auction_closing_time': 1774886372.0, 'created_time': 1774521336.392803, 'last_price_update_time': 1774809638.732969}
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC50370') HTTP/1.1" 204 0
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT24863%27 HTTP/1.1" 200 None
2026-03-29 18:40:38 [auto1.de] INFO: Scrape type for HT24863: 0
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ26894%27 HTTP/1.1" 200 None
2026-03-29 18:40:38 [auto1.de] INFO: Scrape type for MZ26894: 2
2026-03-29 18:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with identifier: MZ26894
2026-03-29 18:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with scrape type 2
2026-03-29 18:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with scrape type 2
2026-03-29 18:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9687abe6-7ee1-5d7a-a821-4c58d61c0379, identifier: MZ26894
2026-03-29 18:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with identifier: MZ26894
2026-03-29 18:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with identifier: MZ26894
2026-03-29 18:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with identifier: MZ26894 to the API
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:13:40Z',
'fuel_type': 'petrol',
'id': '9687abe6-7ee1-5d7a-a821-4c58d61c0379',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ26894',
'listing': 'auction',
'make': 'Skoda',
'model': 'Roomster',
'odometer': 139556,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-26',
'seller_name': None,
'title': 'Skoda Roomster 1.2 TSI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2012}
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ26894%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Saving data for MZ26894: {'auction_closing_time': 1774883620.0, 'created_time': 1773686256.30235, 'last_price_update_time': 1774809639.318805}
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ26894') HTTP/1.1" 204 0
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF59932%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Scrape type for XF59932: 2
2026-03-29 18:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 708b719d-b1cb-56f7-8021-102749ddb47e with identifier: XF59932
2026-03-29 18:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 708b719d-b1cb-56f7-8021-102749ddb47e with scrape type 2
2026-03-29 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 708b719d-b1cb-56f7-8021-102749ddb47e with scrape type 2
2026-03-29 18:40:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 708b719d-b1cb-56f7-8021-102749ddb47e, identifier: XF59932
2026-03-29 18:40:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 708b719d-b1cb-56f7-8021-102749ddb47e with identifier: XF59932
2026-03-29 18:40:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 708b719d-b1cb-56f7-8021-102749ddb47e with identifier: XF59932
2026-03-29 18:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 708b719d-b1cb-56f7-8021-102749ddb47e with identifier: XF59932 to the API
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:06:33Z',
'fuel_type': 'diesel',
'id': '708b719d-b1cb-56f7-8021-102749ddb47e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF59932',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 318443,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-07',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2016}
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF59932%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Saving data for XF59932: {'auction_closing_time': 1774883193.0, 'created_time': 1774521955.245323, 'last_price_update_time': 1774809639.755402}
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF59932') HTTP/1.1" 204 0
2026-03-29 18:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC04315%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Scrape type for RC04315: 0
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS21978%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Scrape type for XS21978: 0
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG70236%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Scrape type for JG70236: 0
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY07264%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Scrape type for CY07264: 0
2026-03-29 18:40:39 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP03676%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Scrape type for CP03676: 0
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14183%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Scrape type for BS14183: 2
2026-03-29 18:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with identifier: BS14183
2026-03-29 18:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with scrape type 2
2026-03-29 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with scrape type 2
2026-03-29 18:40:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccde1fa7-8f30-5cff-ac77-cf11bf9f344e, identifier: BS14183
2026-03-29 18:40:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with identifier: BS14183
2026-03-29 18:40:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with identifier: BS14183
2026-03-29 18:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with identifier: BS14183 to the API
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:22:13Z',
'fuel_type': 'diesel',
'id': 'ccde1fa7-8f30-5cff-ac77-cf11bf9f344e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS14183',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 318606,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-21',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2012}
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14183%27 HTTP/1.1" 200 None
2026-03-29 18:40:40 [auto1.de] INFO: Saving data for BS14183: {'auction_closing_time': 1774884133.0, 'created_time': 1773657878.991557, 'last_price_update_time': 1774809640.359937}
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS14183') HTTP/1.1" 204 0
2026-03-29 18:40:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:40 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM68518%27 HTTP/1.1" 200 None
2026-03-29 18:40:40 [auto1.de] INFO: Scrape type for CM68518: 0
2026-03-29 18:40:40 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-29 18:40:40 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL51955%27 HTTP/1.1" 200 None
2026-03-29 18:40:40 [auto1.de] INFO: Scrape type for FL51955: 0
2026-03-29 18:40:40 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT69693%27 HTTP/1.1" 200 None
2026-03-29 18:40:40 [auto1.de] INFO: Scrape type for BT69693: 2
2026-03-29 18:40:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8baf42f3-bbe7-5155-b4b8-b4a42e6bd400 with identifier: BT69693
2026-03-29 18:40:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8baf42f3-bbe7-5155-b4b8-b4a42e6bd400 with scrape type 2
2026-03-29 18:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8baf42f3-bbe7-5155-b4b8-b4a42e6bd400 with scrape type 2
2026-03-29 18:40:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8baf42f3-bbe7-5155-b4b8-b4a42e6bd400, identifier: BT69693
2026-03-29 18:40:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8baf42f3-bbe7-5155-b4b8-b4a42e6bd400 with identifier: BT69693
2026-03-29 18:40:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8baf42f3-bbe7-5155-b4b8-b4a42e6bd400 with identifier: BT69693
2026-03-29 18:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8baf42f3-bbe7-5155-b4b8-b4a42e6bd400 with identifier: BT69693 to the API
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:30:46Z',
'fuel_type': 'diesel',
'id': '8baf42f3-bbe7-5155-b4b8-b4a42e6bd400',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT69693',
'listing': 'auction',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 98337,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-23',
'seller_name': None,
'title': 'Nissan X-Trail 2.0 dCi N-Connecta 4x4',
'transmission': 'manual',
'trim': 'N-Connecta 4x4',
'year': 2018}
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT69693%27 HTTP/1.1" 200 None
2026-03-29 18:40:41 [auto1.de] INFO: Saving data for BT69693: {'auction_closing_time': 1774884646.0, 'created_time': 1774510243.372295, 'last_price_update_time': 1774809641.063185}
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT69693') HTTP/1.1" 204 0
2026-03-29 18:40:41 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ17739%27 HTTP/1.1" 200 None
2026-03-29 18:40:41 [auto1.de] INFO: Scrape type for ZJ17739: 2
2026-03-29 18:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47c5e322-430f-5d74-ae67-7f4abef66daf with identifier: ZJ17739
2026-03-29 18:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47c5e322-430f-5d74-ae67-7f4abef66daf with scrape type 2
2026-03-29 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47c5e322-430f-5d74-ae67-7f4abef66daf with scrape type 2
2026-03-29 18:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47c5e322-430f-5d74-ae67-7f4abef66daf, identifier: ZJ17739
2026-03-29 18:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47c5e322-430f-5d74-ae67-7f4abef66daf with identifier: ZJ17739
2026-03-29 18:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47c5e322-430f-5d74-ae67-7f4abef66daf with identifier: ZJ17739
2026-03-29 18:40:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47c5e322-430f-5d74-ae67-7f4abef66daf with identifier: ZJ17739 to the API
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:45:57Z',
'fuel_type': 'petrol',
'id': '47c5e322-430f-5d74-ae67-7f4abef66daf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ17739',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 195266,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-15',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2013}
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ17739%27 HTTP/1.1" 200 None
2026-03-29 18:40:41 [auto1.de] INFO: Saving data for ZJ17739: {'auction_closing_time': 1774885557.0, 'created_time': 1774521303.723928, 'last_price_update_time': 1774809641.586995}
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ17739') HTTP/1.1" 204 0
2026-03-29 18:40:41 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-29 18:40:41 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-29 18:40:41 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-29 18:40:41 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-29 18:40:41 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD13909%27 HTTP/1.1" 200 None
2026-03-29 18:40:41 [auto1.de] INFO: Scrape type for JD13909: 0
2026-03-29 18:40:41 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF11415%27 HTTP/1.1" 200 None
2026-03-29 18:40:41 [auto1.de] INFO: Scrape type for TF11415: 2
2026-03-29 18:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e13dba2c-13a0-548b-921d-6f253b3f702b with identifier: TF11415
2026-03-29 18:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e13dba2c-13a0-548b-921d-6f253b3f702b with scrape type 2
2026-03-29 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e13dba2c-13a0-548b-921d-6f253b3f702b with scrape type 2
2026-03-29 18:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e13dba2c-13a0-548b-921d-6f253b3f702b, identifier: TF11415
2026-03-29 18:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e13dba2c-13a0-548b-921d-6f253b3f702b with identifier: TF11415
2026-03-29 18:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e13dba2c-13a0-548b-921d-6f253b3f702b with identifier: TF11415
2026-03-29 18:40:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e13dba2c-13a0-548b-921d-6f253b3f702b with identifier: TF11415 to the API
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:02:47Z',
'fuel_type': 'diesel',
'id': 'e13dba2c-13a0-548b-921d-6f253b3f702b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF11415',
'listing': 'auction',
'make': 'Nissan',
'model': 'Note',
'odometer': 64319,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-26',
'seller_name': None,
'title': 'Nissan Note 1.5 dCi I-Way',
'transmission': 'manual',
'trim': 'I-Way',
'year': 2013}
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF11415%27 HTTP/1.1" 200 None
2026-03-29 18:40:42 [auto1.de] INFO: Saving data for TF11415: {'auction_closing_time': 1774882967.0, 'created_time': 1773858984.851893, 'last_price_update_time': 1774809642.051863}
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF11415') HTTP/1.1" 204 0
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG31115%27 HTTP/1.1" 200 None
2026-03-29 18:40:42 [auto1.de] INFO: Scrape type for LG31115: 2
2026-03-29 18:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with identifier: LG31115
2026-03-29 18:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with scrape type 2
2026-03-29 18:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with scrape type 2
2026-03-29 18:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c82f2fe-4503-53aa-8263-f7cdd614fda7, identifier: LG31115
2026-03-29 18:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with identifier: LG31115
2026-03-29 18:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with identifier: LG31115
2026-03-29 18:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with identifier: LG31115 to the API
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:10:16Z',
'fuel_type': 'petrol',
'id': '4c82f2fe-4503-53aa-8263-f7cdd614fda7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG31115',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 139869,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-21',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.0 TSI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2017}
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG31115%27 HTTP/1.1" 200 None
2026-03-29 18:40:42 [auto1.de] INFO: Saving data for LG31115: {'auction_closing_time': 1774883416.0, 'created_time': 1774292016.506207, 'last_price_update_time': 1774809642.683019}
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG31115') HTTP/1.1" 204 0
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS62021%27 HTTP/1.1" 200 None
2026-03-29 18:40:42 [auto1.de] INFO: Scrape type for JS62021: 0
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR15708%27 HTTP/1.1" 200 None
2026-03-29 18:40:42 [auto1.de] INFO: Scrape type for KR15708: 0
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS43037%27 HTTP/1.1" 200 None
2026-03-29 18:40:42 [auto1.de] INFO: Scrape type for MS43037: 0
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE35783%27 HTTP/1.1" 200 None
2026-03-29 18:40:42 [auto1.de] INFO: Scrape type for DE35783: 2
2026-03-29 18:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6633aba6-c9aa-5a57-a6f9-062945d9cd5e with identifier: DE35783
2026-03-29 18:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6633aba6-c9aa-5a57-a6f9-062945d9cd5e with scrape type 2
2026-03-29 18:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6633aba6-c9aa-5a57-a6f9-062945d9cd5e with scrape type 2
2026-03-29 18:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6633aba6-c9aa-5a57-a6f9-062945d9cd5e, identifier: DE35783
2026-03-29 18:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6633aba6-c9aa-5a57-a6f9-062945d9cd5e with identifier: DE35783
2026-03-29 18:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6633aba6-c9aa-5a57-a6f9-062945d9cd5e with identifier: DE35783
2026-03-29 18:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6633aba6-c9aa-5a57-a6f9-062945d9cd5e with identifier: DE35783 to the API
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 280,
'expiration_date': '2026-03-30T15:14:46Z',
'fuel_type': 'petrol',
'id': '6633aba6-c9aa-5a57-a6f9-062945d9cd5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE35783',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 125488,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-23',
'seller_name': None,
'title': 'Seat Leon 2.0 TSI Cupra 280',
'transmission': 'automatic',
'trim': 'Cupra 280',
'year': 2014}
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE35783%27 HTTP/1.1" 200 None
2026-03-29 18:40:43 [auto1.de] INFO: Saving data for DE35783: {'auction_closing_time': 1774883686.0, 'created_time': 1774118507.792209, 'last_price_update_time': 1774809643.156082}
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE35783') HTTP/1.1" 204 0
2026-03-29 18:40:43 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX71045%27 HTTP/1.1" 200 None
2026-03-29 18:40:43 [auto1.de] INFO: Scrape type for UX71045: 2
2026-03-29 18:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2edc74-54cf-5d4f-b79e-0971b0d785cf with identifier: UX71045
2026-03-29 18:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2edc74-54cf-5d4f-b79e-0971b0d785cf with scrape type 2
2026-03-29 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da2edc74-54cf-5d4f-b79e-0971b0d785cf with scrape type 2
2026-03-29 18:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da2edc74-54cf-5d4f-b79e-0971b0d785cf, identifier: UX71045
2026-03-29 18:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da2edc74-54cf-5d4f-b79e-0971b0d785cf with identifier: UX71045
2026-03-29 18:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da2edc74-54cf-5d4f-b79e-0971b0d785cf with identifier: UX71045
2026-03-29 18:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da2edc74-54cf-5d4f-b79e-0971b0d785cf with identifier: UX71045 to the API
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:36:04Z',
'fuel_type': 'petrol',
'id': 'da2edc74-54cf-5d4f-b79e-0971b0d785cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX71045',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLC-Klasse',
'odometer': 146465,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-03',
'seller_name': None,
'title': 'Mercedes-Benz SLC-Klasse SLC 300 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2017}
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX71045%27 HTTP/1.1" 200 None
2026-03-29 18:40:43 [auto1.de] INFO: Saving data for UX71045: {'auction_closing_time': 1774884964.0, 'created_time': 1773306358.837761, 'last_price_update_time': 1774809643.620534}
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX71045') HTTP/1.1" 204 0
2026-03-29 18:40:43 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-29 18:40:43 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-29 18:40:43 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS30363%27 HTTP/1.1" 200 None
2026-03-29 18:40:43 [auto1.de] INFO: Scrape type for WS30363: 2
2026-03-29 18:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with identifier: WS30363
2026-03-29 18:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with scrape type 2
2026-03-29 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with scrape type 2
2026-03-29 18:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d40c8af3-85dc-5213-beaf-c8ffeb1c4308, identifier: WS30363
2026-03-29 18:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with identifier: WS30363
2026-03-29 18:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with identifier: WS30363
2026-03-29 18:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with identifier: WS30363 to the API
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:10:13Z',
'fuel_type': 'diesel',
'id': 'd40c8af3-85dc-5213-beaf-c8ffeb1c4308',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS30363',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 183701,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-21',
'seller_name': None,
'title': 'BMW 1er 116d',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS30363%27 HTTP/1.1" 200 None
2026-03-29 18:40:44 [auto1.de] INFO: Saving data for WS30363: {'auction_closing_time': 1774883413.0, 'created_time': 1773776182.625323, 'last_price_update_time': 1774809644.177597}
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS30363') HTTP/1.1" 204 0
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS47503%27 HTTP/1.1" 200 None
2026-03-29 18:40:44 [auto1.de] INFO: Scrape type for NS47503: 2
2026-03-29 18:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with identifier: NS47503
2026-03-29 18:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with scrape type 2
2026-03-29 18:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with scrape type 2
2026-03-29 18:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a, identifier: NS47503
2026-03-29 18:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with identifier: NS47503
2026-03-29 18:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with identifier: NS47503
2026-03-29 18:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with identifier: NS47503 to the API
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:46:32Z',
'fuel_type': 'diesel',
'id': '6b89ff2f-91d0-5d9b-a384-66cb3c07d38a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS47503',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 256494,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-25',
'seller_name': None,
'title': 'BMW 5er 525d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS47503%27 HTTP/1.1" 200 None
2026-03-29 18:40:44 [auto1.de] INFO: Saving data for NS47503: {'auction_closing_time': 1774885592.0, 'created_time': 1773306347.091123, 'last_price_update_time': 1774809644.682617}
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS47503') HTTP/1.1" 204 0
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69443%27 HTTP/1.1" 200 None
2026-03-29 18:40:44 [auto1.de] INFO: Scrape type for HB69443: 2
2026-03-29 18:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b25a198-d146-57be-a887-728299e787cb with identifier: HB69443
2026-03-29 18:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b25a198-d146-57be-a887-728299e787cb with scrape type 2
2026-03-29 18:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b25a198-d146-57be-a887-728299e787cb with scrape type 2
2026-03-29 18:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b25a198-d146-57be-a887-728299e787cb, identifier: HB69443
2026-03-29 18:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b25a198-d146-57be-a887-728299e787cb with identifier: HB69443
2026-03-29 18:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b25a198-d146-57be-a887-728299e787cb with identifier: HB69443
2026-03-29 18:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b25a198-d146-57be-a887-728299e787cb with identifier: HB69443 to the API
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 354,
'expiration_date': '2026-03-30T15:16:04Z',
'fuel_type': 'petrol',
'id': '9b25a198-d146-57be-a887-728299e787cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB69443',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 124319,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-26',
'seller_name': None,
'title': 'Porsche Macan S',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69443%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Saving data for HB69443: {'auction_closing_time': 1774883764.0, 'created_time': 1774607665.52394, 'last_price_update_time': 1774809645.126234}
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB69443') HTTP/1.1" 204 0
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU97464%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Scrape type for HU97464: 0
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB16360%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Scrape type for EB16360: 0
2026-03-29 18:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:45 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67874%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Scrape type for MH67874: 0
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91638%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Scrape type for FY91638: 0
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC05662%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Scrape type for SC05662: 0
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31894%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Scrape type for KL31894: 2
2026-03-29 18:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with identifier: KL31894
2026-03-29 18:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with scrape type 2
2026-03-29 18:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with scrape type 2
2026-03-29 18:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7, identifier: KL31894
2026-03-29 18:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with identifier: KL31894
2026-03-29 18:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with identifier: KL31894
2026-03-29 18:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with identifier: KL31894 to the API
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:43:42Z',
'fuel_type': 'diesel',
'id': '17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL31894',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 208008,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-17',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 CDI Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2016}
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31894%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Saving data for KL31894: {'auction_closing_time': 1774885422.0, 'created_time': 1773945787.355259, 'last_price_update_time': 1774809645.839768}
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL31894') HTTP/1.1" 204 0
2026-03-29 18:40:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25483%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Scrape type for LJ25483: 0
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF03511%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Scrape type for LF03511: 2
2026-03-29 18:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a758a659-716e-5297-8a6b-9aeaccb932cf with identifier: LF03511
2026-03-29 18:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a758a659-716e-5297-8a6b-9aeaccb932cf with scrape type 2
2026-03-29 18:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a758a659-716e-5297-8a6b-9aeaccb932cf with scrape type 2
2026-03-29 18:40:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a758a659-716e-5297-8a6b-9aeaccb932cf, identifier: LF03511
2026-03-29 18:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a758a659-716e-5297-8a6b-9aeaccb932cf with identifier: LF03511
2026-03-29 18:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a758a659-716e-5297-8a6b-9aeaccb932cf with identifier: LF03511
2026-03-29 18:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a758a659-716e-5297-8a6b-9aeaccb932cf with identifier: LF03511 to the API
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:32:12Z',
'fuel_type': 'diesel',
'id': 'a758a659-716e-5297-8a6b-9aeaccb932cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF03511',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 383480,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-31',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.6 TDI Team BlueMotion',
'transmission': 'manual',
'trim': 'Team BlueMotion',
'year': 2011}
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF03511%27 HTTP/1.1" 200 None
2026-03-29 18:40:46 [auto1.de] INFO: Saving data for LF03511: {'auction_closing_time': 1774884732.0, 'created_time': 1774607759.881561, 'last_price_update_time': 1774809646.467968}
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF03511') HTTP/1.1" 204 0
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC37998%27 HTTP/1.1" 200 None
2026-03-29 18:40:46 [auto1.de] INFO: Scrape type for RC37998: 2
2026-03-29 18:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba885203-b1ca-5466-9768-6753981ab855 with identifier: RC37998
2026-03-29 18:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba885203-b1ca-5466-9768-6753981ab855 with scrape type 2
2026-03-29 18:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba885203-b1ca-5466-9768-6753981ab855 with scrape type 2
2026-03-29 18:40:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba885203-b1ca-5466-9768-6753981ab855, identifier: RC37998
2026-03-29 18:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba885203-b1ca-5466-9768-6753981ab855 with identifier: RC37998
2026-03-29 18:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba885203-b1ca-5466-9768-6753981ab855 with identifier: RC37998
2026-03-29 18:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba885203-b1ca-5466-9768-6753981ab855 with identifier: RC37998 to the API
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:19:24Z',
'fuel_type': 'petrol',
'id': 'ba885203-b1ca-5466-9768-6753981ab855',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC37998',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 132001,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-16',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC37998%27 HTTP/1.1" 200 None
2026-03-29 18:40:46 [auto1.de] INFO: Saving data for RC37998: {'auction_closing_time': 1774883964.0, 'created_time': 1774636285.547003, 'last_price_update_time': 1774809646.878588}
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC37998') HTTP/1.1" 204 0
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV91936%27 HTTP/1.1" 200 None
2026-03-29 18:40:46 [auto1.de] INFO: Scrape type for RV91936: 0
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV72825%27 HTTP/1.1" 200 None
2026-03-29 18:40:46 [auto1.de] INFO: Scrape type for BV72825: 0
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY17492%27 HTTP/1.1" 200 None
2026-03-29 18:40:46 [auto1.de] INFO: Scrape type for FY17492: 0
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU64592%27 HTTP/1.1" 200 None
2026-03-29 18:40:46 [auto1.de] INFO: Scrape type for GU64592: 2
2026-03-29 18:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 394387b4-e393-540d-8c98-da0675d2b95f with identifier: GU64592
2026-03-29 18:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 394387b4-e393-540d-8c98-da0675d2b95f with scrape type 2
2026-03-29 18:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 394387b4-e393-540d-8c98-da0675d2b95f with scrape type 2
2026-03-29 18:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 394387b4-e393-540d-8c98-da0675d2b95f, identifier: GU64592
2026-03-29 18:40:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 394387b4-e393-540d-8c98-da0675d2b95f with identifier: GU64592
2026-03-29 18:40:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 394387b4-e393-540d-8c98-da0675d2b95f with identifier: GU64592
2026-03-29 18:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 394387b4-e393-540d-8c98-da0675d2b95f with identifier: GU64592 to the API
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:46:40Z',
'fuel_type': 'diesel',
'id': '394387b4-e393-540d-8c98-da0675d2b95f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU64592',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 213400,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-10',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2013}
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU64592%27 HTTP/1.1" 200 None
2026-03-29 18:40:47 [auto1.de] INFO: Saving data for GU64592: {'auction_closing_time': 1774885600.0, 'created_time': 1773427208.600461, 'last_price_update_time': 1774809647.354011}
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU64592') HTTP/1.1" 204 0
2026-03-29 18:40:47 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78682%27 HTTP/1.1" 200 None
2026-03-29 18:40:47 [auto1.de] INFO: Scrape type for RX78682: 2
2026-03-29 18:40:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45437b91-973d-5635-a29a-02562e370deb with identifier: RX78682
2026-03-29 18:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45437b91-973d-5635-a29a-02562e370deb with scrape type 2
2026-03-29 18:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45437b91-973d-5635-a29a-02562e370deb with scrape type 2
2026-03-29 18:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45437b91-973d-5635-a29a-02562e370deb, identifier: RX78682
2026-03-29 18:40:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45437b91-973d-5635-a29a-02562e370deb with identifier: RX78682
2026-03-29 18:40:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45437b91-973d-5635-a29a-02562e370deb with identifier: RX78682
2026-03-29 18:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45437b91-973d-5635-a29a-02562e370deb with identifier: RX78682 to the API
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:42:45Z',
'fuel_type': 'diesel',
'id': '45437b91-973d-5635-a29a-02562e370deb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX78682',
'listing': 'auction',
'make': 'Hyundai',
'model': 'H1',
'odometer': 186968,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-15',
'seller_name': None,
'title': 'Hyundai H1 2.5 CRDi Travel Trend',
'transmission': 'automatic',
'trim': 'Travel Trend',
'year': 2017}
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78682%27 HTTP/1.1" 200 None
2026-03-29 18:40:47 [auto1.de] INFO: Saving data for RX78682: {'auction_closing_time': 1774885365.0, 'created_time': 1773917164.436302, 'last_price_update_time': 1774809647.870217}
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX78682') HTTP/1.1" 204 0
2026-03-29 18:40:47 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-29 18:40:47 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-29 18:40:47 [auto1.de] INFO: Found listing with ID: UP35116
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP35116%27 HTTP/1.1" 200 None
2026-03-29 18:40:47 [auto1.de] INFO: Scrape type for UP35116: 2
2026-03-29 18:40:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b059128e-25dc-536a-8b18-8c3e0c2c3429 with identifier: UP35116
2026-03-29 18:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b059128e-25dc-536a-8b18-8c3e0c2c3429 with scrape type 2
2026-03-29 18:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b059128e-25dc-536a-8b18-8c3e0c2c3429 with scrape type 2
2026-03-29 18:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b059128e-25dc-536a-8b18-8c3e0c2c3429, identifier: UP35116
2026-03-29 18:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b059128e-25dc-536a-8b18-8c3e0c2c3429 with identifier: UP35116
2026-03-29 18:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b059128e-25dc-536a-8b18-8c3e0c2c3429 with identifier: UP35116
2026-03-29 18:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b059128e-25dc-536a-8b18-8c3e0c2c3429 with identifier: UP35116 to the API
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:22:27Z',
'fuel_type': 'diesel',
'id': 'b059128e-25dc-536a-8b18-8c3e0c2c3429',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP35116',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 266807,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-29',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Move',
'transmission': 'manual',
'trim': 'Move',
'year': 2012}
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP35116%27 HTTP/1.1" 200 None
2026-03-29 18:40:48 [auto1.de] INFO: Saving data for UP35116: {'auction_closing_time': 1774884147.0, 'created_time': 1774722938.076379, 'last_price_update_time': 1774809648.277114}
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP35116') HTTP/1.1" 204 0
2026-03-29 18:40:48 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-29 18:40:48 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV37503%27 HTTP/1.1" 200 None
2026-03-29 18:40:48 [auto1.de] INFO: Scrape type for SV37503: 2
2026-03-29 18:40:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with identifier: SV37503
2026-03-29 18:40:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with scrape type 2
2026-03-29 18:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with scrape type 2
2026-03-29 18:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76a6c93f-6dcb-5cde-b2e2-506bb6118118, identifier: SV37503
2026-03-29 18:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with identifier: SV37503
2026-03-29 18:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with identifier: SV37503
2026-03-29 18:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with identifier: SV37503 to the API
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:12:22Z',
'fuel_type': 'diesel',
'id': '76a6c93f-6dcb-5cde-b2e2-506bb6118118',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV37503',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 217870,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-06',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2011}
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV37503%27 HTTP/1.1" 200 None
2026-03-29 18:40:48 [auto1.de] INFO: Saving data for SV37503: {'auction_closing_time': 1774883542.0, 'created_time': 1773305142.114816, 'last_price_update_time': 1774809648.77261}
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV37503') HTTP/1.1" 204 0
2026-03-29 18:40:48 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-29 18:40:48 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-29 18:40:48 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69696%27 HTTP/1.1" 200 None
2026-03-29 18:40:48 [auto1.de] INFO: Scrape type for SV69696: 2
2026-03-29 18:40:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fde94542-025c-5bf8-b981-0abead488954 with identifier: SV69696
2026-03-29 18:40:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fde94542-025c-5bf8-b981-0abead488954 with scrape type 2
2026-03-29 18:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fde94542-025c-5bf8-b981-0abead488954 with scrape type 2
2026-03-29 18:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fde94542-025c-5bf8-b981-0abead488954, identifier: SV69696
2026-03-29 18:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fde94542-025c-5bf8-b981-0abead488954 with identifier: SV69696
2026-03-29 18:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fde94542-025c-5bf8-b981-0abead488954 with identifier: SV69696
2026-03-29 18:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fde94542-025c-5bf8-b981-0abead488954 with identifier: SV69696 to the API
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:12:51Z',
'fuel_type': 'diesel',
'id': 'fde94542-025c-5bf8-b981-0abead488954',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV69696',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 108785,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-30',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Join',
'transmission': 'automatic',
'trim': 'Join',
'year': 2018}
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69696%27 HTTP/1.1" 200 None
2026-03-29 18:40:49 [auto1.de] INFO: Saving data for SV69696: {'auction_closing_time': 1774883571.0, 'created_time': 1773945479.768048, 'last_price_update_time': 1774809649.188737}
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV69696') HTTP/1.1" 204 0
2026-03-29 18:40:49 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-29 18:40:49 [auto1.de] INFO: Found listing with ID: AU13367
2026-03-29 18:40:49 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA36034%27 HTTP/1.1" 200 None
2026-03-29 18:40:49 [auto1.de] INFO: Scrape type for BA36034: 2
2026-03-29 18:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f410b642-71d6-5523-9cc7-ef811ebbf347 with identifier: BA36034
2026-03-29 18:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f410b642-71d6-5523-9cc7-ef811ebbf347 with scrape type 2
2026-03-29 18:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f410b642-71d6-5523-9cc7-ef811ebbf347 with scrape type 2
2026-03-29 18:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f410b642-71d6-5523-9cc7-ef811ebbf347, identifier: BA36034
2026-03-29 18:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f410b642-71d6-5523-9cc7-ef811ebbf347 with identifier: BA36034
2026-03-29 18:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f410b642-71d6-5523-9cc7-ef811ebbf347 with identifier: BA36034
2026-03-29 18:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f410b642-71d6-5523-9cc7-ef811ebbf347 with identifier: BA36034 to the API
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:40:16Z',
'fuel_type': 'petrol',
'id': 'f410b642-71d6-5523-9cc7-ef811ebbf347',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA36034',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 147683,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-25',
'seller_name': None,
'title': 'Dacia Sandero 1.2 Essentiel',
'transmission': 'manual',
'trim': 'Essentiel',
'year': 2015}
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA36034%27 HTTP/1.1" 200 None
2026-03-29 18:40:49 [auto1.de] INFO: Saving data for BA36034: {'auction_closing_time': 1774885216.0, 'created_time': 1774293774.302122, 'last_price_update_time': 1774809649.630832}
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA36034') HTTP/1.1" 204 0
2026-03-29 18:40:49 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-29 18:40:49 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-29 18:40:49 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54130%27 HTTP/1.1" 200 None
2026-03-29 18:40:49 [auto1.de] INFO: Scrape type for GT54130: 0
2026-03-29 18:40:49 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-29 18:40:49 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-29 18:40:49 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:49 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-29 18:40:49 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-29 18:40:49 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-29 18:40:49 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX38798%27 HTTP/1.1" 200 None
2026-03-29 18:40:49 [auto1.de] INFO: Scrape type for BX38798: 2
2026-03-29 18:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with identifier: BX38798
2026-03-29 18:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with scrape type 2
2026-03-29 18:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with scrape type 2
2026-03-29 18:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bd4c0a3-c14e-5839-95e1-2832184b0c5e, identifier: BX38798
2026-03-29 18:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with identifier: BX38798
2026-03-29 18:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with identifier: BX38798
2026-03-29 18:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with identifier: BX38798 to the API
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:13:16Z',
'fuel_type': 'diesel',
'id': '3bd4c0a3-c14e-5839-95e1-2832184b0c5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX38798',
'listing': 'auction',
'make': 'Audi',
'model': 'A4 Allroad',
'odometer': 320728,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-20',
'seller_name': None,
'title': 'Audi A4 Allroad 3.0 V6 TDI clean diesel',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX38798%27 HTTP/1.1" 200 None
2026-03-29 18:40:50 [auto1.de] INFO: Saving data for BX38798: {'auction_closing_time': 1774883596.0, 'created_time': 1774349907.772821, 'last_price_update_time': 1774809650.229258}
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX38798') HTTP/1.1" 204 0
2026-03-29 18:40:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:50 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD80559%27 HTTP/1.1" 200 None
2026-03-29 18:40:50 [auto1.de] INFO: Scrape type for ZD80559: 0
2026-03-29 18:40:50 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-29 18:40:50 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD36450%27 HTTP/1.1" 200 None
2026-03-29 18:40:50 [auto1.de] INFO: Scrape type for ZD36450: 0
2026-03-29 18:40:50 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-29 18:40:50 [auto1.de] INFO: Found listing with ID: DJ74321
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74321%27 HTTP/1.1" 200 None
2026-03-29 18:40:50 [auto1.de] INFO: Scrape type for DJ74321: 2
2026-03-29 18:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f32e8e14-78a5-5156-8601-3eac092f8a78 with identifier: DJ74321
2026-03-29 18:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f32e8e14-78a5-5156-8601-3eac092f8a78 with scrape type 2
2026-03-29 18:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f32e8e14-78a5-5156-8601-3eac092f8a78 with scrape type 2
2026-03-29 18:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f32e8e14-78a5-5156-8601-3eac092f8a78, identifier: DJ74321
2026-03-29 18:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f32e8e14-78a5-5156-8601-3eac092f8a78 with identifier: DJ74321
2026-03-29 18:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f32e8e14-78a5-5156-8601-3eac092f8a78 with identifier: DJ74321
2026-03-29 18:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f32e8e14-78a5-5156-8601-3eac092f8a78 with identifier: DJ74321 to the API
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-30T15:01:39Z',
'fuel_type': 'petrol',
'id': 'f32e8e14-78a5-5156-8601-3eac092f8a78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ74321',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 86036,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-29',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Tour',
'transmission': 'manual',
'trim': 'Tour',
'year': 2007}
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74321%27 HTTP/1.1" 200 None
2026-03-29 18:40:50 [auto1.de] INFO: Saving data for DJ74321: {'auction_closing_time': 1774882899.0, 'created_time': 1774002238.319657, 'last_price_update_time': 1774809650.658466}
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ74321') HTTP/1.1" 204 0
2026-03-29 18:40:50 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU72034%27 HTTP/1.1" 200 None
2026-03-29 18:40:50 [auto1.de] INFO: Scrape type for EU72034: 2
2026-03-29 18:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with identifier: EU72034
2026-03-29 18:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with scrape type 2
2026-03-29 18:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with scrape type 2
2026-03-29 18:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4d6d7bb-71d0-543e-8dc1-f6debd3fab26, identifier: EU72034
2026-03-29 18:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with identifier: EU72034
2026-03-29 18:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with identifier: EU72034
2026-03-29 18:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with identifier: EU72034 to the API
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:39:47Z',
'fuel_type': 'diesel',
'id': 'c4d6d7bb-71d0-543e-8dc1-f6debd3fab26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU72034',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 124574,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-17',
'seller_name': None,
'title': 'BMW 3er 330d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU72034%27 HTTP/1.1" 200 None
2026-03-29 18:40:51 [auto1.de] INFO: Saving data for EU72034: {'auction_closing_time': 1774885187.0, 'created_time': 1773307033.754092, 'last_price_update_time': 1774809651.294213}
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU72034') HTTP/1.1" 204 0
2026-03-29 18:40:51 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-29 18:40:51 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-29 18:40:51 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF32306%27 HTTP/1.1" 200 None
2026-03-29 18:40:51 [auto1.de] INFO: Scrape type for YF32306: 2
2026-03-29 18:40:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49 with identifier: YF32306
2026-03-29 18:40:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49 with scrape type 2
2026-03-29 18:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49 with scrape type 2
2026-03-29 18:40:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49, identifier: YF32306
2026-03-29 18:40:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49 with identifier: YF32306
2026-03-29 18:40:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49 with identifier: YF32306
2026-03-29 18:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49 with identifier: YF32306 to the API
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:13:30Z',
'fuel_type': 'petrol',
'id': 'a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF32306',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 118044,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-29',
'seller_name': None,
'title': 'Seat Leon 2.0 TSI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2019}
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF32306%27 HTTP/1.1" 200 None
2026-03-29 18:40:51 [auto1.de] INFO: Saving data for YF32306: {'auction_closing_time': 1774883610.0, 'created_time': 1774549839.742128, 'last_price_update_time': 1774809651.730675}
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF32306') HTTP/1.1" 204 0
2026-03-29 18:40:51 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK18306%27 HTTP/1.1" 200 None
2026-03-29 18:40:51 [auto1.de] INFO: Scrape type for PK18306: 0
2026-03-29 18:40:51 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-29 18:40:51 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-29 18:40:51 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK39186%27 HTTP/1.1" 200 None
2026-03-29 18:40:51 [auto1.de] INFO: Scrape type for PK39186: 2
2026-03-29 18:40:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4158606e-e4a8-564d-8d85-912f6be14261 with identifier: PK39186
2026-03-29 18:40:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4158606e-e4a8-564d-8d85-912f6be14261 with scrape type 2
2026-03-29 18:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4158606e-e4a8-564d-8d85-912f6be14261 with scrape type 2
2026-03-29 18:40:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4158606e-e4a8-564d-8d85-912f6be14261, identifier: PK39186
2026-03-29 18:40:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4158606e-e4a8-564d-8d85-912f6be14261 with identifier: PK39186
2026-03-29 18:40:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4158606e-e4a8-564d-8d85-912f6be14261 with identifier: PK39186
2026-03-29 18:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4158606e-e4a8-564d-8d85-912f6be14261 with identifier: PK39186 to the API
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:16:17Z',
'fuel_type': 'petrol',
'id': '4158606e-e4a8-564d-8d85-912f6be14261',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK39186',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 70379,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-21',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2021}
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK39186%27 HTTP/1.1" 200 None
2026-03-29 18:40:52 [auto1.de] INFO: Saving data for PK39186: {'auction_closing_time': 1774883777.0, 'created_time': 1774292004.598575, 'last_price_update_time': 1774809652.23802}
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK39186') HTTP/1.1" 204 0
2026-03-29 18:40:52 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG82987%27 HTTP/1.1" 200 None
2026-03-29 18:40:52 [auto1.de] INFO: Scrape type for RG82987: 2
2026-03-29 18:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with identifier: RG82987
2026-03-29 18:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with scrape type 2
2026-03-29 18:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with scrape type 2
2026-03-29 18:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bedadf5a-19d1-5b22-86f1-abf3d074c0b4, identifier: RG82987
2026-03-29 18:40:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with identifier: RG82987
2026-03-29 18:40:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with identifier: RG82987
2026-03-29 18:40:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with identifier: RG82987 to the API
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:48:11Z',
'fuel_type': 'diesel',
'id': 'bedadf5a-19d1-5b22-86f1-abf3d074c0b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG82987',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 309702,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-05',
'seller_name': None,
'title': 'Audi A4 2.0 TDIe Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2011}
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG82987%27 HTTP/1.1" 200 None
2026-03-29 18:40:52 [auto1.de] INFO: Saving data for RG82987: {'auction_closing_time': 1774885691.0, 'created_time': 1773400574.297106, 'last_price_update_time': 1774809652.698847}
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG82987') HTTP/1.1" 204 0
2026-03-29 18:40:52 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH66881%27 HTTP/1.1" 200 None
2026-03-29 18:40:52 [auto1.de] INFO: Scrape type for WH66881: 0
2026-03-29 18:40:52 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-29 18:40:52 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-29 18:40:52 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-29 18:40:52 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND02727%27 HTTP/1.1" 200 None
2026-03-29 18:40:52 [auto1.de] INFO: Scrape type for ND02727: 2
2026-03-29 18:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93e40ab7-fce8-5160-99be-206fa14f8d8b with identifier: ND02727
2026-03-29 18:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93e40ab7-fce8-5160-99be-206fa14f8d8b with scrape type 2
2026-03-29 18:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93e40ab7-fce8-5160-99be-206fa14f8d8b with scrape type 2
2026-03-29 18:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93e40ab7-fce8-5160-99be-206fa14f8d8b, identifier: ND02727
2026-03-29 18:40:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93e40ab7-fce8-5160-99be-206fa14f8d8b with identifier: ND02727
2026-03-29 18:40:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93e40ab7-fce8-5160-99be-206fa14f8d8b with identifier: ND02727
2026-03-29 18:40:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93e40ab7-fce8-5160-99be-206fa14f8d8b with identifier: ND02727 to the API
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:03:26Z',
'fuel_type': 'diesel',
'id': '93e40ab7-fce8-5160-99be-206fa14f8d8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND02727',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 37556,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-27',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi L1 Active',
'transmission': 'automatic',
'trim': 'L1 Active',
'year': 2023}
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND02727%27 HTTP/1.1" 200 None
2026-03-29 18:40:53 [auto1.de] INFO: Saving data for ND02727: {'auction_closing_time': 1774883006.0, 'created_time': 1774293438.588247, 'last_price_update_time': 1774809653.195843}
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND02727') HTTP/1.1" 204 0
2026-03-29 18:40:53 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ18132%27 HTTP/1.1" 200 None
2026-03-29 18:40:53 [auto1.de] INFO: Scrape type for WJ18132: 0
2026-03-29 18:40:53 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-29 18:40:53 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-29 18:40:53 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-29 18:40:53 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-29 18:40:53 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-29 18:40:53 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR30174%27 HTTP/1.1" 200 None
2026-03-29 18:40:53 [auto1.de] INFO: Scrape type for JR30174: 2
2026-03-29 18:40:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with identifier: JR30174
2026-03-29 18:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with scrape type 2
2026-03-29 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with scrape type 2
2026-03-29 18:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54cb350d-5fe5-5e4e-b0fc-259e34488c39, identifier: JR30174
2026-03-29 18:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with identifier: JR30174
2026-03-29 18:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with identifier: JR30174
2026-03-29 18:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with identifier: JR30174 to the API
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:13:36Z',
'fuel_type': 'diesel',
'id': '54cb350d-5fe5-5e4e-b0fc-259e34488c39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR30174',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 131279,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-12',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Center-Line 2WD',
'transmission': 'manual',
'trim': 'Center-Line 2WD',
'year': 2013}
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR30174%27 HTTP/1.1" 200 None
2026-03-29 18:40:53 [auto1.de] INFO: Saving data for JR30174: {'auction_closing_time': 1774883616.0, 'created_time': 1773302399.342569, 'last_price_update_time': 1774809653.862134}
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR30174') HTTP/1.1" 204 0
2026-03-29 18:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:53 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-29 18:40:53 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ23133%27 HTTP/1.1" 200 None
2026-03-29 18:40:53 [auto1.de] INFO: Scrape type for YJ23133: 2
2026-03-29 18:40:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with identifier: YJ23133
2026-03-29 18:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with scrape type 2
2026-03-29 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with scrape type 2
2026-03-29 18:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1778f9b5-1d04-5f33-aa04-973d57a1dde1, identifier: YJ23133
2026-03-29 18:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with identifier: YJ23133
2026-03-29 18:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with identifier: YJ23133
2026-03-29 18:40:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with identifier: YJ23133 to the API
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:33:15Z',
'fuel_type': 'petrol',
'id': '1778f9b5-1d04-5f33-aa04-973d57a1dde1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ23133',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 58565,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-12',
'seller_name': None,
'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2022}
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ23133%27 HTTP/1.1" 200 None
2026-03-29 18:40:54 [auto1.de] INFO: Saving data for YJ23133: {'auction_closing_time': 1774884795.0, 'created_time': 1774294148.388859, 'last_price_update_time': 1774809654.309568}
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ23133') HTTP/1.1" 204 0
2026-03-29 18:40:54 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-29 18:40:54 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU09743%27 HTTP/1.1" 200 None
2026-03-29 18:40:54 [auto1.de] INFO: Scrape type for XU09743: 0
2026-03-29 18:40:54 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-29 18:40:54 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-29 18:40:54 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX51992%27 HTTP/1.1" 200 None
2026-03-29 18:40:54 [auto1.de] INFO: Scrape type for SX51992: 2
2026-03-29 18:40:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90552867-bda4-5f3a-8027-7ffa30655312 with identifier: SX51992
2026-03-29 18:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90552867-bda4-5f3a-8027-7ffa30655312 with scrape type 2
2026-03-29 18:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90552867-bda4-5f3a-8027-7ffa30655312 with scrape type 2
2026-03-29 18:40:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90552867-bda4-5f3a-8027-7ffa30655312, identifier: SX51992
2026-03-29 18:40:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90552867-bda4-5f3a-8027-7ffa30655312 with identifier: SX51992
2026-03-29 18:40:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90552867-bda4-5f3a-8027-7ffa30655312 with identifier: SX51992
2026-03-29 18:40:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90552867-bda4-5f3a-8027-7ffa30655312 with identifier: SX51992 to the API
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:02:37Z',
'fuel_type': 'diesel',
'id': '90552867-bda4-5f3a-8027-7ffa30655312',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX51992',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 153379,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-15',
'seller_name': None,
'title': 'Seat Ateca 2.0 TDI Xcellence 4Drive',
'transmission': 'automatic',
'trim': 'Xcellence 4Drive',
'year': 2017}
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX51992%27 HTTP/1.1" 200 None
2026-03-29 18:40:54 [auto1.de] INFO: Saving data for SX51992: {'auction_closing_time': 1774882957.0, 'created_time': 1773427015.614078, 'last_price_update_time': 1774809654.79583}
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX51992') HTTP/1.1" 204 0
2026-03-29 18:40:54 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:54 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-29 18:40:54 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT07926%27 HTTP/1.1" 200 None
2026-03-29 18:40:54 [auto1.de] INFO: Scrape type for KT07926: 2
2026-03-29 18:40:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad with identifier: KT07926
2026-03-29 18:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad with scrape type 2
2026-03-29 18:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad with scrape type 2
2026-03-29 18:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad, identifier: KT07926
2026-03-29 18:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad with identifier: KT07926
2026-03-29 18:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad with identifier: KT07926
2026-03-29 18:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad with identifier: KT07926 to the API
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:47:23Z',
'fuel_type': 'petrol',
'id': 'dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT07926',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 99700,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-25',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI ACT FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2017}
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT07926%27 HTTP/1.1" 200 None
2026-03-29 18:40:55 [auto1.de] INFO: Saving data for KT07926: {'auction_closing_time': 1774885643.0, 'created_time': 1774636243.237824, 'last_price_update_time': 1774809655.310825}
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT07926') HTTP/1.1" 204 0
2026-03-29 18:40:55 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ46352%27 HTTP/1.1" 200 None
2026-03-29 18:40:55 [auto1.de] INFO: Scrape type for WZ46352: 0
2026-03-29 18:40:55 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75190%27 HTTP/1.1" 200 None
2026-03-29 18:40:55 [auto1.de] INFO: Scrape type for NY75190: 2
2026-03-29 18:40:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with identifier: NY75190
2026-03-29 18:40:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with scrape type 2
2026-03-29 18:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with scrape type 2
2026-03-29 18:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 936031d5-5b8a-5edc-b7a6-5f76a8f3d954, identifier: NY75190
2026-03-29 18:40:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:55 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC50567%27 HTTP/1.1" 200 None
2026-03-29 18:40:55 [auto1.de] INFO: Scrape type for MC50567: 2
2026-03-29 18:40:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b504f5ac-fce6-5635-92ee-8eb589c7cdcf with identifier: MC50567
2026-03-29 18:40:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf with scrape type 2
2026-03-29 18:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf with scrape type 2
2026-03-29 18:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b504f5ac-fce6-5635-92ee-8eb589c7cdcf, identifier: MC50567
2026-03-29 18:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with identifier: NY75190
2026-03-29 18:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with identifier: NY75190
2026-03-29 18:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with identifier: NY75190 to the API
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:57:49Z',
'fuel_type': 'petrol',
'id': '936031d5-5b8a-5edc-b7a6-5f76a8f3d954',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY75190',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Vitara',
'odometer': 72999,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-26',
'seller_name': None,
'title': 'Suzuki Vitara 1.4 BoosterJet Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2019}
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75190%27 HTTP/1.1" 200 None
2026-03-29 18:40:55 [auto1.de] INFO: Saving data for NY75190: {'auction_closing_time': 1774886269.0, 'created_time': 1773469040.023094, 'last_price_update_time': 1774809655.852967}
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY75190') HTTP/1.1" 204 0
2026-03-29 18:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b504f5ac-fce6-5635-92ee-8eb589c7cdcf with identifier: MC50567
2026-03-29 18:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b504f5ac-fce6-5635-92ee-8eb589c7cdcf with identifier: MC50567
2026-03-29 18:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b504f5ac-fce6-5635-92ee-8eb589c7cdcf with identifier: MC50567 to the API
2026-03-29 18:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 129,
'expiration_date': '2026-03-30T15:30:53Z',
'fuel_type': 'petrol',
'id': 'b504f5ac-fce6-5635-92ee-8eb589c7cdcf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC50567',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 22242,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-16',
'seller_name': None,
'title': 'Jeep Renegade 1.5 GSE T4 e-Hybrid Longitude FWD',
'transmission': 'automatic',
'trim': 'Longitude FWD',
'year': 2023}
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC50567%27 HTTP/1.1" 200 None
2026-03-29 18:40:56 [auto1.de] INFO: Saving data for MC50567: {'auction_closing_time': 1774884653.0, 'created_time': 1774607651.843726, 'last_price_update_time': 1774809656.221339}
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC50567') HTTP/1.1" 204 0
2026-03-29 18:40:56 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS68419%27 HTTP/1.1" 200 None
2026-03-29 18:40:56 [auto1.de] INFO: Scrape type for SS68419: 0
2026-03-29 18:40:56 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-29 18:40:56 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-29 18:40:56 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-29 18:40:56 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD91904%27 HTTP/1.1" 200 None
2026-03-29 18:40:56 [auto1.de] INFO: Scrape type for TD91904: 0
2026-03-29 18:40:56 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG67628%27 HTTP/1.1" 200 None
2026-03-29 18:40:56 [auto1.de] INFO: Scrape type for JG67628: 0
2026-03-29 18:40:56 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-29 18:40:56 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP97739%27 HTTP/1.1" 200 None
2026-03-29 18:40:56 [auto1.de] INFO: Scrape type for FP97739: 2
2026-03-29 18:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a0536d6-12fc-56fc-b68f-8b7658cfc6da with identifier: FP97739
2026-03-29 18:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a0536d6-12fc-56fc-b68f-8b7658cfc6da with scrape type 2
2026-03-29 18:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a0536d6-12fc-56fc-b68f-8b7658cfc6da with scrape type 2
2026-03-29 18:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a0536d6-12fc-56fc-b68f-8b7658cfc6da, identifier: FP97739
2026-03-29 18:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a0536d6-12fc-56fc-b68f-8b7658cfc6da with identifier: FP97739
2026-03-29 18:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a0536d6-12fc-56fc-b68f-8b7658cfc6da with identifier: FP97739
2026-03-29 18:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a0536d6-12fc-56fc-b68f-8b7658cfc6da with identifier: FP97739 to the API
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:11:34Z',
'fuel_type': 'diesel',
'id': '1a0536d6-12fc-56fc-b68f-8b7658cfc6da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP97739',
'listing': 'auction',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 109451,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-22',
'seller_name': None,
'title': 'Fiat Doblo 1.6 JTDM SX Maxi Kasten',
'transmission': 'manual',
'trim': 'SX Maxi Kasten',
'year': 2010}
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP97739%27 HTTP/1.1" 200 None
2026-03-29 18:40:56 [auto1.de] INFO: Saving data for FP97739: {'auction_closing_time': 1774883494.0, 'created_time': 1774522390.398692, 'last_price_update_time': 1774809656.685748}
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP97739') HTTP/1.1" 204 0
2026-03-29 18:40:56 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK39186%27 HTTP/1.1" 200 None
2026-03-29 18:40:56 [auto1.de] INFO: Scrape type for JK39186: 2
2026-03-29 18:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb061c3b-9e55-5a10-9085-4141d8fcdcdd with identifier: JK39186
2026-03-29 18:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb061c3b-9e55-5a10-9085-4141d8fcdcdd with scrape type 2
2026-03-29 18:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb061c3b-9e55-5a10-9085-4141d8fcdcdd with scrape type 2
2026-03-29 18:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb061c3b-9e55-5a10-9085-4141d8fcdcdd, identifier: JK39186
2026-03-29 18:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb061c3b-9e55-5a10-9085-4141d8fcdcdd with identifier: JK39186
2026-03-29 18:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb061c3b-9e55-5a10-9085-4141d8fcdcdd with identifier: JK39186
2026-03-29 18:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb061c3b-9e55-5a10-9085-4141d8fcdcdd with identifier: JK39186 to the API
2026-03-29 18:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:04:24Z',
'fuel_type': 'petrol',
'id': 'fb061c3b-9e55-5a10-9085-4141d8fcdcdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK39186',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 109317,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-12',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 FSI CrossPolo',
'transmission': 'manual',
'trim': 'Cross',
'year': 2010}
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK39186%27 HTTP/1.1" 200 None
2026-03-29 18:40:57 [auto1.de] INFO: Saving data for JK39186: {'auction_closing_time': 1774883064.0, 'created_time': 1773304591.34334, 'last_price_update_time': 1774809657.244211}
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK39186') HTTP/1.1" 204 0
2026-03-29 18:40:57 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB09525%27 HTTP/1.1" 200 None
2026-03-29 18:40:57 [auto1.de] INFO: Scrape type for FB09525: 2
2026-03-29 18:40:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4875374d-89bd-5a6f-bca6-da0fbda33735 with identifier: FB09525
2026-03-29 18:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4875374d-89bd-5a6f-bca6-da0fbda33735 with scrape type 2
2026-03-29 18:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4875374d-89bd-5a6f-bca6-da0fbda33735 with scrape type 2
2026-03-29 18:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4875374d-89bd-5a6f-bca6-da0fbda33735, identifier: FB09525
2026-03-29 18:40:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4875374d-89bd-5a6f-bca6-da0fbda33735 with identifier: FB09525
2026-03-29 18:40:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4875374d-89bd-5a6f-bca6-da0fbda33735 with identifier: FB09525
2026-03-29 18:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4875374d-89bd-5a6f-bca6-da0fbda33735 with identifier: FB09525 to the API
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:55:34Z',
'fuel_type': 'diesel',
'id': '4875374d-89bd-5a6f-bca6-da0fbda33735',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB09525',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 157208,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-19',
'seller_name': None,
'title': 'Peugeot 308 2.0 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2012}
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB09525%27 HTTP/1.1" 200 None
2026-03-29 18:40:57 [auto1.de] INFO: Saving data for FB09525: {'auction_closing_time': 1774886134.0, 'created_time': 1774607778.314263, 'last_price_update_time': 1774809657.687092}
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB09525') HTTP/1.1" 204 0
2026-03-29 18:40:57 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-29 18:40:57 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-29 18:40:57 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG82543%27 HTTP/1.1" 200 None
2026-03-29 18:40:57 [auto1.de] INFO: Scrape type for HG82543: 0
2026-03-29 18:40:57 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-29 18:40:57 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX42000%27 HTTP/1.1" 200 None
2026-03-29 18:40:57 [auto1.de] INFO: Scrape type for KX42000: 2
2026-03-29 18:40:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90829174-e7d4-584c-a331-3ece749f95e0 with identifier: KX42000
2026-03-29 18:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90829174-e7d4-584c-a331-3ece749f95e0 with scrape type 2
2026-03-29 18:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90829174-e7d4-584c-a331-3ece749f95e0 with scrape type 2
2026-03-29 18:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90829174-e7d4-584c-a331-3ece749f95e0, identifier: KX42000
2026-03-29 18:40:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90829174-e7d4-584c-a331-3ece749f95e0 with identifier: KX42000
2026-03-29 18:40:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90829174-e7d4-584c-a331-3ece749f95e0 with identifier: KX42000
2026-03-29 18:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90829174-e7d4-584c-a331-3ece749f95e0 with identifier: KX42000 to the API
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 199,
'expiration_date': '2026-03-30T15:15:55Z',
'fuel_type': 'diesel',
'id': '90829174-e7d4-584c-a331-3ece749f95e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX42000',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 138277,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-06',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline lang',
'transmission': 'automatic',
'trim': 'Comfortline lang',
'year': 2019}
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX42000%27 HTTP/1.1" 200 None
2026-03-29 18:40:58 [auto1.de] INFO: Saving data for KX42000: {'auction_closing_time': 1774883755.0, 'created_time': 1773427299.012885, 'last_price_update_time': 1774809658.169458}
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX42000') HTTP/1.1" 204 0
2026-03-29 18:40:58 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH85992%27 HTTP/1.1" 200 None
2026-03-29 18:40:58 [auto1.de] INFO: Scrape type for YH85992: 2
2026-03-29 18:40:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 039e5412-a506-5aa4-9a84-a640663eb484 with identifier: YH85992
2026-03-29 18:40:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 039e5412-a506-5aa4-9a84-a640663eb484 with scrape type 2
2026-03-29 18:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 039e5412-a506-5aa4-9a84-a640663eb484 with scrape type 2
2026-03-29 18:40:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 039e5412-a506-5aa4-9a84-a640663eb484, identifier: YH85992
2026-03-29 18:40:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 039e5412-a506-5aa4-9a84-a640663eb484 with identifier: YH85992
2026-03-29 18:40:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 039e5412-a506-5aa4-9a84-a640663eb484 with identifier: YH85992
2026-03-29 18:40:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 039e5412-a506-5aa4-9a84-a640663eb484 with identifier: YH85992 to the API
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:39:17Z',
'fuel_type': 'diesel',
'id': '039e5412-a506-5aa4-9a84-a640663eb484',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH85992',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Transporter',
'odometer': 217653,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-26',
'seller_name': None,
'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2011}
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH85992%27 HTTP/1.1" 200 None
2026-03-29 18:40:58 [auto1.de] INFO: Saving data for YH85992: {'auction_closing_time': 1774885157.0, 'created_time': 1773858652.811359, 'last_price_update_time': 1774809658.683456}
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH85992') HTTP/1.1" 204 0
2026-03-29 18:40:58 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY48204%27 HTTP/1.1" 200 None
2026-03-29 18:40:58 [auto1.de] INFO: Scrape type for KY48204: 2
2026-03-29 18:40:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cfd7e68-85c0-54f0-924f-1a0823f9fcfd with identifier: KY48204
2026-03-29 18:40:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cfd7e68-85c0-54f0-924f-1a0823f9fcfd with scrape type 2
2026-03-29 18:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cfd7e68-85c0-54f0-924f-1a0823f9fcfd with scrape type 2
2026-03-29 18:40:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cfd7e68-85c0-54f0-924f-1a0823f9fcfd, identifier: KY48204
2026-03-29 18:40:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cfd7e68-85c0-54f0-924f-1a0823f9fcfd with identifier: KY48204
2026-03-29 18:40:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cfd7e68-85c0-54f0-924f-1a0823f9fcfd with identifier: KY48204
2026-03-29 18:40:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cfd7e68-85c0-54f0-924f-1a0823f9fcfd with identifier: KY48204 to the API
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:28:48Z',
'fuel_type': 'petrol',
'id': '3cfd7e68-85c0-54f0-924f-1a0823f9fcfd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY48204',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 42416,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-05-19',
'seller_name': None,
'title': 'Opel Meriva 1.8 Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2005}
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY48204%27 HTTP/1.1" 200 None
2026-03-29 18:40:59 [auto1.de] INFO: Saving data for KY48204: {'auction_closing_time': 1774884528.0, 'created_time': 1774636360.016592, 'last_price_update_time': 1774809659.077057}
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY48204') HTTP/1.1" 204 0
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL48230%27 HTTP/1.1" 200 None
2026-03-29 18:40:59 [auto1.de] INFO: Scrape type for HL48230: 0
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY59901%27 HTTP/1.1" 200 None
2026-03-29 18:40:59 [auto1.de] INFO: Scrape type for UY59901: 0
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS42902%27 HTTP/1.1" 200 None
2026-03-29 18:40:59 [auto1.de] INFO: Scrape type for PS42902: 0
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG07111%27 HTTP/1.1" 200 None
2026-03-29 18:40:59 [auto1.de] INFO: Scrape type for GG07111: 0
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR01003%27 HTTP/1.1" 200 None
2026-03-29 18:40:59 [auto1.de] INFO: Scrape type for NR01003: 2
2026-03-29 18:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9becfd88-2267-5299-81e8-ce7fd5e06001 with identifier: NR01003
2026-03-29 18:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9becfd88-2267-5299-81e8-ce7fd5e06001 with scrape type 2
2026-03-29 18:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9becfd88-2267-5299-81e8-ce7fd5e06001 with scrape type 2
2026-03-29 18:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9becfd88-2267-5299-81e8-ce7fd5e06001, identifier: NR01003
2026-03-29 18:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9becfd88-2267-5299-81e8-ce7fd5e06001 with identifier: NR01003
2026-03-29 18:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9becfd88-2267-5299-81e8-ce7fd5e06001 with identifier: NR01003
2026-03-29 18:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9becfd88-2267-5299-81e8-ce7fd5e06001 with identifier: NR01003 to the API
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:09:47Z',
'fuel_type': 'petrol',
'id': '9becfd88-2267-5299-81e8-ce7fd5e06001',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR01003',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 142017,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-30',
'seller_name': None,
'title': 'BMW 2er 216i Active Tourer Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2016}
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR01003%27 HTTP/1.1" 200 None
2026-03-29 18:40:59 [auto1.de] INFO: Saving data for NR01003: {'auction_closing_time': 1774883387.0, 'created_time': 1773135853.206265, 'last_price_update_time': 1774809659.604982}
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR01003') HTTP/1.1" 204 0
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52471%27 HTTP/1.1" 200 None
2026-03-29 18:40:59 [auto1.de] INFO: Scrape type for TJ52471: 2
2026-03-29 18:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c66b7fc-5207-5355-826a-862308f9820c with identifier: TJ52471
2026-03-29 18:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c66b7fc-5207-5355-826a-862308f9820c with scrape type 2
2026-03-29 18:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c66b7fc-5207-5355-826a-862308f9820c with scrape type 2
2026-03-29 18:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c66b7fc-5207-5355-826a-862308f9820c, identifier: TJ52471
2026-03-29 18:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c66b7fc-5207-5355-826a-862308f9820c with identifier: TJ52471
2026-03-29 18:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c66b7fc-5207-5355-826a-862308f9820c with identifier: TJ52471
2026-03-29 18:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c66b7fc-5207-5355-826a-862308f9820c with identifier: TJ52471 to the API
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:56:21Z',
'fuel_type': 'petrol',
'id': '1c66b7fc-5207-5355-826a-862308f9820c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ52471',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 167124,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-23',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52471%27 HTTP/1.1" 200 None
2026-03-29 18:41:00 [auto1.de] INFO: Saving data for TJ52471: {'auction_closing_time': 1774886181.0, 'created_time': 1774522092.169159, 'last_price_update_time': 1774809660.12805}
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ52471') HTTP/1.1" 204 0
2026-03-29 18:41:00 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-29 18:41:00 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB47051%27 HTTP/1.1" 200 None
2026-03-29 18:41:00 [auto1.de] INFO: Scrape type for LB47051: 2
2026-03-29 18:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with identifier: LB47051
2026-03-29 18:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with scrape type 2
2026-03-29 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with scrape type 2
2026-03-29 18:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc, identifier: LB47051
2026-03-29 18:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with identifier: LB47051
2026-03-29 18:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with identifier: LB47051
2026-03-29 18:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with identifier: LB47051 to the API
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:13:11Z',
'fuel_type': 'diesel',
'id': '8d5129b1-1119-5e66-a41a-6cc1cf6b93dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB47051',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 350327,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-01',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2014}
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB47051%27 HTTP/1.1" 200 None
2026-03-29 18:41:00 [auto1.de] INFO: Saving data for LB47051: {'auction_closing_time': 1774883591.0, 'created_time': 1774294582.005345, 'last_price_update_time': 1774809660.593579}
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB47051') HTTP/1.1" 204 0
2026-03-29 18:41:00 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05749%27 HTTP/1.1" 200 None
2026-03-29 18:41:00 [auto1.de] INFO: Scrape type for BB05749: 2
2026-03-29 18:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24f0b89b-689c-5307-abde-bbf75fa81151 with identifier: BB05749
2026-03-29 18:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24f0b89b-689c-5307-abde-bbf75fa81151 with scrape type 2
2026-03-29 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24f0b89b-689c-5307-abde-bbf75fa81151 with scrape type 2
2026-03-29 18:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24f0b89b-689c-5307-abde-bbf75fa81151, identifier: BB05749
2026-03-29 18:41:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24f0b89b-689c-5307-abde-bbf75fa81151 with identifier: BB05749
2026-03-29 18:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24f0b89b-689c-5307-abde-bbf75fa81151 with identifier: BB05749
2026-03-29 18:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24f0b89b-689c-5307-abde-bbf75fa81151 with identifier: BB05749 to the API
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 281,
'expiration_date': '2026-03-30T15:13:04Z',
'fuel_type': 'petrol',
'id': '24f0b89b-689c-5307-abde-bbf75fa81151',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB05749',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLE-Klasse',
'odometer': 4900,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-29',
'seller_name': None,
'title': 'Mercedes-Benz CLE-Klasse CLE 300 Mild-Hybrid 4Matic AMG Line '
'Premium',
'transmission': 'automatic',
'trim': '4Matic AMG Line Premium',
'year': 2024}
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05749%27 HTTP/1.1" 200 None
2026-03-29 18:41:01 [auto1.de] INFO: Saving data for BB05749: {'auction_closing_time': 1774883584.0, 'created_time': 1773301481.398373, 'last_price_update_time': 1774809661.11085}
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB05749') HTTP/1.1" 204 0
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU38078%27 HTTP/1.1" 200 None
2026-03-29 18:41:01 [auto1.de] INFO: Scrape type for AU38078: 0
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96040%27 HTTP/1.1" 200 None
2026-03-29 18:41:01 [auto1.de] INFO: Scrape type for BV96040: 0
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-29 18:41:01 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93583%27 HTTP/1.1" 200 None
2026-03-29 18:41:01 [auto1.de] INFO: Scrape type for FK93583: 2
2026-03-29 18:41:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88388082-6f36-5a88-82b9-af9197ffe1f9 with identifier: FK93583
2026-03-29 18:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88388082-6f36-5a88-82b9-af9197ffe1f9 with scrape type 2
2026-03-29 18:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88388082-6f36-5a88-82b9-af9197ffe1f9 with scrape type 2
2026-03-29 18:41:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88388082-6f36-5a88-82b9-af9197ffe1f9, identifier: FK93583
2026-03-29 18:41:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88388082-6f36-5a88-82b9-af9197ffe1f9 with identifier: FK93583
2026-03-29 18:41:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88388082-6f36-5a88-82b9-af9197ffe1f9 with identifier: FK93583
2026-03-29 18:41:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88388082-6f36-5a88-82b9-af9197ffe1f9 with identifier: FK93583 to the API
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:11:40Z',
'fuel_type': 'petrol',
'id': '88388082-6f36-5a88-82b9-af9197ffe1f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK93583',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 165875,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-27',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2017}
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93583%27 HTTP/1.1" 200 None
2026-03-29 18:41:01 [auto1.de] INFO: Saving data for FK93583: {'auction_closing_time': 1774883500.0, 'created_time': 1773776244.391065, 'last_price_update_time': 1774809661.622762}
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK93583') HTTP/1.1" 204 0
2026-03-29 18:41:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF11383%27 HTTP/1.1" 200 None
2026-03-29 18:41:01 [auto1.de] INFO: Scrape type for MF11383: 2
2026-03-29 18:41:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f with identifier: MF11383
2026-03-29 18:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f with scrape type 2
2026-03-29 18:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f with scrape type 2
2026-03-29 18:41:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f, identifier: MF11383
2026-03-29 18:41:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f with identifier: MF11383
2026-03-29 18:41:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f with identifier: MF11383
2026-03-29 18:41:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f with identifier: MF11383 to the API
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:46:47Z',
'fuel_type': 'diesel',
'id': '34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF11383',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 150606,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-06',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2013}
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF11383%27 HTTP/1.1" 200 None
2026-03-29 18:41:02 [auto1.de] INFO: Saving data for MF11383: {'auction_closing_time': 1774885607.0, 'created_time': 1773427205.967907, 'last_price_update_time': 1774809662.136549}
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF11383') HTTP/1.1" 204 0
2026-03-29 18:41:02 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-29 18:41:02 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-29 18:41:02 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA11296%27 HTTP/1.1" 200 None
2026-03-29 18:41:02 [auto1.de] INFO: Scrape type for CA11296: 2
2026-03-29 18:41:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82afe9ad-83dc-5500-9c19-691a6d0092e6 with identifier: CA11296
2026-03-29 18:41:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82afe9ad-83dc-5500-9c19-691a6d0092e6 with scrape type 2
2026-03-29 18:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82afe9ad-83dc-5500-9c19-691a6d0092e6 with scrape type 2
2026-03-29 18:41:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82afe9ad-83dc-5500-9c19-691a6d0092e6, identifier: CA11296
2026-03-29 18:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82afe9ad-83dc-5500-9c19-691a6d0092e6 with identifier: CA11296
2026-03-29 18:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82afe9ad-83dc-5500-9c19-691a6d0092e6 with identifier: CA11296
2026-03-29 18:41:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82afe9ad-83dc-5500-9c19-691a6d0092e6 with identifier: CA11296 to the API
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:21:01Z',
'fuel_type': 'diesel',
'id': '82afe9ad-83dc-5500-9c19-691a6d0092e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA11296',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 191595,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-22',
'seller_name': None,
'title': 'Skoda Fabia 1.6 TDI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2011}
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA11296%27 HTTP/1.1" 200 None
2026-03-29 18:41:02 [auto1.de] INFO: Saving data for CA11296: {'auction_closing_time': 1774884061.0, 'created_time': 1774263166.514422, 'last_price_update_time': 1774809662.580255}
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA11296') HTTP/1.1" 204 0
2026-03-29 18:41:02 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-29 18:41:02 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC52895%27 HTTP/1.1" 200 None
2026-03-29 18:41:02 [auto1.de] INFO: Scrape type for RC52895: 0
2026-03-29 18:41:02 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-29 18:41:02 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT64251%27 HTTP/1.1" 200 None
2026-03-29 18:41:02 [auto1.de] INFO: Scrape type for HT64251: 2
2026-03-29 18:41:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfedd978-7f38-5581-b144-809649f3d32a with identifier: HT64251
2026-03-29 18:41:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfedd978-7f38-5581-b144-809649f3d32a with scrape type 2
2026-03-29 18:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfedd978-7f38-5581-b144-809649f3d32a with scrape type 2
2026-03-29 18:41:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfedd978-7f38-5581-b144-809649f3d32a, identifier: HT64251
2026-03-29 18:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfedd978-7f38-5581-b144-809649f3d32a with identifier: HT64251
2026-03-29 18:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfedd978-7f38-5581-b144-809649f3d32a with identifier: HT64251
2026-03-29 18:41:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfedd978-7f38-5581-b144-809649f3d32a with identifier: HT64251 to the API
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:11:20Z',
'fuel_type': 'diesel',
'id': 'dfedd978-7f38-5581-b144-809649f3d32a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT64251',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 224712,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-19',
'seller_name': None,
'title': 'BMW X1 xDrive 23d',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT64251%27 HTTP/1.1" 200 None
2026-03-29 18:41:03 [auto1.de] INFO: Saving data for HT64251: {'auction_closing_time': 1774883480.0, 'created_time': 1773400607.006065, 'last_price_update_time': 1774809663.043265}
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT64251') HTTP/1.1" 204 0
2026-03-29 18:41:03 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV64840%27 HTTP/1.1" 200 None
2026-03-29 18:41:03 [auto1.de] INFO: Scrape type for CV64840: 2
2026-03-29 18:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59405564-e0ad-51a3-9882-d7724f423a48 with identifier: CV64840
2026-03-29 18:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59405564-e0ad-51a3-9882-d7724f423a48 with scrape type 2
2026-03-29 18:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59405564-e0ad-51a3-9882-d7724f423a48 with scrape type 2
2026-03-29 18:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59405564-e0ad-51a3-9882-d7724f423a48, identifier: CV64840
2026-03-29 18:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59405564-e0ad-51a3-9882-d7724f423a48 with identifier: CV64840
2026-03-29 18:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59405564-e0ad-51a3-9882-d7724f423a48 with identifier: CV64840
2026-03-29 18:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59405564-e0ad-51a3-9882-d7724f423a48 with identifier: CV64840 to the API
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:04:08Z',
'fuel_type': 'petrol',
'id': '59405564-e0ad-51a3-9882-d7724f423a48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV64840',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 24462,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-12',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 Mild-Hybrid Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2022}
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV64840%27 HTTP/1.1" 200 None
2026-03-29 18:41:03 [auto1.de] INFO: Saving data for CV64840: {'auction_closing_time': 1774883048.0, 'created_time': 1774293854.856412, 'last_price_update_time': 1774809663.502377}
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV64840') HTTP/1.1" 204 0
2026-03-29 18:41:03 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-29 18:41:03 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT46739%27 HTTP/1.1" 200 None
2026-03-29 18:41:03 [auto1.de] INFO: Scrape type for LT46739: 0
2026-03-29 18:41:03 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-29 18:41:03 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-29 18:41:03 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-29 18:41:03 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK97708%27 HTTP/1.1" 200 None
2026-03-29 18:41:03 [auto1.de] INFO: Scrape type for YK97708: 0
2026-03-29 18:41:03 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR45011%27 HTTP/1.1" 200 None
2026-03-29 18:41:03 [auto1.de] INFO: Scrape type for WR45011: 0
2026-03-29 18:41:03 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-29 18:41:03 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97741%27 HTTP/1.1" 200 None
2026-03-29 18:41:03 [auto1.de] INFO: Scrape type for AU97741: 0
2026-03-29 18:41:03 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE57640%27 HTTP/1.1" 200 None
2026-03-29 18:41:03 [auto1.de] INFO: Scrape type for XE57640: 0
2026-03-29 18:41:03 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44464%27 HTTP/1.1" 200 None
2026-03-29 18:41:03 [auto1.de] INFO: Scrape type for HX44464: 2
2026-03-29 18:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b407ee1-70ee-5b4c-b546-311fca521be5 with identifier: HX44464
2026-03-29 18:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b407ee1-70ee-5b4c-b546-311fca521be5 with scrape type 2
2026-03-29 18:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b407ee1-70ee-5b4c-b546-311fca521be5 with scrape type 2
2026-03-29 18:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b407ee1-70ee-5b4c-b546-311fca521be5, identifier: HX44464
2026-03-29 18:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b407ee1-70ee-5b4c-b546-311fca521be5 with identifier: HX44464
2026-03-29 18:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b407ee1-70ee-5b4c-b546-311fca521be5 with identifier: HX44464
2026-03-29 18:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b407ee1-70ee-5b4c-b546-311fca521be5 with identifier: HX44464 to the API
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 510,
'expiration_date': '2026-03-30T15:43:30Z',
'fuel_type': 'petrol',
'id': '2b407ee1-70ee-5b4c-b546-311fca521be5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX44464',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 103768,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-14',
'seller_name': None,
'title': 'Land Rover Range Rover Sport 5.0 V8 HSE Dynamic',
'transmission': 'automatic',
'trim': 'HSE Dynamic',
'year': 2017}
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44464%27 HTTP/1.1" 200 None
2026-03-29 18:41:04 [auto1.de] INFO: Saving data for HX44464: {'auction_closing_time': 1774885410.0, 'created_time': 1773685866.871994, 'last_price_update_time': 1774809664.06978}
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX44464') HTTP/1.1" 204 0
2026-03-29 18:41:04 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-29 18:41:04 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-29 18:41:04 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-29 18:41:04 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55568%27 HTTP/1.1" 200 None
2026-03-29 18:41:04 [auto1.de] INFO: Scrape type for WD55568: 2
2026-03-29 18:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0076f557-b5b5-58ef-b072-0ac72c7d2562 with identifier: WD55568
2026-03-29 18:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0076f557-b5b5-58ef-b072-0ac72c7d2562 with scrape type 2
2026-03-29 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0076f557-b5b5-58ef-b072-0ac72c7d2562 with scrape type 2
2026-03-29 18:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0076f557-b5b5-58ef-b072-0ac72c7d2562, identifier: WD55568
2026-03-29 18:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0076f557-b5b5-58ef-b072-0ac72c7d2562 with identifier: WD55568
2026-03-29 18:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0076f557-b5b5-58ef-b072-0ac72c7d2562 with identifier: WD55568
2026-03-29 18:41:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0076f557-b5b5-58ef-b072-0ac72c7d2562 with identifier: WD55568 to the API
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:28:39Z',
'fuel_type': 'diesel',
'id': '0076f557-b5b5-58ef-b072-0ac72c7d2562',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD55568',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 97955,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-10',
'seller_name': None,
'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2018}
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55568%27 HTTP/1.1" 200 None
2026-03-29 18:41:04 [auto1.de] INFO: Saving data for WD55568: {'auction_closing_time': 1774884519.0, 'created_time': 1773773456.523802, 'last_price_update_time': 1774809664.689034}
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD55568') HTTP/1.1" 204 0
2026-03-29 18:41:04 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT11512%27 HTTP/1.1" 200 None
2026-03-29 18:41:04 [auto1.de] INFO: Scrape type for TT11512: 0
2026-03-29 18:41:04 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-29 18:41:04 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH89058%27 HTTP/1.1" 200 None
2026-03-29 18:41:04 [auto1.de] INFO: Scrape type for EH89058: 0
2026-03-29 18:41:04 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-29 18:41:04 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU70640%27 HTTP/1.1" 200 None
2026-03-29 18:41:04 [auto1.de] INFO: Scrape type for YU70640: 2
2026-03-29 18:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0765f866-dd67-5f13-a246-6ff56ae7d349 with identifier: YU70640
2026-03-29 18:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0765f866-dd67-5f13-a246-6ff56ae7d349 with scrape type 2
2026-03-29 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0765f866-dd67-5f13-a246-6ff56ae7d349 with scrape type 2
2026-03-29 18:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0765f866-dd67-5f13-a246-6ff56ae7d349, identifier: YU70640
2026-03-29 18:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0765f866-dd67-5f13-a246-6ff56ae7d349 with identifier: YU70640
2026-03-29 18:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0765f866-dd67-5f13-a246-6ff56ae7d349 with identifier: YU70640
2026-03-29 18:41:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0765f866-dd67-5f13-a246-6ff56ae7d349 with identifier: YU70640 to the API
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:33:28Z',
'fuel_type': 'diesel',
'id': '0765f866-dd67-5f13-a246-6ff56ae7d349',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU70640',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 201361,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-27',
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU70640%27 HTTP/1.1" 200 None
2026-03-29 18:41:05 [auto1.de] INFO: Saving data for YU70640: {'auction_closing_time': 1774884808.0, 'created_time': 1774522137.946633, 'last_price_update_time': 1774809665.126497}
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU70640') HTTP/1.1" 204 0
2026-03-29 18:41:05 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68722%27 HTTP/1.1" 200 None
2026-03-29 18:41:05 [auto1.de] INFO: Scrape type for BS68722: 0
2026-03-29 18:41:05 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR59987%27 HTTP/1.1" 200 None
2026-03-29 18:41:05 [auto1.de] INFO: Scrape type for KR59987: 2
2026-03-29 18:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b94ba28-32bf-5e16-b129-66d1a51e379c with identifier: KR59987
2026-03-29 18:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b94ba28-32bf-5e16-b129-66d1a51e379c with scrape type 2
2026-03-29 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b94ba28-32bf-5e16-b129-66d1a51e379c with scrape type 2
2026-03-29 18:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b94ba28-32bf-5e16-b129-66d1a51e379c, identifier: KR59987
2026-03-29 18:41:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b94ba28-32bf-5e16-b129-66d1a51e379c with identifier: KR59987
2026-03-29 18:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b94ba28-32bf-5e16-b129-66d1a51e379c with identifier: KR59987
2026-03-29 18:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b94ba28-32bf-5e16-b129-66d1a51e379c with identifier: KR59987 to the API
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:31:33Z',
'fuel_type': 'petrol',
'id': '2b94ba28-32bf-5e16-b129-66d1a51e379c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR59987',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 186064,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-16',
'seller_name': None,
'title': 'Hyundai i10 1.1 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2011}
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR59987%27 HTTP/1.1" 200 None
2026-03-29 18:41:05 [auto1.de] INFO: Saving data for KR59987: {'auction_closing_time': 1774884693.0, 'created_time': 1773660381.20251, 'last_price_update_time': 1774809665.590402}
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR59987') HTTP/1.1" 204 0
2026-03-29 18:41:05 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59954%27 HTTP/1.1" 200 None
2026-03-29 18:41:05 [auto1.de] INFO: Scrape type for XA59954: 0
2026-03-29 18:41:05 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-29 18:41:05 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV53584%27 HTTP/1.1" 200 None
2026-03-29 18:41:05 [auto1.de] INFO: Scrape type for WV53584: 2
2026-03-29 18:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13394db8-552d-5fc2-8fc9-8259ed5b2c07 with identifier: WV53584
2026-03-29 18:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13394db8-552d-5fc2-8fc9-8259ed5b2c07 with scrape type 2
2026-03-29 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13394db8-552d-5fc2-8fc9-8259ed5b2c07 with scrape type 2
2026-03-29 18:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13394db8-552d-5fc2-8fc9-8259ed5b2c07, identifier: WV53584
2026-03-29 18:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13394db8-552d-5fc2-8fc9-8259ed5b2c07 with identifier: WV53584
2026-03-29 18:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13394db8-552d-5fc2-8fc9-8259ed5b2c07 with identifier: WV53584
2026-03-29 18:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13394db8-552d-5fc2-8fc9-8259ed5b2c07 with identifier: WV53584 to the API
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:54:26Z',
'fuel_type': 'diesel',
'id': '13394db8-552d-5fc2-8fc9-8259ed5b2c07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV53584',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 151801,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-11',
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 400 d L 4Matic AMG Line',
'transmission': 'automatic',
'trim': 'L 4Matic AMG Line',
'year': 2019}
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV53584%27 HTTP/1.1" 200 None
2026-03-29 18:41:06 [auto1.de] INFO: Saving data for WV53584: {'auction_closing_time': 1774886066.0, 'created_time': 1773945924.996212, 'last_price_update_time': 1774809666.111972}
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV53584') HTTP/1.1" 204 0
2026-03-29 18:41:06 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-29 18:41:06 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-29 18:41:06 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX82785%27 HTTP/1.1" 200 None
2026-03-29 18:41:06 [auto1.de] INFO: Scrape type for HX82785: 2
2026-03-29 18:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30ca088d-784a-53d8-a460-c0e26c2c666b with identifier: HX82785
2026-03-29 18:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ca088d-784a-53d8-a460-c0e26c2c666b with scrape type 2
2026-03-29 18:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30ca088d-784a-53d8-a460-c0e26c2c666b with scrape type 2
2026-03-29 18:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30ca088d-784a-53d8-a460-c0e26c2c666b, identifier: HX82785
2026-03-29 18:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30ca088d-784a-53d8-a460-c0e26c2c666b with identifier: HX82785
2026-03-29 18:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30ca088d-784a-53d8-a460-c0e26c2c666b with identifier: HX82785
2026-03-29 18:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30ca088d-784a-53d8-a460-c0e26c2c666b with identifier: HX82785 to the API
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 367,
'expiration_date': '2026-03-30T15:24:14Z',
'fuel_type': 'petrol',
'id': '30ca088d-784a-53d8-a460-c0e26c2c666b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX82785',
'listing': 'auction',
'make': 'Audi',
'model': 'RS Q3',
'odometer': 140203,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-11',
'seller_name': None,
'title': 'Audi RS Q3 2.5 TFSI quattro Performance',
'transmission': 'automatic',
'trim': 'quattro Performance',
'year': 2016}
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX82785%27 HTTP/1.1" 200 None
2026-03-29 18:41:06 [auto1.de] INFO: Saving data for HX82785: {'auction_closing_time': 1774884254.0, 'created_time': 1773135013.354186, 'last_price_update_time': 1774809666.598171}
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX82785') HTTP/1.1" 204 0
2026-03-29 18:41:06 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:06 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89302%27 HTTP/1.1" 200 None
2026-03-29 18:41:06 [auto1.de] INFO: Scrape type for ZL89302: 0
2026-03-29 18:41:06 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-29 18:41:06 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP94641%27 HTTP/1.1" 200 None
2026-03-29 18:41:06 [auto1.de] INFO: Scrape type for KP94641: 0
2026-03-29 18:41:06 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK64701%27 HTTP/1.1" 200 None
2026-03-29 18:41:06 [auto1.de] INFO: Scrape type for FK64701: 0
2026-03-29 18:41:06 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-29 18:41:06 [auto1.de] INFO: Scrape type for TJ54274: 2
2026-03-29 18:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with identifier: TJ54274
2026-03-29 18:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with scrape type 2
2026-03-29 18:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with scrape type 2
2026-03-29 18:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc1073af-f2da-5a7b-9024-ad2b9f9adbe2, identifier: TJ54274
2026-03-29 18:41:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with identifier: TJ54274
2026-03-29 18:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with identifier: TJ54274
2026-03-29 18:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with identifier: TJ54274 to the API
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:59:16Z',
'fuel_type': 'diesel',
'id': 'fc1073af-f2da-5a7b-9024-ad2b9f9adbe2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ54274',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 234057,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-27',
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Allure L2',
'transmission': 'automatic',
'trim': 'Allure L2',
'year': 2019}
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-29 18:41:07 [auto1.de] INFO: Saving data for TJ54274: {'auction_closing_time': 1774886356.0, 'created_time': 1773226336.737632, 'last_price_update_time': 1774809667.107511}
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ54274') HTTP/1.1" 204 0
2026-03-29 18:41:07 [scrapy.extensions.logstats] INFO: Crawled 120 pages (at 12 pages/min), scraped 936 items (at 117 items/min)
2026-03-29 18:41:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:41:07 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD99837%27 HTTP/1.1" 200 None
2026-03-29 18:41:07 [auto1.de] INFO: Scrape type for KD99837: 0
2026-03-29 18:41:07 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-29 18:41:07 [auto1.de] INFO: Scrape type for BP65975: 2
2026-03-29 18:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with identifier: BP65975
2026-03-29 18:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with scrape type 2
2026-03-29 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with scrape type 2
2026-03-29 18:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5874bb0-3d59-5c63-aa90-7bfcd5e83901, identifier: BP65975
2026-03-29 18:41:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with identifier: BP65975
2026-03-29 18:41:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with identifier: BP65975
2026-03-29 18:41:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with identifier: BP65975 to the API
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:50:30Z',
'fuel_type': 'petrol',
'id': 'f5874bb0-3d59-5c63-aa90-7bfcd5e83901',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP65975',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 77072,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-06',
'seller_name': None,
'title': 'Audi Q2 30 TFSI Design',
'transmission': 'manual',
'trim': 'Design',
'year': 2018}
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-29 18:41:07 [auto1.de] INFO: Saving data for BP65975: {'auction_closing_time': 1774885830.0, 'created_time': 1772729716.244316, 'last_price_update_time': 1774809667.682099}
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP65975') HTTP/1.1" 204 0
2026-03-29 18:41:07 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN84809%27 HTTP/1.1" 200 None
2026-03-29 18:41:07 [auto1.de] INFO: Scrape type for GN84809: 2
2026-03-29 18:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1413d98a-f689-5bad-8148-522bccaf80b0 with identifier: GN84809
2026-03-29 18:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1413d98a-f689-5bad-8148-522bccaf80b0 with scrape type 2
2026-03-29 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1413d98a-f689-5bad-8148-522bccaf80b0 with scrape type 2
2026-03-29 18:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1413d98a-f689-5bad-8148-522bccaf80b0, identifier: GN84809
2026-03-29 18:41:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1413d98a-f689-5bad-8148-522bccaf80b0 with identifier: GN84809
2026-03-29 18:41:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1413d98a-f689-5bad-8148-522bccaf80b0 with identifier: GN84809
2026-03-29 18:41:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1413d98a-f689-5bad-8148-522bccaf80b0 with identifier: GN84809 to the API
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:14:26Z',
'fuel_type': 'petrol',
'id': '1413d98a-f689-5bad-8148-522bccaf80b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN84809',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 46280,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-13',
'seller_name': None,
'title': 'Volkswagen Caddy 1.4 TSI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2018}
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN84809%27 HTTP/1.1" 200 None
2026-03-29 18:41:08 [auto1.de] INFO: Saving data for GN84809: {'auction_closing_time': 1774883666.0, 'created_time': 1774292734.001056, 'last_price_update_time': 1774809668.123497}
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN84809') HTTP/1.1" 204 0
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT92909%27 HTTP/1.1" 200 None
2026-03-29 18:41:08 [auto1.de] INFO: Scrape type for GT92909: 0
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: US02416
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT79226%27 HTTP/1.1" 200 None
2026-03-29 18:41:08 [auto1.de] INFO: Scrape type for JT79226: 0
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: SP71400
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP71400%27 HTTP/1.1" 200 None
2026-03-29 18:41:08 [auto1.de] INFO: Scrape type for SP71400: 2
2026-03-29 18:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84fc03d3-2ba8-56eb-b011-4d7ba72fe54e with identifier: SP71400
2026-03-29 18:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84fc03d3-2ba8-56eb-b011-4d7ba72fe54e with scrape type 2
2026-03-29 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84fc03d3-2ba8-56eb-b011-4d7ba72fe54e with scrape type 2
2026-03-29 18:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84fc03d3-2ba8-56eb-b011-4d7ba72fe54e, identifier: SP71400
2026-03-29 18:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84fc03d3-2ba8-56eb-b011-4d7ba72fe54e with identifier: SP71400
2026-03-29 18:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84fc03d3-2ba8-56eb-b011-4d7ba72fe54e with identifier: SP71400
2026-03-29 18:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84fc03d3-2ba8-56eb-b011-4d7ba72fe54e with identifier: SP71400 to the API
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:02:11Z',
'fuel_type': 'petrol',
'id': '84fc03d3-2ba8-56eb-b011-4d7ba72fe54e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP71400',
'listing': 'auction',
'make': 'Honda',
'model': 'CR-V',
'odometer': 45017,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-28',
'seller_name': None,
'title': 'Honda CR-V 2.0 VTEC Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2009}
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP71400%27 HTTP/1.1" 200 None
2026-03-29 18:41:08 [auto1.de] INFO: Saving data for SP71400: {'auction_closing_time': 1774882931.0, 'created_time': 1773428309.461068, 'last_price_update_time': 1774809668.546489}
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP71400') HTTP/1.1" 204 0
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR69124%27 HTTP/1.1" 200 None
2026-03-29 18:41:08 [auto1.de] INFO: Scrape type for VR69124: 0
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03124%27 HTTP/1.1" 200 None
2026-03-29 18:41:08 [auto1.de] INFO: Scrape type for TB03124: 2
2026-03-29 18:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 027adde0-4e65-5bb3-bc37-49fecac89140 with identifier: TB03124
2026-03-29 18:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 027adde0-4e65-5bb3-bc37-49fecac89140 with scrape type 2
2026-03-29 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 027adde0-4e65-5bb3-bc37-49fecac89140 with scrape type 2
2026-03-29 18:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 027adde0-4e65-5bb3-bc37-49fecac89140, identifier: TB03124
2026-03-29 18:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 027adde0-4e65-5bb3-bc37-49fecac89140 with identifier: TB03124
2026-03-29 18:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 027adde0-4e65-5bb3-bc37-49fecac89140 with identifier: TB03124
2026-03-29 18:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 027adde0-4e65-5bb3-bc37-49fecac89140 with identifier: TB03124 to the API
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:04:20Z',
'fuel_type': 'petrol',
'id': '027adde0-4e65-5bb3-bc37-49fecac89140',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB03124',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 37123,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-29',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2021}
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03124%27 HTTP/1.1" 200 None
2026-03-29 18:41:09 [auto1.de] INFO: Saving data for TB03124: {'auction_closing_time': 1774883060.0, 'created_time': 1773400890.847966, 'last_price_update_time': 1774809669.005552}
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB03124') HTTP/1.1" 204 0
2026-03-29 18:41:09 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC27244%27 HTTP/1.1" 200 None
2026-03-29 18:41:09 [auto1.de] INFO: Scrape type for FC27244: 0
2026-03-29 18:41:09 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR76399%27 HTTP/1.1" 200 None
2026-03-29 18:41:09 [auto1.de] INFO: Scrape type for CR76399: 0
2026-03-29 18:41:09 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY70159%27 HTTP/1.1" 200 None
2026-03-29 18:41:09 [auto1.de] INFO: Scrape type for EY70159: 0
2026-03-29 18:41:09 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04335%27 HTTP/1.1" 200 None
2026-03-29 18:41:09 [auto1.de] INFO: Scrape type for ZN04335: 2
2026-03-29 18:41:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with identifier: ZN04335
2026-03-29 18:41:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with scrape type 2
2026-03-29 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with scrape type 2
2026-03-29 18:41:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64a51235-0f1f-53a6-bceb-284a0ab7ca50, identifier: ZN04335
2026-03-29 18:41:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with identifier: ZN04335
2026-03-29 18:41:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with identifier: ZN04335
2026-03-29 18:41:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with identifier: ZN04335 to the API
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:37:33Z',
'fuel_type': 'diesel',
'id': '64a51235-0f1f-53a6-bceb-284a0ab7ca50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN04335',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 224947,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-28',
'seller_name': None,
'title': 'Audi A4 2.0 TDIe Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2011}
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04335%27 HTTP/1.1" 200 None
2026-03-29 18:41:09 [auto1.de] INFO: Saving data for ZN04335: {'auction_closing_time': 1774885053.0, 'created_time': 1773225996.144559, 'last_price_update_time': 1774809669.592727}
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN04335') HTTP/1.1" 204 0
2026-03-29 18:41:09 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-29 18:41:09 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63884%27 HTTP/1.1" 200 None
2026-03-29 18:41:09 [auto1.de] INFO: Scrape type for SR63884: 0
2026-03-29 18:41:09 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74558%27 HTTP/1.1" 200 None
2026-03-29 18:41:09 [auto1.de] INFO: Scrape type for ZA74558: 2
2026-03-29 18:41:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15aaabb6-c342-5cb7-aa23-044bcfe32476 with identifier: ZA74558
2026-03-29 18:41:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15aaabb6-c342-5cb7-aa23-044bcfe32476 with scrape type 2
2026-03-29 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15aaabb6-c342-5cb7-aa23-044bcfe32476 with scrape type 2
2026-03-29 18:41:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15aaabb6-c342-5cb7-aa23-044bcfe32476, identifier: ZA74558
2026-03-29 18:41:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15aaabb6-c342-5cb7-aa23-044bcfe32476 with identifier: ZA74558
2026-03-29 18:41:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15aaabb6-c342-5cb7-aa23-044bcfe32476 with identifier: ZA74558
2026-03-29 18:41:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15aaabb6-c342-5cb7-aa23-044bcfe32476 with identifier: ZA74558 to the API
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:41:52Z',
'fuel_type': 'diesel',
'id': '15aaabb6-c342-5cb7-aa23-044bcfe32476',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA74558',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 292487,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-14',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2014}
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74558%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Saving data for ZA74558: {'auction_closing_time': 1774885312.0, 'created_time': 1773776243.486686, 'last_price_update_time': 1774809670.039353}
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA74558') HTTP/1.1" 204 0
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL19330%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Scrape type for UL19330: 0
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM38204%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Scrape type for EM38204: 0
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH60406%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Scrape type for DH60406: 2
2026-03-29 18:41:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3cfc1e1-806d-51fe-8ae9-51373de03b77 with identifier: DH60406
2026-03-29 18:41:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3cfc1e1-806d-51fe-8ae9-51373de03b77 with scrape type 2
2026-03-29 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3cfc1e1-806d-51fe-8ae9-51373de03b77 with scrape type 2
2026-03-29 18:41:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3cfc1e1-806d-51fe-8ae9-51373de03b77, identifier: DH60406
2026-03-29 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3cfc1e1-806d-51fe-8ae9-51373de03b77 with identifier: DH60406
2026-03-29 18:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3cfc1e1-806d-51fe-8ae9-51373de03b77 with identifier: DH60406
2026-03-29 18:41:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3cfc1e1-806d-51fe-8ae9-51373de03b77 with identifier: DH60406 to the API
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-30T15:00:18Z',
'fuel_type': 'diesel',
'id': 'e3cfc1e1-806d-51fe-8ae9-51373de03b77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH60406',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 123545,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-28',
'seller_name': None,
'title': 'Peugeot 2008 1.6 e-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2013}
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH60406%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Saving data for DH60406: {'auction_closing_time': 1774882818.0, 'created_time': 1774118160.60647, 'last_price_update_time': 1774809670.492893}
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH60406') HTTP/1.1" 204 0
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV98525%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Scrape type for LV98525: 2
2026-03-29 18:41:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb222700-2d65-5811-b59a-94d310519ef8 with identifier: LV98525
2026-03-29 18:41:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb222700-2d65-5811-b59a-94d310519ef8 with scrape type 2
2026-03-29 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb222700-2d65-5811-b59a-94d310519ef8 with scrape type 2
2026-03-29 18:41:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb222700-2d65-5811-b59a-94d310519ef8, identifier: LV98525
2026-03-29 18:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb222700-2d65-5811-b59a-94d310519ef8 with identifier: LV98525
2026-03-29 18:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb222700-2d65-5811-b59a-94d310519ef8 with identifier: LV98525
2026-03-29 18:41:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb222700-2d65-5811-b59a-94d310519ef8 with identifier: LV98525 to the API
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:25:29Z',
'fuel_type': 'petrol',
'id': 'eb222700-2d65-5811-b59a-94d310519ef8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV98525',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 114641,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-28',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI Comfortline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline 4Motion BlueMotion',
'year': 2017}
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV98525%27 HTTP/1.1" 200 None
2026-03-29 18:41:11 [auto1.de] INFO: Saving data for LV98525: {'auction_closing_time': 1774884329.0, 'created_time': 1773341874.231617, 'last_price_update_time': 1774809671.086259}
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV98525') HTTP/1.1" 204 0
2026-03-29 18:41:11 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-29 18:41:11 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-29 18:41:11 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF90181%27 HTTP/1.1" 200 None
2026-03-29 18:41:11 [auto1.de] INFO: Scrape type for FF90181: 2
2026-03-29 18:41:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca34f071-0187-52ec-8a15-c95d1d1c51b1 with identifier: FF90181
2026-03-29 18:41:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca34f071-0187-52ec-8a15-c95d1d1c51b1 with scrape type 2
2026-03-29 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca34f071-0187-52ec-8a15-c95d1d1c51b1 with scrape type 2
2026-03-29 18:41:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca34f071-0187-52ec-8a15-c95d1d1c51b1, identifier: FF90181
2026-03-29 18:41:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca34f071-0187-52ec-8a15-c95d1d1c51b1 with identifier: FF90181
2026-03-29 18:41:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca34f071-0187-52ec-8a15-c95d1d1c51b1 with identifier: FF90181
2026-03-29 18:41:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca34f071-0187-52ec-8a15-c95d1d1c51b1 with identifier: FF90181 to the API
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:28:10Z',
'fuel_type': 'hybrid',
'id': 'ca34f071-0187-52ec-8a15-c95d1d1c51b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF90181',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 33611,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-21',
'seller_name': None,
'title': 'BMW X1 xDrive 25e Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2021}
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF90181%27 HTTP/1.1" 200 None
2026-03-29 18:41:11 [auto1.de] INFO: Saving data for FF90181: {'auction_closing_time': 1774884490.0, 'created_time': 1773344622.488958, 'last_price_update_time': 1774809671.551537}
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF90181') HTTP/1.1" 204 0
2026-03-29 18:41:11 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:11 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS26933%27 HTTP/1.1" 200 None
2026-03-29 18:41:11 [auto1.de] INFO: Scrape type for PS26933: 2
2026-03-29 18:41:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af54d5ef-77e0-5dd9-832a-db5628a4e2ee with identifier: PS26933
2026-03-29 18:41:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af54d5ef-77e0-5dd9-832a-db5628a4e2ee with scrape type 2
2026-03-29 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af54d5ef-77e0-5dd9-832a-db5628a4e2ee with scrape type 2
2026-03-29 18:41:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af54d5ef-77e0-5dd9-832a-db5628a4e2ee, identifier: PS26933
2026-03-29 18:41:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af54d5ef-77e0-5dd9-832a-db5628a4e2ee with identifier: PS26933
2026-03-29 18:41:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af54d5ef-77e0-5dd9-832a-db5628a4e2ee with identifier: PS26933
2026-03-29 18:41:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af54d5ef-77e0-5dd9-832a-db5628a4e2ee with identifier: PS26933 to the API
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:15:09Z',
'fuel_type': 'diesel',
'id': 'af54d5ef-77e0-5dd9-832a-db5628a4e2ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS26933',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 227541,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-05',
'seller_name': None,
'title': 'BMW X1 xDrive 18d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS26933%27 HTTP/1.1" 200 None
2026-03-29 18:41:12 [auto1.de] INFO: Saving data for PS26933: {'auction_closing_time': 1774883709.0, 'created_time': 1773399285.810597, 'last_price_update_time': 1774809672.024404}
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS26933') HTTP/1.1" 204 0
2026-03-29 18:41:12 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT94690%27 HTTP/1.1" 200 None
2026-03-29 18:41:12 [auto1.de] INFO: Scrape type for WT94690: 0
2026-03-29 18:41:12 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW09174%27 HTTP/1.1" 200 None
2026-03-29 18:41:12 [auto1.de] INFO: Scrape type for JW09174: 2
2026-03-29 18:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with identifier: JW09174
2026-03-29 18:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with scrape type 2
2026-03-29 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with scrape type 2
2026-03-29 18:41:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5, identifier: JW09174
2026-03-29 18:41:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:12 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK20650%27 HTTP/1.1" 200 None
2026-03-29 18:41:12 [auto1.de] INFO: Scrape type for KK20650: 2
2026-03-29 18:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with identifier: KK20650
2026-03-29 18:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with scrape type 2
2026-03-29 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with scrape type 2
2026-03-29 18:41:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7, identifier: KK20650
2026-03-29 18:41:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with identifier: JW09174
2026-03-29 18:41:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with identifier: JW09174
2026-03-29 18:41:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with identifier: JW09174 to the API
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:45:58Z',
'fuel_type': 'petrol',
'id': '6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW09174',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 169299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-18',
'seller_name': None,
'title': 'Opel Astra 1.4 Turbo Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2011}
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW09174%27 HTTP/1.1" 200 None
2026-03-29 18:41:13 [auto1.de] INFO: Saving data for JW09174: {'auction_closing_time': 1774885558.0, 'created_time': 1773303435.256022, 'last_price_update_time': 1774809673.434824}
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW09174') HTTP/1.1" 204 0
2026-03-29 18:41:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with identifier: KK20650
2026-03-29 18:41:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with identifier: KK20650
2026-03-29 18:41:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with identifier: KK20650 to the API
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:42:54Z',
'fuel_type': 'petrol',
'id': '95ab3343-5ae0-58d5-a0c2-f71d75d86bb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK20650',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 222034,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-30',
'seller_name': None,
'title': 'Volkswagen Golf V 1.4 TSI United',
'transmission': 'manual',
'trim': 'United',
'year': 2008}
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK20650%27 HTTP/1.1" 200 None
2026-03-29 18:41:13 [auto1.de] INFO: Saving data for KK20650: {'auction_closing_time': 1774885374.0, 'created_time': 1773858654.076532, 'last_price_update_time': 1774809673.77586}
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK20650') HTTP/1.1" 204 0
2026-03-29 18:41:13 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL45586%27 HTTP/1.1" 200 None
2026-03-29 18:41:13 [auto1.de] INFO: Scrape type for XL45586: 2
2026-03-29 18:41:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8157fd3e-fd37-5c06-b9bd-57338cef12dd with identifier: XL45586
2026-03-29 18:41:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8157fd3e-fd37-5c06-b9bd-57338cef12dd with scrape type 2
2026-03-29 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8157fd3e-fd37-5c06-b9bd-57338cef12dd with scrape type 2
2026-03-29 18:41:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8157fd3e-fd37-5c06-b9bd-57338cef12dd, identifier: XL45586
2026-03-29 18:41:13 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT51756%27 HTTP/1.1" 200 None
2026-03-29 18:41:13 [auto1.de] INFO: Scrape type for ZT51756: 0
2026-03-29 18:41:13 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-29 18:41:13 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG01076%27 HTTP/1.1" 200 None
2026-03-29 18:41:13 [auto1.de] INFO: Scrape type for VG01076: 0
2026-03-29 18:41:13 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-29 18:41:13 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08508%27 HTTP/1.1" 200 None
2026-03-29 18:41:13 [auto1.de] INFO: Scrape type for AJ08508: 2
2026-03-29 18:41:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66ad37e9-1379-5401-9c38-58b5aad6e208 with identifier: AJ08508
2026-03-29 18:41:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66ad37e9-1379-5401-9c38-58b5aad6e208 with scrape type 2
2026-03-29 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66ad37e9-1379-5401-9c38-58b5aad6e208 with scrape type 2
2026-03-29 18:41:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66ad37e9-1379-5401-9c38-58b5aad6e208, identifier: AJ08508
2026-03-29 18:41:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8157fd3e-fd37-5c06-b9bd-57338cef12dd with identifier: XL45586
2026-03-29 18:41:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8157fd3e-fd37-5c06-b9bd-57338cef12dd with identifier: XL45586
2026-03-29 18:41:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8157fd3e-fd37-5c06-b9bd-57338cef12dd with identifier: XL45586 to the API
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 450,
'expiration_date': '2026-03-30T15:10:38Z',
'fuel_type': 'petrol',
'id': '8157fd3e-fd37-5c06-b9bd-57338cef12dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL45586',
'listing': 'auction',
'make': 'Audi',
'model': 'S6',
'odometer': 139797,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-24',
'seller_name': None,
'title': 'Audi S6 4.0 V8 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2018}
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL45586%27 HTTP/1.1" 200 None
2026-03-29 18:41:14 [auto1.de] INFO: Saving data for XL45586: {'auction_closing_time': 1774883438.0, 'created_time': 1772543201.677041, 'last_price_update_time': 1774809674.406325}
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL45586') HTTP/1.1" 204 0
2026-03-29 18:41:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66ad37e9-1379-5401-9c38-58b5aad6e208 with identifier: AJ08508
2026-03-29 18:41:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66ad37e9-1379-5401-9c38-58b5aad6e208 with identifier: AJ08508
2026-03-29 18:41:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66ad37e9-1379-5401-9c38-58b5aad6e208 with identifier: AJ08508 to the API
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:20:50Z',
'fuel_type': 'diesel',
'id': '66ad37e9-1379-5401-9c38-58b5aad6e208',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ08508',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 119886,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-16',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Elegance 4Motion',
'transmission': 'automatic',
'trim': 'Elegance 4Motion',
'year': 2021}
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08508%27 HTTP/1.1" 200 None
2026-03-29 18:41:14 [auto1.de] INFO: Saving data for AJ08508: {'auction_closing_time': 1774884050.0, 'created_time': 1774522302.359298, 'last_price_update_time': 1774809674.799626}
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ08508') HTTP/1.1" 204 0
2026-03-29 18:41:14 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF78286%27 HTTP/1.1" 200 None
2026-03-29 18:41:14 [auto1.de] INFO: Scrape type for JF78286: 2
2026-03-29 18:41:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e78664ca-19d5-52ce-8a2b-409bbf506043 with identifier: JF78286
2026-03-29 18:41:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e78664ca-19d5-52ce-8a2b-409bbf506043 with scrape type 2
2026-03-29 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e78664ca-19d5-52ce-8a2b-409bbf506043 with scrape type 2
2026-03-29 18:41:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e78664ca-19d5-52ce-8a2b-409bbf506043, identifier: JF78286
2026-03-29 18:41:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e78664ca-19d5-52ce-8a2b-409bbf506043 with identifier: JF78286
2026-03-29 18:41:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e78664ca-19d5-52ce-8a2b-409bbf506043 with identifier: JF78286
2026-03-29 18:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e78664ca-19d5-52ce-8a2b-409bbf506043 with identifier: JF78286 to the API
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:24:33Z',
'fuel_type': 'diesel',
'id': 'e78664ca-19d5-52ce-8a2b-409bbf506043',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF78286',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 137618,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-09',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI Maxi Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Maxi Comfortline BlueMotion',
'year': 2019}
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF78286%27 HTTP/1.1" 200 None
2026-03-29 18:41:15 [auto1.de] INFO: Saving data for JF78286: {'auction_closing_time': 1774884273.0, 'created_time': 1774636542.923446, 'last_price_update_time': 1774809675.205244}
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF78286') HTTP/1.1" 204 0
2026-03-29 18:41:15 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-29 18:41:15 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU78971%27 HTTP/1.1" 200 None
2026-03-29 18:41:15 [auto1.de] INFO: Scrape type for LU78971: 2
2026-03-29 18:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d82731f0-4143-5c3b-bca4-73e350b68a34 with identifier: LU78971
2026-03-29 18:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d82731f0-4143-5c3b-bca4-73e350b68a34 with scrape type 2
2026-03-29 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d82731f0-4143-5c3b-bca4-73e350b68a34 with scrape type 2
2026-03-29 18:41:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d82731f0-4143-5c3b-bca4-73e350b68a34, identifier: LU78971
2026-03-29 18:41:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d82731f0-4143-5c3b-bca4-73e350b68a34 with identifier: LU78971
2026-03-29 18:41:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d82731f0-4143-5c3b-bca4-73e350b68a34 with identifier: LU78971
2026-03-29 18:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d82731f0-4143-5c3b-bca4-73e350b68a34 with identifier: LU78971 to the API
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:23:44Z',
'fuel_type': 'diesel',
'id': 'd82731f0-4143-5c3b-bca4-73e350b68a34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU78971',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 288720,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-08-08',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 280 CDI Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2005}
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU78971%27 HTTP/1.1" 200 None
2026-03-29 18:41:15 [auto1.de] INFO: Saving data for LU78971: {'auction_closing_time': 1774884224.0, 'created_time': 1773469111.327448, 'last_price_update_time': 1774809675.622394}
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU78971') HTTP/1.1" 204 0
2026-03-29 18:41:15 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42572%27 HTTP/1.1" 200 None
2026-03-29 18:41:15 [auto1.de] INFO: Scrape type for DE42572: 2
2026-03-29 18:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 557a104b-0f7c-5ec8-b511-88add1c586ed with identifier: DE42572
2026-03-29 18:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 557a104b-0f7c-5ec8-b511-88add1c586ed with scrape type 2
2026-03-29 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 557a104b-0f7c-5ec8-b511-88add1c586ed with scrape type 2
2026-03-29 18:41:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 557a104b-0f7c-5ec8-b511-88add1c586ed, identifier: DE42572
2026-03-29 18:41:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 557a104b-0f7c-5ec8-b511-88add1c586ed with identifier: DE42572
2026-03-29 18:41:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 557a104b-0f7c-5ec8-b511-88add1c586ed with identifier: DE42572
2026-03-29 18:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 557a104b-0f7c-5ec8-b511-88add1c586ed with identifier: DE42572 to the API
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:17:51Z',
'fuel_type': 'diesel',
'id': '557a104b-0f7c-5ec8-b511-88add1c586ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE42572',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 148669,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-28',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
'transmission': 'manual',
'trim': 'Sports-Line AWD',
'year': 2016}
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42572%27 HTTP/1.1" 200 None
2026-03-29 18:41:16 [auto1.de] INFO: Saving data for DE42572: {'auction_closing_time': 1774883871.0, 'created_time': 1772545084.892825, 'last_price_update_time': 1774809676.100077}
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE42572') HTTP/1.1" 204 0
2026-03-29 18:41:16 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH92340%27 HTTP/1.1" 200 None
2026-03-29 18:41:16 [auto1.de] INFO: Scrape type for JH92340: 0
2026-03-29 18:41:16 [auto1.de] INFO: Found listing with ID: MH95503
2026-03-29 18:41:16 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS04983%27 HTTP/1.1" 200 None
2026-03-29 18:41:16 [auto1.de] INFO: Scrape type for NS04983: 2
2026-03-29 18:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5107a15a-289f-5118-821d-0e47c7fd0497 with identifier: NS04983
2026-03-29 18:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5107a15a-289f-5118-821d-0e47c7fd0497 with scrape type 2
2026-03-29 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5107a15a-289f-5118-821d-0e47c7fd0497 with scrape type 2
2026-03-29 18:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5107a15a-289f-5118-821d-0e47c7fd0497, identifier: NS04983
2026-03-29 18:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5107a15a-289f-5118-821d-0e47c7fd0497 with identifier: NS04983
2026-03-29 18:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5107a15a-289f-5118-821d-0e47c7fd0497 with identifier: NS04983
2026-03-29 18:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5107a15a-289f-5118-821d-0e47c7fd0497 with identifier: NS04983 to the API
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:16:42Z',
'fuel_type': 'petrol',
'id': '5107a15a-289f-5118-821d-0e47c7fd0497',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS04983',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 67979,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-16',
'seller_name': None,
'title': 'BMW X1 xDrive 28i',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS04983%27 HTTP/1.1" 200 None
2026-03-29 18:41:16 [auto1.de] INFO: Saving data for NS04983: {'auction_closing_time': 1774883802.0, 'created_time': 1773400577.900967, 'last_price_update_time': 1774809676.545393}
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS04983') HTTP/1.1" 204 0
2026-03-29 18:41:16 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM23773%27 HTTP/1.1" 200 None
2026-03-29 18:41:16 [auto1.de] INFO: Scrape type for MM23773: 2
2026-03-29 18:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0127fa3-ff0d-57ce-9de3-e733be125e5d with identifier: MM23773
2026-03-29 18:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0127fa3-ff0d-57ce-9de3-e733be125e5d with scrape type 2
2026-03-29 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0127fa3-ff0d-57ce-9de3-e733be125e5d with scrape type 2
2026-03-29 18:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0127fa3-ff0d-57ce-9de3-e733be125e5d, identifier: MM23773
2026-03-29 18:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0127fa3-ff0d-57ce-9de3-e733be125e5d with identifier: MM23773
2026-03-29 18:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0127fa3-ff0d-57ce-9de3-e733be125e5d with identifier: MM23773
2026-03-29 18:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0127fa3-ff0d-57ce-9de3-e733be125e5d with identifier: MM23773 to the API
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:29:50Z',
'fuel_type': 'diesel',
'id': 'b0127fa3-ff0d-57ce-9de3-e733be125e5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM23773',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 216498,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-10',
'seller_name': None,
'title': 'BMW 2er 218d Active Tourer Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2015}
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM23773%27 HTTP/1.1" 200 None
2026-03-29 18:41:17 [auto1.de] INFO: Saving data for MM23773: {'auction_closing_time': 1774884590.0, 'created_time': 1774293911.948399, 'last_price_update_time': 1774809677.004569}
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM23773') HTTP/1.1" 204 0
2026-03-29 18:41:17 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-29 18:41:17 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY22177%27 HTTP/1.1" 200 None
2026-03-29 18:41:17 [auto1.de] INFO: Scrape type for FY22177: 0
2026-03-29 18:41:17 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS84546%27 HTTP/1.1" 200 None
2026-03-29 18:41:17 [auto1.de] INFO: Scrape type for ZS84546: 2
2026-03-29 18:41:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14936224-b559-5c51-b0ee-14f74714156d with identifier: ZS84546
2026-03-29 18:41:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14936224-b559-5c51-b0ee-14f74714156d with scrape type 2
2026-03-29 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14936224-b559-5c51-b0ee-14f74714156d with scrape type 2
2026-03-29 18:41:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14936224-b559-5c51-b0ee-14f74714156d, identifier: ZS84546
2026-03-29 18:41:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14936224-b559-5c51-b0ee-14f74714156d with identifier: ZS84546
2026-03-29 18:41:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14936224-b559-5c51-b0ee-14f74714156d with identifier: ZS84546
2026-03-29 18:41:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14936224-b559-5c51-b0ee-14f74714156d with identifier: ZS84546 to the API
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 69,
'expiration_date': '2026-03-30T15:33:39Z',
'fuel_type': 'petrol',
'id': '14936224-b559-5c51-b0ee-14f74714156d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS84546',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 64978,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-14',
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid Club',
'transmission': 'manual',
'trim': 'Club',
'year': 2014}
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS84546%27 HTTP/1.1" 200 None
2026-03-29 18:41:17 [auto1.de] INFO: Saving data for ZS84546: {'auction_closing_time': 1774884819.0, 'created_time': 1773400086.235863, 'last_price_update_time': 1774809677.481227}
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS84546') HTTP/1.1" 204 0
2026-03-29 18:41:17 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP80168%27 HTTP/1.1" 200 None
2026-03-29 18:41:17 [auto1.de] INFO: Scrape type for PP80168: 0
2026-03-29 18:41:17 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL01177%27 HTTP/1.1" 200 None
2026-03-29 18:41:17 [auto1.de] INFO: Scrape type for JL01177: 0
2026-03-29 18:41:17 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-29 18:41:17 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-29 18:41:17 [auto1.de] INFO: Scrape type for BD72910: 2
2026-03-29 18:41:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with identifier: BD72910
2026-03-29 18:41:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with scrape type 2
2026-03-29 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with scrape type 2
2026-03-29 18:41:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91, identifier: BD72910
2026-03-29 18:41:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with identifier: BD72910
2026-03-29 18:41:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with identifier: BD72910
2026-03-29 18:41:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with identifier: BD72910 to the API
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:06:18Z',
'fuel_type': 'diesel',
'id': 'c572a2fd-c4e0-5c41-acf1-9272a0e8ad91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD72910',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 197843,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-03',
'seller_name': None,
'title': 'Audi A4 2.0 TDI quattro S line Sportpaket plus',
'transmission': 'automatic',
'trim': 'quattro S line Sportpaket plus',
'year': 2013}
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-29 18:41:18 [auto1.de] INFO: Saving data for BD72910: {'auction_closing_time': 1774883178.0, 'created_time': 1773469081.61321, 'last_price_update_time': 1774809678.103249}
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD72910') HTTP/1.1" 204 0
2026-03-29 18:41:18 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC80403%27 HTTP/1.1" 200 None
2026-03-29 18:41:18 [auto1.de] INFO: Scrape type for RC80403: 0
2026-03-29 18:41:18 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG76002%27 HTTP/1.1" 200 None
2026-03-29 18:41:18 [auto1.de] INFO: Scrape type for NG76002: 0
2026-03-29 18:41:18 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ71122%27 HTTP/1.1" 200 None
2026-03-29 18:41:18 [auto1.de] INFO: Scrape type for AJ71122: 2
2026-03-29 18:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e623ff-fe03-5500-8a70-06d78fa7c337 with identifier: AJ71122
2026-03-29 18:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e623ff-fe03-5500-8a70-06d78fa7c337 with scrape type 2
2026-03-29 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68e623ff-fe03-5500-8a70-06d78fa7c337 with scrape type 2
2026-03-29 18:41:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68e623ff-fe03-5500-8a70-06d78fa7c337, identifier: AJ71122
2026-03-29 18:41:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68e623ff-fe03-5500-8a70-06d78fa7c337 with identifier: AJ71122
2026-03-29 18:41:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68e623ff-fe03-5500-8a70-06d78fa7c337 with identifier: AJ71122
2026-03-29 18:41:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68e623ff-fe03-5500-8a70-06d78fa7c337 with identifier: AJ71122 to the API
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 262,
'expiration_date': '2026-03-30T15:27:40Z',
'fuel_type': 'diesel',
'id': '68e623ff-fe03-5500-8a70-06d78fa7c337',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ71122',
'listing': 'auction',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 141585,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-11',
'seller_name': None,
'title': 'Porsche Cayenne Diesel Platinum Edition',
'transmission': 'automatic',
'trim': 'Platinum Edition',
'year': 2017}
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ71122%27 HTTP/1.1" 200 None
2026-03-29 18:41:18 [auto1.de] INFO: Saving data for AJ71122: {'auction_closing_time': 1774884460.0, 'created_time': 1774290715.357785, 'last_price_update_time': 1774809678.619239}
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ71122') HTTP/1.1" 204 0
2026-03-29 18:41:18 [auto1.de] INFO: Found listing with ID: MV27472
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV27472%27 HTTP/1.1" 200 None
2026-03-29 18:41:18 [auto1.de] INFO: Scrape type for MV27472: 2
2026-03-29 18:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41003dae-0779-592a-b3ee-b2a6717b4e82 with identifier: MV27472
2026-03-29 18:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41003dae-0779-592a-b3ee-b2a6717b4e82 with scrape type 2
2026-03-29 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41003dae-0779-592a-b3ee-b2a6717b4e82 with scrape type 2
2026-03-29 18:41:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41003dae-0779-592a-b3ee-b2a6717b4e82, identifier: MV27472
2026-03-29 18:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41003dae-0779-592a-b3ee-b2a6717b4e82 with identifier: MV27472
2026-03-29 18:41:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41003dae-0779-592a-b3ee-b2a6717b4e82 with identifier: MV27472
2026-03-29 18:41:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41003dae-0779-592a-b3ee-b2a6717b4e82 with identifier: MV27472 to the API
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:17:39Z',
'fuel_type': 'diesel',
'id': '41003dae-0779-592a-b3ee-b2a6717b4e82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV27472',
'listing': 'auction',
'make': 'Renault',
'model': 'Master',
'odometer': 90849,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-17',
'seller_name': None,
'title': 'Renault Master 2.3 dCi L2H2 HKa 3,3t',
'transmission': 'manual',
'trim': 'L2H2 HKa 3,3t',
'year': 2018}
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV27472%27 HTTP/1.1" 200 None
2026-03-29 18:41:19 [auto1.de] INFO: Saving data for MV27472: {'auction_closing_time': 1774883859.0, 'created_time': 1773399502.280106, 'last_price_update_time': 1774809679.033136}
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV27472') HTTP/1.1" 204 0
2026-03-29 18:41:19 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27977%27 HTTP/1.1" 200 None
2026-03-29 18:41:19 [auto1.de] INFO: Scrape type for GB27977: 2
2026-03-29 18:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b8e4afb-8d96-5a04-a092-38428b049634 with identifier: GB27977
2026-03-29 18:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b8e4afb-8d96-5a04-a092-38428b049634 with scrape type 2
2026-03-29 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b8e4afb-8d96-5a04-a092-38428b049634 with scrape type 2
2026-03-29 18:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b8e4afb-8d96-5a04-a092-38428b049634, identifier: GB27977
2026-03-29 18:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b8e4afb-8d96-5a04-a092-38428b049634 with identifier: GB27977
2026-03-29 18:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b8e4afb-8d96-5a04-a092-38428b049634 with identifier: GB27977
2026-03-29 18:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b8e4afb-8d96-5a04-a092-38428b049634 with identifier: GB27977 to the API
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:26:44Z',
'fuel_type': 'diesel',
'id': '6b8e4afb-8d96-5a04-a092-38428b049634',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB27977',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 81671,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-28',
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Allure L2',
'transmission': 'automatic',
'trim': 'Allure L2',
'year': 2018}
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27977%27 HTTP/1.1" 200 None
2026-03-29 18:41:19 [auto1.de] INFO: Saving data for GB27977: {'auction_closing_time': 1774884404.0, 'created_time': 1774032130.796188, 'last_price_update_time': 1774809679.483056}
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB27977') HTTP/1.1" 204 0
2026-03-29 18:41:19 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM13382%27 HTTP/1.1" 200 None
2026-03-29 18:41:19 [auto1.de] INFO: Scrape type for DM13382: 2
2026-03-29 18:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c10f829-a6be-5740-bd57-74517d6a4f59 with identifier: DM13382
2026-03-29 18:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c10f829-a6be-5740-bd57-74517d6a4f59 with scrape type 2
2026-03-29 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c10f829-a6be-5740-bd57-74517d6a4f59 with scrape type 2
2026-03-29 18:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c10f829-a6be-5740-bd57-74517d6a4f59, identifier: DM13382
2026-03-29 18:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c10f829-a6be-5740-bd57-74517d6a4f59 with identifier: DM13382
2026-03-29 18:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c10f829-a6be-5740-bd57-74517d6a4f59 with identifier: DM13382
2026-03-29 18:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c10f829-a6be-5740-bd57-74517d6a4f59 with identifier: DM13382 to the API
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:09:59Z',
'fuel_type': 'petrol',
'id': '8c10f829-a6be-5740-bd57-74517d6a4f59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM13382',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 90029,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-27',
'seller_name': None,
'title': 'Skoda Octavia 1.5 TSI ACT Clever',
'transmission': 'automatic',
'trim': 'Clever',
'year': 2018}
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM13382%27 HTTP/1.1" 200 None
2026-03-29 18:41:19 [auto1.de] INFO: Saving data for DM13382: {'auction_closing_time': 1774883399.0, 'created_time': 1773307254.364152, 'last_price_update_time': 1774809679.948057}
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM13382') HTTP/1.1" 204 0
2026-03-29 18:41:19 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:19 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-29 18:41:19 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR73410%27 HTTP/1.1" 200 None
2026-03-29 18:41:19 [auto1.de] INFO: Scrape type for XR73410: 2
2026-03-29 18:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1733974a-2168-5da2-8ec7-3b9d2e4c635f with identifier: XR73410
2026-03-29 18:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1733974a-2168-5da2-8ec7-3b9d2e4c635f with scrape type 2
2026-03-29 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1733974a-2168-5da2-8ec7-3b9d2e4c635f with scrape type 2
2026-03-29 18:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1733974a-2168-5da2-8ec7-3b9d2e4c635f, identifier: XR73410
2026-03-29 18:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1733974a-2168-5da2-8ec7-3b9d2e4c635f with identifier: XR73410
2026-03-29 18:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1733974a-2168-5da2-8ec7-3b9d2e4c635f with identifier: XR73410
2026-03-29 18:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1733974a-2168-5da2-8ec7-3b9d2e4c635f with identifier: XR73410 to the API
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:57:13Z',
'fuel_type': 'petrol',
'id': '1733974a-2168-5da2-8ec7-3b9d2e4c635f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR73410',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand C-Max',
'odometer': 134814,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-05',
'seller_name': None,
'title': 'Ford Grand C-Max 1.5 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2016}
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR73410%27 HTTP/1.1" 200 None
2026-03-29 18:41:20 [auto1.de] INFO: Saving data for XR73410: {'auction_closing_time': 1774886233.0, 'created_time': 1774521920.616533, 'last_price_update_time': 1774809680.390061}
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR73410') HTTP/1.1" 204 0
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK05347%27 HTTP/1.1" 200 None
2026-03-29 18:41:20 [auto1.de] INFO: Scrape type for RK05347: 0
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86778%27 HTTP/1.1" 200 None
2026-03-29 18:41:20 [auto1.de] INFO: Scrape type for XC86778: 0
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ94450%27 HTTP/1.1" 200 None
2026-03-29 18:41:20 [auto1.de] INFO: Scrape type for CZ94450: 2
2026-03-29 18:41:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 023b43e7-00c1-5cae-8017-4b4155e5e661 with identifier: CZ94450
2026-03-29 18:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 023b43e7-00c1-5cae-8017-4b4155e5e661 with scrape type 2
2026-03-29 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 023b43e7-00c1-5cae-8017-4b4155e5e661 with scrape type 2
2026-03-29 18:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 023b43e7-00c1-5cae-8017-4b4155e5e661, identifier: CZ94450
2026-03-29 18:41:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32906%27 HTTP/1.1" 200 None
2026-03-29 18:41:20 [auto1.de] INFO: Scrape type for PR32906: 0
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13835%27 HTTP/1.1" 200 None
2026-03-29 18:41:20 [auto1.de] INFO: Scrape type for BG13835: 2
2026-03-29 18:41:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed816ebe-4d4c-5c66-ba4c-2f343082fe4a with identifier: BG13835
2026-03-29 18:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed816ebe-4d4c-5c66-ba4c-2f343082fe4a with scrape type 2
2026-03-29 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed816ebe-4d4c-5c66-ba4c-2f343082fe4a with scrape type 2
2026-03-29 18:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed816ebe-4d4c-5c66-ba4c-2f343082fe4a, identifier: BG13835
2026-03-29 18:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 023b43e7-00c1-5cae-8017-4b4155e5e661 with identifier: CZ94450
2026-03-29 18:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 023b43e7-00c1-5cae-8017-4b4155e5e661 with identifier: CZ94450
2026-03-29 18:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 023b43e7-00c1-5cae-8017-4b4155e5e661 with identifier: CZ94450 to the API
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:56:15Z',
'fuel_type': 'petrol',
'id': '023b43e7-00c1-5cae-8017-4b4155e5e661',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ94450',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 147514,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-23',
'seller_name': None,
'title': 'BMW 1er 118i Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2018}
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ94450%27 HTTP/1.1" 200 None
2026-03-29 18:41:21 [auto1.de] INFO: Saving data for CZ94450: {'auction_closing_time': 1774886175.0, 'created_time': 1774292019.43737, 'last_price_update_time': 1774809681.163039}
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ94450') HTTP/1.1" 204 0
2026-03-29 18:41:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed816ebe-4d4c-5c66-ba4c-2f343082fe4a with identifier: BG13835
2026-03-29 18:41:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed816ebe-4d4c-5c66-ba4c-2f343082fe4a with identifier: BG13835
2026-03-29 18:41:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed816ebe-4d4c-5c66-ba4c-2f343082fe4a with identifier: BG13835 to the API
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:35:31Z',
'fuel_type': 'petrol',
'id': 'ed816ebe-4d4c-5c66-ba4c-2f343082fe4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG13835',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 201308,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-21',
'seller_name': None,
'title': 'Seat Ibiza 1.4 Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2012}
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13835%27 HTTP/1.1" 200 None
2026-03-29 18:41:21 [auto1.de] INFO: Saving data for BG13835: {'auction_closing_time': 1774884931.0, 'created_time': 1774522012.821496, 'last_price_update_time': 1774809681.479591}
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG13835') HTTP/1.1" 204 0
2026-03-29 18:41:21 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD07804%27 HTTP/1.1" 200 None
2026-03-29 18:41:21 [auto1.de] INFO: Scrape type for FD07804: 2
2026-03-29 18:41:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with identifier: FD07804
2026-03-29 18:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with scrape type 2
2026-03-29 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with scrape type 2
2026-03-29 18:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7dc9a63b-bef0-516a-b640-0ed70f5eb054, identifier: FD07804
2026-03-29 18:41:21 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-29 18:41:21 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX79678%27 HTTP/1.1" 200 None
2026-03-29 18:41:21 [auto1.de] INFO: Scrape type for KX79678: 2
2026-03-29 18:41:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4207b5d9-b583-5de5-a664-8aa73e57ada5 with identifier: KX79678
2026-03-29 18:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4207b5d9-b583-5de5-a664-8aa73e57ada5 with scrape type 2
2026-03-29 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4207b5d9-b583-5de5-a664-8aa73e57ada5 with scrape type 2
2026-03-29 18:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4207b5d9-b583-5de5-a664-8aa73e57ada5, identifier: KX79678
2026-03-29 18:41:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with identifier: FD07804
2026-03-29 18:41:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with identifier: FD07804
2026-03-29 18:41:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with identifier: FD07804 to the API
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:05:08Z',
'fuel_type': 'petrol',
'id': '7dc9a63b-bef0-516a-b640-0ed70f5eb054',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD07804',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 306605,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-05',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD07804%27 HTTP/1.1" 200 None
2026-03-29 18:41:22 [auto1.de] INFO: Saving data for FD07804: {'auction_closing_time': 1774883108.0, 'created_time': 1774293941.83323, 'last_price_update_time': 1774809682.031707}
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD07804') HTTP/1.1" 204 0
2026-03-29 18:41:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4207b5d9-b583-5de5-a664-8aa73e57ada5 with identifier: KX79678
2026-03-29 18:41:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4207b5d9-b583-5de5-a664-8aa73e57ada5 with identifier: KX79678
2026-03-29 18:41:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4207b5d9-b583-5de5-a664-8aa73e57ada5 with identifier: KX79678 to the API
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:48:28Z',
'fuel_type': 'petrol',
'id': '4207b5d9-b583-5de5-a664-8aa73e57ada5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX79678',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 96029,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-21',
'seller_name': None,
'title': 'Opel Mokka 1.4 Turbo Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2015}
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX79678%27 HTTP/1.1" 200 None
2026-03-29 18:41:22 [auto1.de] INFO: Saving data for KX79678: {'auction_closing_time': 1774885708.0, 'created_time': 1773306116.14845, 'last_price_update_time': 1774809682.583881}
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX79678') HTTP/1.1" 204 0
2026-03-29 18:41:22 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU14663%27 HTTP/1.1" 200 None
2026-03-29 18:41:22 [auto1.de] INFO: Scrape type for EU14663: 0
2026-03-29 18:41:22 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK09620%27 HTTP/1.1" 200 None
2026-03-29 18:41:22 [auto1.de] INFO: Scrape type for MK09620: 0
2026-03-29 18:41:22 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-29 18:41:22 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS96565%27 HTTP/1.1" 200 None
2026-03-29 18:41:22 [auto1.de] INFO: Scrape type for BS96565: 0
2026-03-29 18:41:22 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93420%27 HTTP/1.1" 200 None
2026-03-29 18:41:22 [auto1.de] INFO: Scrape type for FK93420: 0
2026-03-29 18:41:22 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP67168%27 HTTP/1.1" 200 None
2026-03-29 18:41:22 [auto1.de] INFO: Scrape type for TP67168: 0
2026-03-29 18:41:22 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-29 18:41:22 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL71232%27 HTTP/1.1" 200 None
2026-03-29 18:41:22 [auto1.de] INFO: Scrape type for AL71232: 2
2026-03-29 18:41:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b7451f4-d5f3-51cb-8269-84453813d405 with identifier: AL71232
2026-03-29 18:41:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b7451f4-d5f3-51cb-8269-84453813d405 with scrape type 2
2026-03-29 18:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b7451f4-d5f3-51cb-8269-84453813d405 with scrape type 2
2026-03-29 18:41:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b7451f4-d5f3-51cb-8269-84453813d405, identifier: AL71232
2026-03-29 18:41:22 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03907%27 HTTP/1.1" 200 None
2026-03-29 18:41:22 [auto1.de] INFO: Scrape type for BJ03907: 2
2026-03-29 18:41:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a535f07-fa4a-5c06-bf25-732891dafc2c with identifier: BJ03907
2026-03-29 18:41:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a535f07-fa4a-5c06-bf25-732891dafc2c with scrape type 2
2026-03-29 18:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a535f07-fa4a-5c06-bf25-732891dafc2c with scrape type 2
2026-03-29 18:41:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a535f07-fa4a-5c06-bf25-732891dafc2c, identifier: BJ03907
2026-03-29 18:41:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b7451f4-d5f3-51cb-8269-84453813d405 with identifier: AL71232
2026-03-29 18:41:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b7451f4-d5f3-51cb-8269-84453813d405 with identifier: AL71232
2026-03-29 18:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b7451f4-d5f3-51cb-8269-84453813d405 with identifier: AL71232 to the API
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:23:26Z',
'fuel_type': 'petrol',
'id': '1b7451f4-d5f3-51cb-8269-84453813d405',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL71232',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 129595,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-04',
'seller_name': None,
'title': 'Audi A1 1.4 TFSI S line Sportpaket',
'transmission': 'manual',
'trim': 'S line Sportpaket',
'year': 2015}
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL71232%27 HTTP/1.1" 200 None
2026-03-29 18:41:23 [auto1.de] INFO: Saving data for AL71232: {'auction_closing_time': 1774884206.0, 'created_time': 1773859369.203921, 'last_price_update_time': 1774809683.25895}
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL71232') HTTP/1.1" 204 0
2026-03-29 18:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a535f07-fa4a-5c06-bf25-732891dafc2c with identifier: BJ03907
2026-03-29 18:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a535f07-fa4a-5c06-bf25-732891dafc2c with identifier: BJ03907
2026-03-29 18:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a535f07-fa4a-5c06-bf25-732891dafc2c with identifier: BJ03907 to the API
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:18:13Z',
'fuel_type': 'petrol',
'id': '1a535f07-fa4a-5c06-bf25-732891dafc2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ03907',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 187156,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-07-19',
'seller_name': None,
'title': 'BMW 5er 523i',
'transmission': 'automatic',
'trim': '',
'year': 1998}
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03907%27 HTTP/1.1" 200 None
2026-03-29 18:41:23 [auto1.de] INFO: Saving data for BJ03907: {'auction_closing_time': 1774883893.0, 'created_time': 1774292268.597958, 'last_price_update_time': 1774809683.584016}
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ03907') HTTP/1.1" 204 0
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH93335%27 HTTP/1.1" 200 None
2026-03-29 18:41:23 [auto1.de] INFO: Scrape type for YH93335: 2
2026-03-29 18:41:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f498da1d-5208-5a84-a2bd-5be7e2af31be with identifier: YH93335
2026-03-29 18:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f498da1d-5208-5a84-a2bd-5be7e2af31be with scrape type 2
2026-03-29 18:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f498da1d-5208-5a84-a2bd-5be7e2af31be with scrape type 2
2026-03-29 18:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f498da1d-5208-5a84-a2bd-5be7e2af31be, identifier: YH93335
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE52525%27 HTTP/1.1" 200 None
2026-03-29 18:41:23 [auto1.de] INFO: Scrape type for BE52525: 2
2026-03-29 18:41:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 406642a3-d969-5745-8934-74863490bf24 with identifier: BE52525
2026-03-29 18:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 406642a3-d969-5745-8934-74863490bf24 with scrape type 2
2026-03-29 18:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 406642a3-d969-5745-8934-74863490bf24 with scrape type 2
2026-03-29 18:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 406642a3-d969-5745-8934-74863490bf24, identifier: BE52525
2026-03-29 18:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f498da1d-5208-5a84-a2bd-5be7e2af31be with identifier: YH93335
2026-03-29 18:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f498da1d-5208-5a84-a2bd-5be7e2af31be with identifier: YH93335
2026-03-29 18:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f498da1d-5208-5a84-a2bd-5be7e2af31be with identifier: YH93335 to the API
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:31:09Z',
'fuel_type': 'diesel',
'id': 'f498da1d-5208-5a84-a2bd-5be7e2af31be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH93335',
'listing': 'auction',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 103531,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-27',
'seller_name': None,
'title': 'Seat Tarraco 2.0 TDI Xcellence 4Drive',
'transmission': 'automatic',
'trim': 'Xcellence 4Drive',
'year': 2019}
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH93335%27 HTTP/1.1" 200 None
2026-03-29 18:41:24 [auto1.de] INFO: Saving data for YH93335: {'auction_closing_time': 1774884669.0, 'created_time': 1773134593.0644, 'last_price_update_time': 1774809684.191463}
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH93335') HTTP/1.1" 204 0
2026-03-29 18:41:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 406642a3-d969-5745-8934-74863490bf24 with identifier: BE52525
2026-03-29 18:41:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 406642a3-d969-5745-8934-74863490bf24 with identifier: BE52525
2026-03-29 18:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 406642a3-d969-5745-8934-74863490bf24 with identifier: BE52525 to the API
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:47:38Z',
'fuel_type': 'diesel',
'id': '406642a3-d969-5745-8934-74863490bf24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE52525',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 235302,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-03',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2012}
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE52525%27 HTTP/1.1" 200 None
2026-03-29 18:41:24 [auto1.de] INFO: Saving data for BE52525: {'auction_closing_time': 1774885658.0, 'created_time': 1774251040.727605, 'last_price_update_time': 1774809684.664608}
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE52525') HTTP/1.1" 204 0
2026-03-29 18:41:24 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-29 18:41:24 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08526%27 HTTP/1.1" 200 None
2026-03-29 18:41:24 [auto1.de] INFO: Scrape type for YA08526: 0
2026-03-29 18:41:24 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-29 18:41:24 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-29 18:41:24 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-29 18:41:24 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60092%27 HTTP/1.1" 200 None
2026-03-29 18:41:24 [auto1.de] INFO: Scrape type for YM60092: 0
2026-03-29 18:41:24 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA99169%27 HTTP/1.1" 200 None
2026-03-29 18:41:24 [auto1.de] INFO: Scrape type for HA99169: 2
2026-03-29 18:41:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d02b93fe-7708-5ebe-aed6-8eccae35fb81 with identifier: HA99169
2026-03-29 18:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d02b93fe-7708-5ebe-aed6-8eccae35fb81 with scrape type 2
2026-03-29 18:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d02b93fe-7708-5ebe-aed6-8eccae35fb81 with scrape type 2
2026-03-29 18:41:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d02b93fe-7708-5ebe-aed6-8eccae35fb81, identifier: HA99169
2026-03-29 18:41:24 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD84444%27 HTTP/1.1" 200 None
2026-03-29 18:41:24 [auto1.de] INFO: Scrape type for ZD84444: 2
2026-03-29 18:41:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 875a71bf-a439-5849-b5ae-90a3ce035f2e with identifier: ZD84444
2026-03-29 18:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 875a71bf-a439-5849-b5ae-90a3ce035f2e with scrape type 2
2026-03-29 18:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 875a71bf-a439-5849-b5ae-90a3ce035f2e with scrape type 2
2026-03-29 18:41:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 875a71bf-a439-5849-b5ae-90a3ce035f2e, identifier: ZD84444
2026-03-29 18:41:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d02b93fe-7708-5ebe-aed6-8eccae35fb81 with identifier: HA99169
2026-03-29 18:41:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d02b93fe-7708-5ebe-aed6-8eccae35fb81 with identifier: HA99169
2026-03-29 18:41:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d02b93fe-7708-5ebe-aed6-8eccae35fb81 with identifier: HA99169 to the API
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 194,
'expiration_date': '2026-03-30T15:36:44Z',
'fuel_type': 'diesel',
'id': 'd02b93fe-7708-5ebe-aed6-8eccae35fb81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA99169',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 85673,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-11',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T AMG Line',
'transmission': 'automatic',
'trim': 'T AMG Line',
'year': 2019}
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA99169%27 HTTP/1.1" 200 None
2026-03-29 18:41:25 [auto1.de] INFO: Saving data for HA99169: {'auction_closing_time': 1774885004.0, 'created_time': 1773830069.665637, 'last_price_update_time': 1774809685.282844}
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA99169') HTTP/1.1" 204 0
2026-03-29 18:41:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 875a71bf-a439-5849-b5ae-90a3ce035f2e with identifier: ZD84444
2026-03-29 18:41:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 875a71bf-a439-5849-b5ae-90a3ce035f2e with identifier: ZD84444
2026-03-29 18:41:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 875a71bf-a439-5849-b5ae-90a3ce035f2e with identifier: ZD84444 to the API
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:00:17Z',
'fuel_type': 'petrol',
'id': '875a71bf-a439-5849-b5ae-90a3ce035f2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD84444',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 208550,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-30',
'seller_name': None,
'title': 'Renault Megane 1.6 Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2012}
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD84444%27 HTTP/1.1" 200 None
2026-03-29 18:41:25 [auto1.de] INFO: Saving data for ZD84444: {'auction_closing_time': 1774882817.0, 'created_time': 1774521625.900573, 'last_price_update_time': 1774809685.580204}
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD84444') HTTP/1.1" 204 0
2026-03-29 18:41:25 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-29 18:41:25 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU28360%27 HTTP/1.1" 200 None
2026-03-29 18:41:25 [auto1.de] INFO: Scrape type for GU28360: 2
2026-03-29 18:41:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4cc9f20-ea51-5320-8886-ed781248e844 with identifier: GU28360
2026-03-29 18:41:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4cc9f20-ea51-5320-8886-ed781248e844 with scrape type 2
2026-03-29 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4cc9f20-ea51-5320-8886-ed781248e844 with scrape type 2
2026-03-29 18:41:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4cc9f20-ea51-5320-8886-ed781248e844, identifier: GU28360
2026-03-29 18:41:25 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-29 18:41:25 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-29 18:41:25 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS79616%27 HTTP/1.1" 200 None
2026-03-29 18:41:25 [auto1.de] INFO: Scrape type for AS79616: 0
2026-03-29 18:41:25 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY24056%27 HTTP/1.1" 200 None
2026-03-29 18:41:25 [auto1.de] INFO: Scrape type for KY24056: 0
2026-03-29 18:41:25 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-29 18:41:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4cc9f20-ea51-5320-8886-ed781248e844 with identifier: GU28360
2026-03-29 18:41:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4cc9f20-ea51-5320-8886-ed781248e844 with identifier: GU28360
2026-03-29 18:41:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4cc9f20-ea51-5320-8886-ed781248e844 with identifier: GU28360 to the API
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:56:25Z',
'fuel_type': 'petrol',
'id': 'a4cc9f20-ea51-5320-8886-ed781248e844',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU28360',
'listing': 'auction',
'make': 'Seat',
'model': 'Mii',
'odometer': 106253,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-18',
'seller_name': None,
'title': 'Seat Mii 1.0 Style Salsa',
'transmission': 'manual',
'trim': 'Style Salsa',
'year': 2013}
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU28360%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Saving data for GU28360: {'auction_closing_time': 1774886185.0, 'created_time': 1774636513.868887, 'last_price_update_time': 1774809686.008118}
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU28360') HTTP/1.1" 204 0
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL23432%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Scrape type for GL23432: 0
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY39865%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Scrape type for NY39865: 2
2026-03-29 18:41:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 729c82fa-8f39-50e2-ae15-3b8acda29ec6 with identifier: NY39865
2026-03-29 18:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 729c82fa-8f39-50e2-ae15-3b8acda29ec6 with scrape type 2
2026-03-29 18:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 729c82fa-8f39-50e2-ae15-3b8acda29ec6 with scrape type 2
2026-03-29 18:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 729c82fa-8f39-50e2-ae15-3b8acda29ec6, identifier: NY39865
2026-03-29 18:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 729c82fa-8f39-50e2-ae15-3b8acda29ec6 with identifier: NY39865
2026-03-29 18:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 729c82fa-8f39-50e2-ae15-3b8acda29ec6 with identifier: NY39865
2026-03-29 18:41:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 729c82fa-8f39-50e2-ae15-3b8acda29ec6 with identifier: NY39865 to the API
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:04:23Z',
'fuel_type': 'petrol',
'id': '729c82fa-8f39-50e2-ae15-3b8acda29ec6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY39865',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 267719,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-05-13',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 320 Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2003}
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY39865%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Saving data for NY39865: {'auction_closing_time': 1774883063.0, 'created_time': 1774636252.858283, 'last_price_update_time': 1774809686.525211}
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY39865') HTTP/1.1" 204 0
2026-03-29 18:41:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM89123%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Scrape type for YM89123: 0
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE20553%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Scrape type for JE20553: 0
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95833%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Scrape type for HE95833: 0
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-29 18:41:26 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH40486%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Scrape type for BH40486: 2
2026-03-29 18:41:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 551c1ada-bf78-5be3-9631-177dbd709f4d with identifier: BH40486
2026-03-29 18:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 551c1ada-bf78-5be3-9631-177dbd709f4d with scrape type 2
2026-03-29 18:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 551c1ada-bf78-5be3-9631-177dbd709f4d with scrape type 2
2026-03-29 18:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 551c1ada-bf78-5be3-9631-177dbd709f4d, identifier: BH40486
2026-03-29 18:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 551c1ada-bf78-5be3-9631-177dbd709f4d with identifier: BH40486
2026-03-29 18:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 551c1ada-bf78-5be3-9631-177dbd709f4d with identifier: BH40486
2026-03-29 18:41:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 551c1ada-bf78-5be3-9631-177dbd709f4d with identifier: BH40486 to the API
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:24:22Z',
'fuel_type': 'petrol',
'id': '551c1ada-bf78-5be3-9631-177dbd709f4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH40486',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 97459,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-19',
'seller_name': None,
'title': 'Opel Astra 1.4 SIDI Turbo Ultimate Start/Stop',
'transmission': 'manual',
'trim': 'Ultimate Start/Stop',
'year': 2018}
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH40486%27 HTTP/1.1" 200 None
2026-03-29 18:41:27 [auto1.de] INFO: Saving data for BH40486: {'auction_closing_time': 1774884262.0, 'created_time': 1774117874.201827, 'last_price_update_time': 1774809687.064631}
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH40486') HTTP/1.1" 204 0
2026-03-29 18:41:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC58368%27 HTTP/1.1" 200 None
2026-03-29 18:41:27 [auto1.de] INFO: Scrape type for FC58368: 2
2026-03-29 18:41:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20c71355-aa31-5840-8206-1ca39c023845 with identifier: FC58368
2026-03-29 18:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20c71355-aa31-5840-8206-1ca39c023845 with scrape type 2
2026-03-29 18:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20c71355-aa31-5840-8206-1ca39c023845 with scrape type 2
2026-03-29 18:41:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20c71355-aa31-5840-8206-1ca39c023845, identifier: FC58368
2026-03-29 18:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20c71355-aa31-5840-8206-1ca39c023845 with identifier: FC58368
2026-03-29 18:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20c71355-aa31-5840-8206-1ca39c023845 with identifier: FC58368
2026-03-29 18:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20c71355-aa31-5840-8206-1ca39c023845 with identifier: FC58368 to the API
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:48:55Z',
'fuel_type': 'petrol',
'id': '20c71355-aa31-5840-8206-1ca39c023845',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC58368',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 214437,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-12-13',
'seller_name': None,
'title': 'Audi A4 2.0 TFSIe',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC58368%27 HTTP/1.1" 200 None
2026-03-29 18:41:27 [auto1.de] INFO: Saving data for FC58368: {'auction_closing_time': 1774885735.0, 'created_time': 1774522125.216577, 'last_price_update_time': 1774809687.57733}
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC58368') HTTP/1.1" 204 0
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ72661%27 HTTP/1.1" 200 None
2026-03-29 18:41:27 [auto1.de] INFO: Scrape type for PJ72661: 0
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU55937%27 HTTP/1.1" 200 None
2026-03-29 18:41:27 [auto1.de] INFO: Scrape type for EU55937: 2
2026-03-29 18:41:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79d1bd06-228a-5b68-952d-698deb89dc78 with identifier: EU55937
2026-03-29 18:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79d1bd06-228a-5b68-952d-698deb89dc78 with scrape type 2
2026-03-29 18:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79d1bd06-228a-5b68-952d-698deb89dc78 with scrape type 2
2026-03-29 18:41:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79d1bd06-228a-5b68-952d-698deb89dc78, identifier: EU55937
2026-03-29 18:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79d1bd06-228a-5b68-952d-698deb89dc78 with identifier: EU55937
2026-03-29 18:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79d1bd06-228a-5b68-952d-698deb89dc78 with identifier: EU55937
2026-03-29 18:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79d1bd06-228a-5b68-952d-698deb89dc78 with identifier: EU55937 to the API
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:22:00Z',
'fuel_type': 'diesel',
'id': '79d1bd06-228a-5b68-952d-698deb89dc78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU55937',
'listing': 'auction',
'make': 'Volvo',
'model': 'V70',
'odometer': 157214,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-10',
'seller_name': None,
'title': 'Volvo V70 2.0 D2 Linje Classic',
'transmission': 'manual',
'trim': 'Linje Classic',
'year': 2015}
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU55937%27 HTTP/1.1" 200 None
2026-03-29 18:41:28 [auto1.de] INFO: Saving data for EU55937: {'auction_closing_time': 1774884120.0, 'created_time': 1774290700.149568, 'last_price_update_time': 1774809688.048265}
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU55937') HTTP/1.1" 204 0
2026-03-29 18:41:28 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72428%27 HTTP/1.1" 200 None
2026-03-29 18:41:28 [auto1.de] INFO: Scrape type for TL72428: 0
2026-03-29 18:41:28 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR16166%27 HTTP/1.1" 200 None
2026-03-29 18:41:28 [auto1.de] INFO: Scrape type for TR16166: 0
2026-03-29 18:41:28 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-29 18:41:28 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT75216%27 HTTP/1.1" 200 None
2026-03-29 18:41:28 [auto1.de] INFO: Scrape type for CT75216: 2
2026-03-29 18:41:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 841da4fd-f475-5cfe-9962-457dfb47561e with identifier: CT75216
2026-03-29 18:41:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 841da4fd-f475-5cfe-9962-457dfb47561e with scrape type 2
2026-03-29 18:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 841da4fd-f475-5cfe-9962-457dfb47561e with scrape type 2
2026-03-29 18:41:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 841da4fd-f475-5cfe-9962-457dfb47561e, identifier: CT75216
2026-03-29 18:41:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 841da4fd-f475-5cfe-9962-457dfb47561e with identifier: CT75216
2026-03-29 18:41:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 841da4fd-f475-5cfe-9962-457dfb47561e with identifier: CT75216
2026-03-29 18:41:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 841da4fd-f475-5cfe-9962-457dfb47561e with identifier: CT75216 to the API
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:33:40Z',
'fuel_type': 'diesel',
'id': '841da4fd-f475-5cfe-9962-457dfb47561e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT75216',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 51621,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-21',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 CDI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2011}
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT75216%27 HTTP/1.1" 200 None
2026-03-29 18:41:28 [auto1.de] INFO: Saving data for CT75216: {'auction_closing_time': 1774884820.0, 'created_time': 1774522493.368228, 'last_price_update_time': 1774809688.495829}
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT75216') HTTP/1.1" 204 0
2026-03-29 18:41:28 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-29 18:41:28 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-29 18:41:28 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22561%27 HTTP/1.1" 200 None
2026-03-29 18:41:28 [auto1.de] INFO: Scrape type for CN22561: 0
2026-03-29 18:41:28 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-29 18:41:28 [auto1.de] INFO: Found listing with ID: UA34873
2026-03-29 18:41:28 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH54779%27 HTTP/1.1" 200 None
2026-03-29 18:41:28 [auto1.de] INFO: Scrape type for ZH54779: 2
2026-03-29 18:41:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dd22ef7-37f7-5119-87f4-68fd0aac645b with identifier: ZH54779
2026-03-29 18:41:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dd22ef7-37f7-5119-87f4-68fd0aac645b with scrape type 2
2026-03-29 18:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dd22ef7-37f7-5119-87f4-68fd0aac645b with scrape type 2
2026-03-29 18:41:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5dd22ef7-37f7-5119-87f4-68fd0aac645b, identifier: ZH54779
2026-03-29 18:41:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5dd22ef7-37f7-5119-87f4-68fd0aac645b with identifier: ZH54779
2026-03-29 18:41:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5dd22ef7-37f7-5119-87f4-68fd0aac645b with identifier: ZH54779
2026-03-29 18:41:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5dd22ef7-37f7-5119-87f4-68fd0aac645b with identifier: ZH54779 to the API
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:35:15Z',
'fuel_type': 'diesel',
'id': '5dd22ef7-37f7-5119-87f4-68fd0aac645b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH54779',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 172250,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-25',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2011}
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH54779%27 HTTP/1.1" 200 None
2026-03-29 18:41:29 [auto1.de] INFO: Saving data for ZH54779: {'auction_closing_time': 1774884915.0, 'created_time': 1774262583.119828, 'last_price_update_time': 1774809689.050921}
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH54779') HTTP/1.1" 204 0
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84142%27 HTTP/1.1" 200 None
2026-03-29 18:41:29 [auto1.de] INFO: Scrape type for NV84142: 0
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV75239%27 HTTP/1.1" 200 None
2026-03-29 18:41:29 [auto1.de] INFO: Scrape type for KV75239: 2
2026-03-29 18:41:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with identifier: KV75239
2026-03-29 18:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with scrape type 2
2026-03-29 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with scrape type 2
2026-03-29 18:41:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea, identifier: KV75239
2026-03-29 18:41:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with identifier: KV75239
2026-03-29 18:41:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with identifier: KV75239
2026-03-29 18:41:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with identifier: KV75239 to the API
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:19:12Z',
'fuel_type': 'petrol',
'id': '82444e8b-ca76-5e97-8ad8-4ee35d3e8cea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV75239',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 213705,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-25',
'seller_name': None,
'title': 'Ford Focus 1.6 Concept',
'transmission': 'manual',
'trim': 'Concept',
'year': 2009}
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV75239%27 HTTP/1.1" 200 None
2026-03-29 18:41:29 [auto1.de] INFO: Saving data for KV75239: {'auction_closing_time': 1774883952.0, 'created_time': 1773306810.208658, 'last_price_update_time': 1774809689.640212}
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV75239') HTTP/1.1" 204 0
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN20430%27 HTTP/1.1" 200 None
2026-03-29 18:41:29 [auto1.de] INFO: Scrape type for WN20430: 0
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP55762%27 HTTP/1.1" 200 None
2026-03-29 18:41:29 [auto1.de] INFO: Scrape type for CP55762: 0
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE30876%27 HTTP/1.1" 200 None
2026-03-29 18:41:29 [auto1.de] INFO: Scrape type for UE30876: 2
2026-03-29 18:41:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05d164fa-902c-54bb-ab5a-f6903d939bc9 with identifier: UE30876
2026-03-29 18:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05d164fa-902c-54bb-ab5a-f6903d939bc9 with scrape type 2
2026-03-29 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05d164fa-902c-54bb-ab5a-f6903d939bc9 with scrape type 2
2026-03-29 18:41:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05d164fa-902c-54bb-ab5a-f6903d939bc9, identifier: UE30876
2026-03-29 18:41:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05d164fa-902c-54bb-ab5a-f6903d939bc9 with identifier: UE30876
2026-03-29 18:41:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05d164fa-902c-54bb-ab5a-f6903d939bc9 with identifier: UE30876
2026-03-29 18:41:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05d164fa-902c-54bb-ab5a-f6903d939bc9 with identifier: UE30876 to the API
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:33:50Z',
'fuel_type': 'petrol',
'id': '05d164fa-902c-54bb-ab5a-f6903d939bc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE30876',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix20',
'odometer': 84867,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-14',
'seller_name': None,
'title': 'Hyundai ix20 1.6 Comfort',
'transmission': 'automatic',
'trim': 'Comfort',
'year': 2012}
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE30876%27 HTTP/1.1" 200 None
2026-03-29 18:41:30 [auto1.de] INFO: Saving data for UE30876: {'auction_closing_time': 1774884830.0, 'created_time': 1774607542.583199, 'last_price_update_time': 1774809690.451602}
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE30876') HTTP/1.1" 204 0
2026-03-29 18:41:30 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY98011%27 HTTP/1.1" 200 None
2026-03-29 18:41:30 [auto1.de] INFO: Scrape type for EY98011: 0
2026-03-29 18:41:30 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-29 18:41:30 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-29 18:41:30 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK93259%27 HTTP/1.1" 200 None
2026-03-29 18:41:30 [auto1.de] INFO: Scrape type for MK93259: 2
2026-03-29 18:41:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 103f26e6-ca00-57ba-b79d-7de5efc56ff7 with identifier: MK93259
2026-03-29 18:41:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 103f26e6-ca00-57ba-b79d-7de5efc56ff7 with scrape type 2
2026-03-29 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 103f26e6-ca00-57ba-b79d-7de5efc56ff7 with scrape type 2
2026-03-29 18:41:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 103f26e6-ca00-57ba-b79d-7de5efc56ff7, identifier: MK93259
2026-03-29 18:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 103f26e6-ca00-57ba-b79d-7de5efc56ff7 with identifier: MK93259
2026-03-29 18:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 103f26e6-ca00-57ba-b79d-7de5efc56ff7 with identifier: MK93259
2026-03-29 18:41:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 103f26e6-ca00-57ba-b79d-7de5efc56ff7 with identifier: MK93259 to the API
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:03:21Z',
'fuel_type': 'petrol',
'id': '103f26e6-ca00-57ba-b79d-7de5efc56ff7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK93259',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 72450,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-27',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK93259%27 HTTP/1.1" 200 None
2026-03-29 18:41:30 [auto1.de] INFO: Saving data for MK93259: {'auction_closing_time': 1774883001.0, 'created_time': 1774636503.497648, 'last_price_update_time': 1774809690.920992}
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK93259') HTTP/1.1" 204 0
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT09686%27 HTTP/1.1" 200 None
2026-03-29 18:41:31 [auto1.de] INFO: Scrape type for JT09686: 0
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB40051%27 HTTP/1.1" 200 None
2026-03-29 18:41:31 [auto1.de] INFO: Scrape type for CB40051: 0
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21344%27 HTTP/1.1" 200 None
2026-03-29 18:41:31 [auto1.de] INFO: Scrape type for NY21344: 2
2026-03-29 18:41:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b97d0590-ebcb-5840-9e0d-284c82e25b68 with identifier: NY21344
2026-03-29 18:41:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b97d0590-ebcb-5840-9e0d-284c82e25b68 with scrape type 2
2026-03-29 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b97d0590-ebcb-5840-9e0d-284c82e25b68 with scrape type 2
2026-03-29 18:41:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b97d0590-ebcb-5840-9e0d-284c82e25b68, identifier: NY21344
2026-03-29 18:41:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b97d0590-ebcb-5840-9e0d-284c82e25b68 with identifier: NY21344
2026-03-29 18:41:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b97d0590-ebcb-5840-9e0d-284c82e25b68 with identifier: NY21344
2026-03-29 18:41:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b97d0590-ebcb-5840-9e0d-284c82e25b68 with identifier: NY21344 to the API
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 72,
'expiration_date': '2026-03-30T15:22:17Z',
'fuel_type': 'petrol',
'id': 'b97d0590-ebcb-5840-9e0d-284c82e25b68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY21344',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo X',
'odometer': 45748,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-11-27',
'seller_name': None,
'title': 'Toyota Aygo X 1.0 VVT-i Team D',
'transmission': 'automatic',
'trim': 'Team D',
'year': 2024}
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21344%27 HTTP/1.1" 200 None
2026-03-29 18:41:31 [auto1.de] INFO: Saving data for NY21344: {'auction_closing_time': 1774884137.0, 'created_time': 1774636329.12714, 'last_price_update_time': 1774809691.902108}
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY21344') HTTP/1.1" 204 0
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS09930%27 HTTP/1.1" 200 None
2026-03-29 18:41:31 [auto1.de] INFO: Scrape type for NS09930: 0
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB70808%27 HTTP/1.1" 200 None
2026-03-29 18:41:31 [auto1.de] INFO: Scrape type for HB70808: 0
2026-03-29 18:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:32 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: HL07149
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL07149%27 HTTP/1.1" 200 None
2026-03-29 18:41:32 [auto1.de] INFO: Scrape type for HL07149: 0
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR43208%27 HTTP/1.1" 200 None
2026-03-29 18:41:32 [auto1.de] INFO: Scrape type for XR43208: 2
2026-03-29 18:41:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9988beee-091a-51a8-9251-c85e89b9b8ca with identifier: XR43208
2026-03-29 18:41:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9988beee-091a-51a8-9251-c85e89b9b8ca with scrape type 2
2026-03-29 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9988beee-091a-51a8-9251-c85e89b9b8ca with scrape type 2
2026-03-29 18:41:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9988beee-091a-51a8-9251-c85e89b9b8ca, identifier: XR43208
2026-03-29 18:41:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9988beee-091a-51a8-9251-c85e89b9b8ca with identifier: XR43208
2026-03-29 18:41:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9988beee-091a-51a8-9251-c85e89b9b8ca with identifier: XR43208
2026-03-29 18:41:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9988beee-091a-51a8-9251-c85e89b9b8ca with identifier: XR43208 to the API
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:00:24Z',
'fuel_type': 'diesel',
'id': '9988beee-091a-51a8-9251-c85e89b9b8ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR43208',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 140190,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-16',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2010}
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR43208%27 HTTP/1.1" 200 None
2026-03-29 18:41:32 [auto1.de] INFO: Saving data for XR43208: {'auction_closing_time': 1774882824.0, 'created_time': 1774293312.589195, 'last_price_update_time': 1774809692.605501}
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR43208') HTTP/1.1" 204 0
2026-03-29 18:41:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA11075%27 HTTP/1.1" 200 None
2026-03-29 18:41:32 [auto1.de] INFO: Scrape type for LA11075: 0
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX54451%27 HTTP/1.1" 200 None
2026-03-29 18:41:32 [auto1.de] INFO: Scrape type for BX54451: 0
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93910%27 HTTP/1.1" 200 None
2026-03-29 18:41:32 [auto1.de] INFO: Scrape type for KU93910: 2
2026-03-29 18:41:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f92dfd0-a12d-5b34-b508-80b1b87f1919 with identifier: KU93910
2026-03-29 18:41:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f92dfd0-a12d-5b34-b508-80b1b87f1919 with scrape type 2
2026-03-29 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f92dfd0-a12d-5b34-b508-80b1b87f1919 with scrape type 2
2026-03-29 18:41:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f92dfd0-a12d-5b34-b508-80b1b87f1919, identifier: KU93910
2026-03-29 18:41:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f92dfd0-a12d-5b34-b508-80b1b87f1919 with identifier: KU93910
2026-03-29 18:41:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f92dfd0-a12d-5b34-b508-80b1b87f1919 with identifier: KU93910
2026-03-29 18:41:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f92dfd0-a12d-5b34-b508-80b1b87f1919 with identifier: KU93910 to the API
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:03:47Z',
'fuel_type': 'hybrid',
'id': '6f92dfd0-a12d-5b34-b508-80b1b87f1919',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU93910',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 113693,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-29',
'seller_name': None,
'title': 'Peugeot 3008 2.0 HDi Hybrid4',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93910%27 HTTP/1.1" 200 None
2026-03-29 18:41:33 [auto1.de] INFO: Saving data for KU93910: {'auction_closing_time': 1774883027.0, 'created_time': 1774521579.9574, 'last_price_update_time': 1774809693.144437}
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU93910') HTTP/1.1" 204 0
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK24126%27 HTTP/1.1" 200 None
2026-03-29 18:41:33 [auto1.de] INFO: Scrape type for BK24126: 0
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC39473%27 HTTP/1.1" 200 None
2026-03-29 18:41:33 [auto1.de] INFO: Scrape type for EC39473: 0
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK25344%27 HTTP/1.1" 200 None
2026-03-29 18:41:33 [auto1.de] INFO: Scrape type for YK25344: 0
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG59761%27 HTTP/1.1" 200 None
2026-03-29 18:41:33 [auto1.de] INFO: Scrape type for UG59761: 0
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR07443%27 HTTP/1.1" 200 None
2026-03-29 18:41:33 [auto1.de] INFO: Scrape type for YR07443: 2
2026-03-29 18:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dc696c5-580f-5784-974b-bc532cf68bd7 with identifier: YR07443
2026-03-29 18:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dc696c5-580f-5784-974b-bc532cf68bd7 with scrape type 2
2026-03-29 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dc696c5-580f-5784-974b-bc532cf68bd7 with scrape type 2
2026-03-29 18:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5dc696c5-580f-5784-974b-bc532cf68bd7, identifier: YR07443
2026-03-29 18:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5dc696c5-580f-5784-974b-bc532cf68bd7 with identifier: YR07443
2026-03-29 18:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5dc696c5-580f-5784-974b-bc532cf68bd7 with identifier: YR07443
2026-03-29 18:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5dc696c5-580f-5784-974b-bc532cf68bd7 with identifier: YR07443 to the API
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 249,
'expiration_date': '2026-03-30T15:45:22Z',
'fuel_type': 'diesel',
'id': '5dc696c5-580f-5784-974b-bc532cf68bd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR07443',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 111280,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-20',
'seller_name': None,
'title': 'Volvo XC90 2.0 B5 Diesel R-Design AWD',
'transmission': 'automatic',
'trim': 'R-Design AWD',
'year': 2019}
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR07443%27 HTTP/1.1" 200 None
2026-03-29 18:41:33 [auto1.de] INFO: Saving data for YR07443: {'auction_closing_time': 1774885522.0, 'created_time': 1773427045.549917, 'last_price_update_time': 1774809693.753557}
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR07443') HTTP/1.1" 204 0
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND18169%27 HTTP/1.1" 200 None
2026-03-29 18:41:33 [auto1.de] INFO: Scrape type for ND18169: 2
2026-03-29 18:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65d9dc76-4491-5308-9b75-88a0aceea15e with identifier: ND18169
2026-03-29 18:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65d9dc76-4491-5308-9b75-88a0aceea15e with scrape type 2
2026-03-29 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65d9dc76-4491-5308-9b75-88a0aceea15e with scrape type 2
2026-03-29 18:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65d9dc76-4491-5308-9b75-88a0aceea15e, identifier: ND18169
2026-03-29 18:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65d9dc76-4491-5308-9b75-88a0aceea15e with identifier: ND18169
2026-03-29 18:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65d9dc76-4491-5308-9b75-88a0aceea15e with identifier: ND18169
2026-03-29 18:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65d9dc76-4491-5308-9b75-88a0aceea15e with identifier: ND18169 to the API
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:49:55Z',
'fuel_type': 'petrol',
'id': '65d9dc76-4491-5308-9b75-88a0aceea15e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND18169',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 134901,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-30',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-29 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND18169%27 HTTP/1.1" 200 None
2026-03-29 18:41:35 [auto1.de] INFO: Saving data for ND18169: {'auction_closing_time': 1774885795.0, 'created_time': 1773732648.390875, 'last_price_update_time': 1774809695.967062}
2026-03-29 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND18169') HTTP/1.1" 204 0
2026-03-29 18:41:36 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-29 18:41:36 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-29 18:41:36 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE74949%27 HTTP/1.1" 200 None
2026-03-29 18:41:36 [auto1.de] INFO: Scrape type for EE74949: 0
2026-03-29 18:41:36 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN93893%27 HTTP/1.1" 200 None
2026-03-29 18:41:36 [auto1.de] INFO: Scrape type for AN93893: 2
2026-03-29 18:41:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with identifier: AN93893
2026-03-29 18:41:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with scrape type 2
2026-03-29 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with scrape type 2
2026-03-29 18:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 664a47e5-cdb0-5cb9-adb1-2b35c8758626, identifier: AN93893
2026-03-29 18:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with identifier: AN93893
2026-03-29 18:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with identifier: AN93893
2026-03-29 18:41:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with identifier: AN93893 to the API
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:41:49Z',
'fuel_type': 'diesel',
'id': '664a47e5-cdb0-5cb9-adb1-2b35c8758626',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN93893',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 277598,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-25',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN93893%27 HTTP/1.1" 200 None
2026-03-29 18:41:36 [auto1.de] INFO: Saving data for AN93893: {'auction_closing_time': 1774885309.0, 'created_time': 1773307951.607186, 'last_price_update_time': 1774809696.63535}
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN93893') HTTP/1.1" 204 0
2026-03-29 18:41:36 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-29 18:41:36 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-29 18:41:36 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-29 18:41:36 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU36572%27 HTTP/1.1" 200 None
2026-03-29 18:41:36 [auto1.de] INFO: Scrape type for MU36572: 0
2026-03-29 18:41:36 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU92987%27 HTTP/1.1" 200 None
2026-03-29 18:41:36 [auto1.de] INFO: Scrape type for XU92987: 0
2026-03-29 18:41:36 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-29 18:41:36 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP20693%27 HTTP/1.1" 200 None
2026-03-29 18:41:36 [auto1.de] INFO: Scrape type for AP20693: 2
2026-03-29 18:41:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f95bb6a8-e05a-5735-a145-4566bd28db91 with identifier: AP20693
2026-03-29 18:41:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f95bb6a8-e05a-5735-a145-4566bd28db91 with scrape type 2
2026-03-29 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f95bb6a8-e05a-5735-a145-4566bd28db91 with scrape type 2
2026-03-29 18:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f95bb6a8-e05a-5735-a145-4566bd28db91, identifier: AP20693
2026-03-29 18:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f95bb6a8-e05a-5735-a145-4566bd28db91 with identifier: AP20693
2026-03-29 18:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f95bb6a8-e05a-5735-a145-4566bd28db91 with identifier: AP20693
2026-03-29 18:41:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f95bb6a8-e05a-5735-a145-4566bd28db91 with identifier: AP20693 to the API
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:05:46Z',
'fuel_type': 'diesel',
'id': 'f95bb6a8-e05a-5735-a145-4566bd28db91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP20693',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 315705,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-15',
'seller_name': None,
'title': 'Nissan Qashqai 2.0 dCi 360 4x4',
'transmission': 'automatic',
'trim': '360 4x4',
'year': 2013}
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP20693%27 HTTP/1.1" 200 None
2026-03-29 18:41:37 [auto1.de] INFO: Saving data for AP20693: {'auction_closing_time': 1774883146.0, 'created_time': 1774522505.361843, 'last_price_update_time': 1774809697.098013}
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP20693') HTTP/1.1" 204 0
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-29 18:41:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:37 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT56915%27 HTTP/1.1" 200 None
2026-03-29 18:41:37 [auto1.de] INFO: Scrape type for YT56915: 0
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX05177%27 HTTP/1.1" 200 None
2026-03-29 18:41:37 [auto1.de] INFO: Scrape type for VX05177: 0
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK07522%27 HTTP/1.1" 200 None
2026-03-29 18:41:37 [auto1.de] INFO: Scrape type for ZK07522: 2
2026-03-29 18:41:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa7ae772-719a-5c6e-9c3f-c3f647a64180 with identifier: ZK07522
2026-03-29 18:41:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa7ae772-719a-5c6e-9c3f-c3f647a64180 with scrape type 2
2026-03-29 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa7ae772-719a-5c6e-9c3f-c3f647a64180 with scrape type 2
2026-03-29 18:41:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa7ae772-719a-5c6e-9c3f-c3f647a64180, identifier: ZK07522
2026-03-29 18:41:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa7ae772-719a-5c6e-9c3f-c3f647a64180 with identifier: ZK07522
2026-03-29 18:41:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa7ae772-719a-5c6e-9c3f-c3f647a64180 with identifier: ZK07522
2026-03-29 18:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa7ae772-719a-5c6e-9c3f-c3f647a64180 with identifier: ZK07522 to the API
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 330,
'expiration_date': '2026-03-30T15:52:38Z',
'fuel_type': 'petrol',
'id': 'aa7ae772-719a-5c6e-9c3f-c3f647a64180',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK07522',
'listing': 'auction',
'make': 'Maserati',
'model': 'Grecale',
'odometer': 27730,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-15',
'seller_name': None,
'title': 'Maserati Grecale 2.0 Turbo Mild-Hybrid Modena AWD',
'transmission': 'automatic',
'trim': 'Modena AWD',
'year': 2023}
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK07522%27 HTTP/1.1" 200 None
2026-03-29 18:41:37 [auto1.de] INFO: Saving data for ZK07522: {'auction_closing_time': 1774885958.0, 'created_time': 1774549854.128375, 'last_price_update_time': 1774809697.903182}
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK07522') HTTP/1.1" 204 0
2026-03-29 18:41:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL91815%27 HTTP/1.1" 200 None
2026-03-29 18:41:37 [auto1.de] INFO: Scrape type for JL91815: 2
2026-03-29 18:41:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with identifier: JL91815
2026-03-29 18:41:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with scrape type 2
2026-03-29 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with scrape type 2
2026-03-29 18:41:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93b4b4e9-50cb-5882-b364-b47601ed4dc6, identifier: JL91815
2026-03-29 18:41:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with identifier: JL91815
2026-03-29 18:41:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with identifier: JL91815
2026-03-29 18:41:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with identifier: JL91815 to the API
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:41:21Z',
'fuel_type': 'petrol',
'id': '93b4b4e9-50cb-5882-b364-b47601ed4dc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL91815',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 88428,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-06',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180',
'transmission': 'manual',
'trim': '',
'year': 2017}
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL91815%27 HTTP/1.1" 200 None
2026-03-29 18:41:38 [auto1.de] INFO: Saving data for JL91815: {'auction_closing_time': 1774885281.0, 'created_time': 1774608340.673145, 'last_price_update_time': 1774809698.375381}
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL91815') HTTP/1.1" 204 0
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: US61717
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08144%27 HTTP/1.1" 200 None
2026-03-29 18:41:38 [auto1.de] INFO: Scrape type for SG08144: 0
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ63993%27 HTTP/1.1" 200 None
2026-03-29 18:41:38 [auto1.de] INFO: Scrape type for UJ63993: 0
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP10598%27 HTTP/1.1" 200 None
2026-03-29 18:41:38 [auto1.de] INFO: Scrape type for XP10598: 2
2026-03-29 18:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ed0f722-c06d-5659-8f0f-94074b18bed4 with identifier: XP10598
2026-03-29 18:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ed0f722-c06d-5659-8f0f-94074b18bed4 with scrape type 2
2026-03-29 18:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ed0f722-c06d-5659-8f0f-94074b18bed4 with scrape type 2
2026-03-29 18:41:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ed0f722-c06d-5659-8f0f-94074b18bed4, identifier: XP10598
2026-03-29 18:41:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ed0f722-c06d-5659-8f0f-94074b18bed4 with identifier: XP10598
2026-03-29 18:41:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ed0f722-c06d-5659-8f0f-94074b18bed4 with identifier: XP10598
2026-03-29 18:41:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ed0f722-c06d-5659-8f0f-94074b18bed4 with identifier: XP10598 to the API
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:26:17Z',
'fuel_type': 'diesel',
'id': '9ed0f722-c06d-5659-8f0f-94074b18bed4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP10598',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 278847,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-22',
'seller_name': None,
'title': 'BMW 3er 330d',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP10598%27 HTTP/1.1" 200 None
2026-03-29 18:41:38 [auto1.de] INFO: Saving data for XP10598: {'auction_closing_time': 1774884377.0, 'created_time': 1774521834.637139, 'last_price_update_time': 1774809698.917793}
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP10598') HTTP/1.1" 204 0
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27093%27 HTTP/1.1" 200 None
2026-03-29 18:41:38 [auto1.de] INFO: Scrape type for PJ27093: 0
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM49388%27 HTTP/1.1" 200 None
2026-03-29 18:41:38 [auto1.de] INFO: Scrape type for FM49388: 0
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA76775%27 HTTP/1.1" 200 None
2026-03-29 18:41:38 [auto1.de] INFO: Scrape type for DA76775: 0
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT48359%27 HTTP/1.1" 200 None
2026-03-29 18:41:39 [auto1.de] INFO: Scrape type for HT48359: 2
2026-03-29 18:41:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67321d13-024e-5a3f-b165-2e95b5d92cd0 with identifier: HT48359
2026-03-29 18:41:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67321d13-024e-5a3f-b165-2e95b5d92cd0 with scrape type 2
2026-03-29 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67321d13-024e-5a3f-b165-2e95b5d92cd0 with scrape type 2
2026-03-29 18:41:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67321d13-024e-5a3f-b165-2e95b5d92cd0, identifier: HT48359
2026-03-29 18:41:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67321d13-024e-5a3f-b165-2e95b5d92cd0 with identifier: HT48359
2026-03-29 18:41:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67321d13-024e-5a3f-b165-2e95b5d92cd0 with identifier: HT48359
2026-03-29 18:41:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67321d13-024e-5a3f-b165-2e95b5d92cd0 with identifier: HT48359 to the API
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:03:41Z',
'fuel_type': 'petrol',
'id': '67321d13-024e-5a3f-b165-2e95b5d92cd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT48359',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 12161,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-06-30',
'seller_name': None,
'title': 'Audi A1 Sportback 30 TFSI Advanced',
'transmission': 'automatic',
'trim': 'Advanced',
'year': 2024}
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT48359%27 HTTP/1.1" 200 None
2026-03-29 18:41:39 [auto1.de] INFO: Saving data for HT48359: {'auction_closing_time': 1774883021.0, 'created_time': 1773302749.523, 'last_price_update_time': 1774809699.446394}
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT48359') HTTP/1.1" 204 0
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET45765%27 HTTP/1.1" 200 None
2026-03-29 18:41:39 [auto1.de] INFO: Scrape type for ET45765: 0
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ86023%27 HTTP/1.1" 200 None
2026-03-29 18:41:39 [auto1.de] INFO: Scrape type for RZ86023: 2
2026-03-29 18:41:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3aa066d-4166-54bc-8173-c7c4b71ccf2f with identifier: RZ86023
2026-03-29 18:41:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3aa066d-4166-54bc-8173-c7c4b71ccf2f with scrape type 2
2026-03-29 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3aa066d-4166-54bc-8173-c7c4b71ccf2f with scrape type 2
2026-03-29 18:41:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3aa066d-4166-54bc-8173-c7c4b71ccf2f, identifier: RZ86023
2026-03-29 18:41:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3aa066d-4166-54bc-8173-c7c4b71ccf2f with identifier: RZ86023
2026-03-29 18:41:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3aa066d-4166-54bc-8173-c7c4b71ccf2f with identifier: RZ86023
2026-03-29 18:41:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3aa066d-4166-54bc-8173-c7c4b71ccf2f with identifier: RZ86023 to the API
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:05:53Z',
'fuel_type': 'petrol',
'id': 'd3aa066d-4166-54bc-8173-c7c4b71ccf2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ86023',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 152454,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-14',
'seller_name': None,
'title': 'Skoda Fabia 1.4 Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2009}
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ86023%27 HTTP/1.1" 200 None
2026-03-29 18:41:40 [auto1.de] INFO: Saving data for RZ86023: {'auction_closing_time': 1774883153.0, 'created_time': 1774291993.583421, 'last_price_update_time': 1774809700.006139}
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ86023') HTTP/1.1" 204 0
2026-03-29 18:41:40 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-29 18:41:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:40 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:40 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-29 18:41:40 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80532%27 HTTP/1.1" 200 None
2026-03-29 18:41:40 [auto1.de] INFO: Scrape type for RX80532: 0
2026-03-29 18:41:40 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-29 18:41:40 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-29 18:41:40 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-29 18:41:40 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB35470%27 HTTP/1.1" 200 None
2026-03-29 18:41:41 [auto1.de] INFO: Scrape type for SB35470: 2
2026-03-29 18:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c257a53-690d-5983-be70-3bb3206b465b with identifier: SB35470
2026-03-29 18:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c257a53-690d-5983-be70-3bb3206b465b with scrape type 2
2026-03-29 18:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c257a53-690d-5983-be70-3bb3206b465b with scrape type 2
2026-03-29 18:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c257a53-690d-5983-be70-3bb3206b465b, identifier: SB35470
2026-03-29 18:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c257a53-690d-5983-be70-3bb3206b465b with identifier: SB35470
2026-03-29 18:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c257a53-690d-5983-be70-3bb3206b465b with identifier: SB35470
2026-03-29 18:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c257a53-690d-5983-be70-3bb3206b465b with identifier: SB35470 to the API
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:03:32Z',
'fuel_type': 'diesel',
'id': '4c257a53-690d-5983-be70-3bb3206b465b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB35470',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 48965,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-17',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 300 d 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2020}
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB35470%27 HTTP/1.1" 200 None
2026-03-29 18:41:41 [auto1.de] INFO: Saving data for SB35470: {'auction_closing_time': 1774883012.0, 'created_time': 1772547044.289282, 'last_price_update_time': 1774809701.432039}
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB35470') HTTP/1.1" 204 0
2026-03-29 18:41:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:41 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF21072%27 HTTP/1.1" 200 None
2026-03-29 18:41:41 [auto1.de] INFO: Scrape type for UF21072: 2
2026-03-29 18:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64ed201d-2143-55a2-99e3-33ebd4607baa with identifier: UF21072
2026-03-29 18:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64ed201d-2143-55a2-99e3-33ebd4607baa with scrape type 2
2026-03-29 18:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64ed201d-2143-55a2-99e3-33ebd4607baa with scrape type 2
2026-03-29 18:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64ed201d-2143-55a2-99e3-33ebd4607baa, identifier: UF21072
2026-03-29 18:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64ed201d-2143-55a2-99e3-33ebd4607baa with identifier: UF21072
2026-03-29 18:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64ed201d-2143-55a2-99e3-33ebd4607baa with identifier: UF21072
2026-03-29 18:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64ed201d-2143-55a2-99e3-33ebd4607baa with identifier: UF21072 to the API
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:44:23Z',
'fuel_type': 'petrol',
'id': '64ed201d-2143-55a2-99e3-33ebd4607baa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF21072',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 85362,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-05',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2018}
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF21072%27 HTTP/1.1" 200 None
2026-03-29 18:41:41 [auto1.de] INFO: Saving data for UF21072: {'auction_closing_time': 1774885463.0, 'created_time': 1773307809.842107, 'last_price_update_time': 1774809701.998629}
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF21072') HTTP/1.1" 204 0
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS48010%27 HTTP/1.1" 200 None
2026-03-29 18:41:42 [auto1.de] INFO: Scrape type for XS48010: 0
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09657%27 HTTP/1.1" 200 None
2026-03-29 18:41:42 [auto1.de] INFO: Scrape type for YD09657: 2
2026-03-29 18:41:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9bc550b-3356-58e5-9670-73a40cd2f56b with identifier: YD09657
2026-03-29 18:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9bc550b-3356-58e5-9670-73a40cd2f56b with scrape type 2
2026-03-29 18:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9bc550b-3356-58e5-9670-73a40cd2f56b with scrape type 2
2026-03-29 18:41:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9bc550b-3356-58e5-9670-73a40cd2f56b, identifier: YD09657
2026-03-29 18:41:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9bc550b-3356-58e5-9670-73a40cd2f56b with identifier: YD09657
2026-03-29 18:41:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9bc550b-3356-58e5-9670-73a40cd2f56b with identifier: YD09657
2026-03-29 18:41:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9bc550b-3356-58e5-9670-73a40cd2f56b with identifier: YD09657 to the API
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:11:19Z',
'fuel_type': 'diesel',
'id': 'f9bc550b-3356-58e5-9670-73a40cd2f56b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD09657',
'listing': 'auction',
'make': 'Audi',
'model': 'A3',
'odometer': 164379,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-19',
'seller_name': None,
'title': 'Audi A3 2.0 TDI S line Sportpaket plus',
'transmission': 'manual',
'trim': 'S line Sportpaket plus',
'year': 2010}
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09657%27 HTTP/1.1" 200 None
2026-03-29 18:41:42 [auto1.de] INFO: Saving data for YD09657: {'auction_closing_time': 1774883479.0, 'created_time': 1774290713.92599, 'last_price_update_time': 1774809702.511332}
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD09657') HTTP/1.1" 204 0
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06043%27 HTTP/1.1" 200 None
2026-03-29 18:41:42 [auto1.de] INFO: Scrape type for VN06043: 2
2026-03-29 18:41:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with identifier: VN06043
2026-03-29 18:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with scrape type 2
2026-03-29 18:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with scrape type 2
2026-03-29 18:41:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d, identifier: VN06043
2026-03-29 18:41:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with identifier: VN06043
2026-03-29 18:41:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with identifier: VN06043
2026-03-29 18:41:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with identifier: VN06043 to the API
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 286,
'expiration_date': '2026-03-30T15:06:03Z',
'fuel_type': 'diesel',
'id': '7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN06043',
'listing': 'auction',
'make': 'Audi',
'model': 'Q7',
'odometer': 63125,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-16',
'seller_name': None,
'title': 'Audi Q7 50 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2021}
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06043%27 HTTP/1.1" 200 None
2026-03-29 18:41:43 [auto1.de] INFO: Saving data for VN06043: {'auction_closing_time': 1774883163.0, 'created_time': 1773136038.289438, 'last_price_update_time': 1774809703.900921}
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN06043') HTTP/1.1" 204 0
2026-03-29 18:41:43 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD74109%27 HTTP/1.1" 200 None
2026-03-29 18:41:43 [auto1.de] INFO: Scrape type for FD74109: 0
2026-03-29 18:41:43 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98998%27 HTTP/1.1" 200 None
2026-03-29 18:41:43 [auto1.de] INFO: Scrape type for CC98998: 0
2026-03-29 18:41:43 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-29 18:41:43 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-29 18:41:43 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-29 18:41:43 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89149%27 HTTP/1.1" 200 None
2026-03-29 18:41:43 [auto1.de] INFO: Scrape type for TK89149: 0
2026-03-29 18:41:43 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK50877%27 HTTP/1.1" 200 None
2026-03-29 18:41:43 [auto1.de] INFO: Scrape type for XK50877: 0
2026-03-29 18:41:43 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA61960%27 HTTP/1.1" 200 None
2026-03-29 18:41:43 [auto1.de] INFO: Scrape type for TA61960: 2
2026-03-29 18:41:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9c68c09-7a77-5e6d-816e-fc12e1ade24e with identifier: TA61960
2026-03-29 18:41:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9c68c09-7a77-5e6d-816e-fc12e1ade24e with scrape type 2
2026-03-29 18:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9c68c09-7a77-5e6d-816e-fc12e1ade24e with scrape type 2
2026-03-29 18:41:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9c68c09-7a77-5e6d-816e-fc12e1ade24e, identifier: TA61960
2026-03-29 18:41:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9c68c09-7a77-5e6d-816e-fc12e1ade24e with identifier: TA61960
2026-03-29 18:41:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9c68c09-7a77-5e6d-816e-fc12e1ade24e with identifier: TA61960
2026-03-29 18:41:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9c68c09-7a77-5e6d-816e-fc12e1ade24e with identifier: TA61960 to the API
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:04:26Z',
'fuel_type': 'diesel',
'id': 'e9c68c09-7a77-5e6d-816e-fc12e1ade24e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA61960',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 183568,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-01',
'seller_name': None,
'title': 'Audi A4 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2017}
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA61960%27 HTTP/1.1" 200 None
2026-03-29 18:41:44 [auto1.de] INFO: Saving data for TA61960: {'auction_closing_time': 1774883066.0, 'created_time': 1774522032.366457, 'last_price_update_time': 1774809704.393493}
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA61960') HTTP/1.1" 204 0
2026-03-29 18:41:44 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-29 18:41:44 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV41920%27 HTTP/1.1" 200 None
2026-03-29 18:41:44 [auto1.de] INFO: Scrape type for FV41920: 2
2026-03-29 18:41:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ced39d6-2b53-5571-830a-fae337852c3f with identifier: FV41920
2026-03-29 18:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ced39d6-2b53-5571-830a-fae337852c3f with scrape type 2
2026-03-29 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ced39d6-2b53-5571-830a-fae337852c3f with scrape type 2
2026-03-29 18:41:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ced39d6-2b53-5571-830a-fae337852c3f, identifier: FV41920
2026-03-29 18:41:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ced39d6-2b53-5571-830a-fae337852c3f with identifier: FV41920
2026-03-29 18:41:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ced39d6-2b53-5571-830a-fae337852c3f with identifier: FV41920
2026-03-29 18:41:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ced39d6-2b53-5571-830a-fae337852c3f with identifier: FV41920 to the API
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 310,
'expiration_date': '2026-03-30T15:59:59Z',
'fuel_type': 'petrol',
'id': '1ced39d6-2b53-5571-830a-fae337852c3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV41920',
'listing': 'auction',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 14638,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-04',
'seller_name': None,
'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
'transmission': 'automatic',
'trim': 'VZ 4Drive',
'year': 2024}
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV41920%27 HTTP/1.1" 200 None
2026-03-29 18:41:44 [auto1.de] INFO: Saving data for FV41920: {'auction_closing_time': 1774886399.0, 'created_time': 1774293426.868566, 'last_price_update_time': 1774809704.939019}
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV41920') HTTP/1.1" 204 0
2026-03-29 18:41:44 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-29 18:41:44 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH51780%27 HTTP/1.1" 200 None
2026-03-29 18:41:44 [auto1.de] INFO: Scrape type for LH51780: 2
2026-03-29 18:41:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with identifier: LH51780
2026-03-29 18:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with scrape type 2
2026-03-29 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with scrape type 2
2026-03-29 18:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32a8b10d-fbc0-59e5-8207-1759ab8fc68f, identifier: LH51780
2026-03-29 18:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with identifier: LH51780
2026-03-29 18:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with identifier: LH51780
2026-03-29 18:41:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with identifier: LH51780 to the API
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:47:32Z',
'fuel_type': 'petrol',
'id': '32a8b10d-fbc0-59e5-8207-1759ab8fc68f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH51780',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 27165,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-26',
'seller_name': None,
'title': 'Audi A6 45 TFSI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH51780%27 HTTP/1.1" 200 None
2026-03-29 18:41:45 [auto1.de] INFO: Saving data for LH51780: {'auction_closing_time': 1774885652.0, 'created_time': 1773773688.207965, 'last_price_update_time': 1774809705.374134}
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH51780') HTTP/1.1" 204 0
2026-03-29 18:41:45 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX47002%27 HTTP/1.1" 200 None
2026-03-29 18:41:45 [auto1.de] INFO: Scrape type for UX47002: 0
2026-03-29 18:41:45 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP96351%27 HTTP/1.1" 200 None
2026-03-29 18:41:45 [auto1.de] INFO: Scrape type for XP96351: 2
2026-03-29 18:41:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9cf80c6-a632-5a26-a895-34b7bdf4fbab with identifier: XP96351
2026-03-29 18:41:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9cf80c6-a632-5a26-a895-34b7bdf4fbab with scrape type 2
2026-03-29 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9cf80c6-a632-5a26-a895-34b7bdf4fbab with scrape type 2
2026-03-29 18:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9cf80c6-a632-5a26-a895-34b7bdf4fbab, identifier: XP96351
2026-03-29 18:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9cf80c6-a632-5a26-a895-34b7bdf4fbab with identifier: XP96351
2026-03-29 18:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9cf80c6-a632-5a26-a895-34b7bdf4fbab with identifier: XP96351
2026-03-29 18:41:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9cf80c6-a632-5a26-a895-34b7bdf4fbab with identifier: XP96351 to the API
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:07:14Z',
'fuel_type': 'diesel',
'id': 'f9cf80c6-a632-5a26-a895-34b7bdf4fbab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP96351',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 44045,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-03',
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Momentum Pro 2WD',
'transmission': 'automatic',
'trim': 'Momentum Pro 2WD',
'year': 2020}
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP96351%27 HTTP/1.1" 200 None
2026-03-29 18:41:45 [auto1.de] INFO: Saving data for XP96351: {'auction_closing_time': 1774883234.0, 'created_time': 1773305084.289303, 'last_price_update_time': 1774809705.869339}
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP96351') HTTP/1.1" 204 0
2026-03-29 18:41:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:45 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-29 18:41:45 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM66386%27 HTTP/1.1" 200 None
2026-03-29 18:41:45 [auto1.de] INFO: Scrape type for TM66386: 2
2026-03-29 18:41:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7da4cd20-cd91-5649-8777-b14c8f2ea840 with identifier: TM66386
2026-03-29 18:41:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7da4cd20-cd91-5649-8777-b14c8f2ea840 with scrape type 2
2026-03-29 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7da4cd20-cd91-5649-8777-b14c8f2ea840 with scrape type 2
2026-03-29 18:41:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7da4cd20-cd91-5649-8777-b14c8f2ea840, identifier: TM66386
2026-03-29 18:41:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7da4cd20-cd91-5649-8777-b14c8f2ea840 with identifier: TM66386
2026-03-29 18:41:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7da4cd20-cd91-5649-8777-b14c8f2ea840 with identifier: TM66386
2026-03-29 18:41:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7da4cd20-cd91-5649-8777-b14c8f2ea840 with identifier: TM66386 to the API
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:29:25Z',
'fuel_type': 'diesel',
'id': '7da4cd20-cd91-5649-8777-b14c8f2ea840',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM66386',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 119550,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-06',
'seller_name': None,
'title': 'BMW X3 xDrive 30d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2017}
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM66386%27 HTTP/1.1" 200 None
2026-03-29 18:41:46 [auto1.de] INFO: Saving data for TM66386: {'auction_closing_time': 1774884565.0, 'created_time': 1774349825.70511, 'last_price_update_time': 1774809706.345613}
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM66386') HTTP/1.1" 204 0
2026-03-29 18:41:46 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92547%27 HTTP/1.1" 200 None
2026-03-29 18:41:46 [auto1.de] INFO: Scrape type for MV92547: 2
2026-03-29 18:41:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with identifier: MV92547
2026-03-29 18:41:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with scrape type 2
2026-03-29 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with scrape type 2
2026-03-29 18:41:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd45a1c7-0a05-58f7-af6a-c15e3d223f7f, identifier: MV92547
2026-03-29 18:41:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with identifier: MV92547
2026-03-29 18:41:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with identifier: MV92547
2026-03-29 18:41:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with identifier: MV92547 to the API
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:50:00Z',
'fuel_type': 'petrol',
'id': 'dd45a1c7-0a05-58f7-af6a-c15e3d223f7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV92547',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 108582,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-09',
'seller_name': None,
'title': 'Toyota Aygo 1.0 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2011}
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92547%27 HTTP/1.1" 200 None
2026-03-29 18:41:46 [auto1.de] INFO: Saving data for MV92547: {'auction_closing_time': 1774885800.0, 'created_time': 1773304589.394061, 'last_price_update_time': 1774809706.835023}
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV92547') HTTP/1.1" 204 0
2026-03-29 18:41:46 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:46 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-29 18:41:46 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL10604%27 HTTP/1.1" 200 None
2026-03-29 18:41:46 [auto1.de] INFO: Scrape type for WL10604: 0
2026-03-29 18:41:46 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-29 18:41:46 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU77482%27 HTTP/1.1" 200 None
2026-03-29 18:41:46 [auto1.de] INFO: Scrape type for JU77482: 2
2026-03-29 18:41:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e161abf6-cd02-5201-91ff-e46bf75b50fc with identifier: JU77482
2026-03-29 18:41:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e161abf6-cd02-5201-91ff-e46bf75b50fc with scrape type 2
2026-03-29 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e161abf6-cd02-5201-91ff-e46bf75b50fc with scrape type 2
2026-03-29 18:41:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e161abf6-cd02-5201-91ff-e46bf75b50fc, identifier: JU77482
2026-03-29 18:41:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e161abf6-cd02-5201-91ff-e46bf75b50fc with identifier: JU77482
2026-03-29 18:41:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e161abf6-cd02-5201-91ff-e46bf75b50fc with identifier: JU77482
2026-03-29 18:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e161abf6-cd02-5201-91ff-e46bf75b50fc with identifier: JU77482 to the API
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:54:49Z',
'fuel_type': 'diesel',
'id': 'e161abf6-cd02-5201-91ff-e46bf75b50fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU77482',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 159669,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-22',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
'transmission': 'automatic',
'trim': 'Allure Pack',
'year': 2022}
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU77482%27 HTTP/1.1" 200 None
2026-03-29 18:41:47 [auto1.de] INFO: Saving data for JU77482: {'auction_closing_time': 1774886089.0, 'created_time': 1773426768.002692, 'last_price_update_time': 1774809707.292834}
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU77482') HTTP/1.1" 204 0
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP44977%27 HTTP/1.1" 200 None
2026-03-29 18:41:47 [auto1.de] INFO: Scrape type for MP44977: 2
2026-03-29 18:41:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d9a6843-52b1-5b0e-bfaa-5d48c6442ece with identifier: MP44977
2026-03-29 18:41:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d9a6843-52b1-5b0e-bfaa-5d48c6442ece with scrape type 2
2026-03-29 18:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d9a6843-52b1-5b0e-bfaa-5d48c6442ece with scrape type 2
2026-03-29 18:41:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d9a6843-52b1-5b0e-bfaa-5d48c6442ece, identifier: MP44977
2026-03-29 18:41:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP37345%27 HTTP/1.1" 200 None
2026-03-29 18:41:47 [auto1.de] INFO: Scrape type for YP37345: 2
2026-03-29 18:41:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e5d84cc-3980-51be-8873-f9077341de52 with identifier: YP37345
2026-03-29 18:41:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e5d84cc-3980-51be-8873-f9077341de52 with scrape type 2
2026-03-29 18:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e5d84cc-3980-51be-8873-f9077341de52 with scrape type 2
2026-03-29 18:41:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e5d84cc-3980-51be-8873-f9077341de52, identifier: YP37345
2026-03-29 18:41:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d9a6843-52b1-5b0e-bfaa-5d48c6442ece with identifier: MP44977
2026-03-29 18:41:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d9a6843-52b1-5b0e-bfaa-5d48c6442ece with identifier: MP44977
2026-03-29 18:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d9a6843-52b1-5b0e-bfaa-5d48c6442ece with identifier: MP44977 to the API
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:47:43Z',
'fuel_type': 'diesel',
'id': '1d9a6843-52b1-5b0e-bfaa-5d48c6442ece',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP44977',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 73553,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-08',
'seller_name': None,
'title': 'Audi Q3 Sportback 40 TDI quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2020}
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP44977%27 HTTP/1.1" 200 None
2026-03-29 18:41:47 [auto1.de] INFO: Saving data for MP44977: {'auction_closing_time': 1774885663.0, 'created_time': 1774117859.982382, 'last_price_update_time': 1774809707.946857}
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP44977') HTTP/1.1" 204 0
2026-03-29 18:41:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e5d84cc-3980-51be-8873-f9077341de52 with identifier: YP37345
2026-03-29 18:41:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e5d84cc-3980-51be-8873-f9077341de52 with identifier: YP37345
2026-03-29 18:41:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e5d84cc-3980-51be-8873-f9077341de52 with identifier: YP37345 to the API
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:15:38Z',
'fuel_type': 'petrol',
'id': '0e5d84cc-3980-51be-8873-f9077341de52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP37345',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 175874,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-02',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2013}
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP37345%27 HTTP/1.1" 200 None
2026-03-29 18:41:48 [auto1.de] INFO: Saving data for YP37345: {'auction_closing_time': 1774883738.0, 'created_time': 1774607790.957486, 'last_price_update_time': 1774809708.307602}
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP37345') HTTP/1.1" 204 0
2026-03-29 18:41:48 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-29 18:41:48 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR33954%27 HTTP/1.1" 200 None
2026-03-29 18:41:48 [auto1.de] INFO: Scrape type for AR33954: 2
2026-03-29 18:41:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ad8abe-1545-55e5-b297-bf0e512a54f4 with identifier: AR33954
2026-03-29 18:41:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ad8abe-1545-55e5-b297-bf0e512a54f4 with scrape type 2
2026-03-29 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08ad8abe-1545-55e5-b297-bf0e512a54f4 with scrape type 2
2026-03-29 18:41:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08ad8abe-1545-55e5-b297-bf0e512a54f4, identifier: AR33954
2026-03-29 18:41:48 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP93259%27 HTTP/1.1" 200 None
2026-03-29 18:41:48 [auto1.de] INFO: Scrape type for YP93259: 0
2026-03-29 18:41:48 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-29 18:41:48 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX47030%27 HTTP/1.1" 200 None
2026-03-29 18:41:48 [auto1.de] INFO: Scrape type for PX47030: 0
2026-03-29 18:41:48 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW72669%27 HTTP/1.1" 200 None
2026-03-29 18:41:48 [auto1.de] INFO: Scrape type for KW72669: 0
2026-03-29 18:41:48 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ10404%27 HTTP/1.1" 200 None
2026-03-29 18:41:48 [auto1.de] INFO: Scrape type for SZ10404: 2
2026-03-29 18:41:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600 with identifier: SZ10404
2026-03-29 18:41:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600 with scrape type 2
2026-03-29 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600 with scrape type 2
2026-03-29 18:41:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600, identifier: SZ10404
2026-03-29 18:41:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08ad8abe-1545-55e5-b297-bf0e512a54f4 with identifier: AR33954
2026-03-29 18:41:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08ad8abe-1545-55e5-b297-bf0e512a54f4 with identifier: AR33954
2026-03-29 18:41:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08ad8abe-1545-55e5-b297-bf0e512a54f4 with identifier: AR33954 to the API
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:57:32Z',
'fuel_type': 'diesel',
'id': '08ad8abe-1545-55e5-b297-bf0e512a54f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR33954',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 84126,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-11',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Sportline 4x4',
'transmission': 'automatic',
'trim': 'Sportline 4x4',
'year': 2020}
2026-03-29 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR33954%27 HTTP/1.1" 200 None
2026-03-29 18:41:50 [auto1.de] INFO: Saving data for AR33954: {'auction_closing_time': 1774886252.0, 'created_time': 1773945914.401284, 'last_price_update_time': 1774809710.88842}
2026-03-29 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR33954') HTTP/1.1" 204 0
2026-03-29 18:41:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600 with identifier: SZ10404
2026-03-29 18:41:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600 with identifier: SZ10404
2026-03-29 18:41:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600 with identifier: SZ10404 to the API
2026-03-29 18:41:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:11:24Z',
'fuel_type': 'diesel',
'id': '5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ10404',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-02-11',
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 320 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2003}
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ10404%27 HTTP/1.1" 200 None
2026-03-29 18:41:51 [auto1.de] INFO: Saving data for SZ10404: {'auction_closing_time': 1774883484.0, 'created_time': 1774032228.871473, 'last_price_update_time': 1774809711.179177}
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ10404') HTTP/1.1" 204 0
2026-03-29 18:41:51 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-29 18:41:51 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE68759%27 HTTP/1.1" 200 None
2026-03-29 18:41:51 [auto1.de] INFO: Scrape type for CE68759: 2
2026-03-29 18:41:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with identifier: CE68759
2026-03-29 18:41:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with scrape type 2
2026-03-29 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with scrape type 2
2026-03-29 18:41:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726, identifier: CE68759
2026-03-29 18:41:51 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-29 18:41:51 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-29 18:41:51 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-29 18:41:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with identifier: CE68759
2026-03-29 18:41:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with identifier: CE68759
2026-03-29 18:41:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with identifier: CE68759 to the API
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:49:12Z',
'fuel_type': 'diesel',
'id': '96cf5e01-aa9b-58b6-9c21-0f3e50dd5726',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE68759',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i40',
'odometer': 127384,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-12',
'seller_name': None,
'title': 'Hyundai i40 1.7 CRDi Premium Blue',
'transmission': 'manual',
'trim': 'Premium Blue',
'year': 2015}
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE68759%27 HTTP/1.1" 200 None
2026-03-29 18:41:51 [auto1.de] INFO: Saving data for CE68759: {'auction_closing_time': 1774885752.0, 'created_time': 1773138249.071629, 'last_price_update_time': 1774809711.688089}
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE68759') HTTP/1.1" 204 0
2026-03-29 18:41:51 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-29 18:41:51 [auto1.de] INFO: Found listing with ID: NC07171
2026-03-29 18:41:51 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26108%27 HTTP/1.1" 200 None
2026-03-29 18:41:51 [auto1.de] INFO: Scrape type for AW26108: 2
2026-03-29 18:41:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 398bde9e-315c-56fc-a56d-680a0aa4e7fa with identifier: AW26108
2026-03-29 18:41:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 398bde9e-315c-56fc-a56d-680a0aa4e7fa with scrape type 2
2026-03-29 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 398bde9e-315c-56fc-a56d-680a0aa4e7fa with scrape type 2
2026-03-29 18:41:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 398bde9e-315c-56fc-a56d-680a0aa4e7fa, identifier: AW26108
2026-03-29 18:41:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 398bde9e-315c-56fc-a56d-680a0aa4e7fa with identifier: AW26108
2026-03-29 18:41:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 398bde9e-315c-56fc-a56d-680a0aa4e7fa with identifier: AW26108
2026-03-29 18:41:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 398bde9e-315c-56fc-a56d-680a0aa4e7fa with identifier: AW26108 to the API
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:58:14Z',
'fuel_type': 'diesel',
'id': '398bde9e-315c-56fc-a56d-680a0aa4e7fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW26108',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 147562,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-20',
'seller_name': None,
'title': 'BMW X3 xDrive 30d Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2016}
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26108%27 HTTP/1.1" 200 None
2026-03-29 18:41:52 [auto1.de] INFO: Saving data for AW26108: {'auction_closing_time': 1774886294.0, 'created_time': 1774089332.653136, 'last_price_update_time': 1774809712.215214}
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW26108') HTTP/1.1" 204 0
2026-03-29 18:41:52 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70879%27 HTTP/1.1" 200 None
2026-03-29 18:41:52 [auto1.de] INFO: Scrape type for EE70879: 0
2026-03-29 18:41:52 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-29 18:41:52 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-29 18:41:52 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ68235%27 HTTP/1.1" 200 None
2026-03-29 18:41:52 [auto1.de] INFO: Scrape type for LJ68235: 2
2026-03-29 18:41:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dfb657e-0ca6-5583-b866-b467b729d7ca with identifier: LJ68235
2026-03-29 18:41:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dfb657e-0ca6-5583-b866-b467b729d7ca with scrape type 2
2026-03-29 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dfb657e-0ca6-5583-b866-b467b729d7ca with scrape type 2
2026-03-29 18:41:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dfb657e-0ca6-5583-b866-b467b729d7ca, identifier: LJ68235
2026-03-29 18:41:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dfb657e-0ca6-5583-b866-b467b729d7ca with identifier: LJ68235
2026-03-29 18:41:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dfb657e-0ca6-5583-b866-b467b729d7ca with identifier: LJ68235
2026-03-29 18:41:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dfb657e-0ca6-5583-b866-b467b729d7ca with identifier: LJ68235 to the API
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:38:44Z',
'fuel_type': 'diesel',
'id': '6dfb657e-0ca6-5583-b866-b467b729d7ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ68235',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 108505,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-25',
'seller_name': None,
'title': 'Peugeot 208 1.4 HDi Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2014}
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ68235%27 HTTP/1.1" 200 None
2026-03-29 18:41:52 [auto1.de] INFO: Saving data for LJ68235: {'auction_closing_time': 1774885124.0, 'created_time': 1774522008.677466, 'last_price_update_time': 1774809712.649612}
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ68235') HTTP/1.1" 204 0
2026-03-29 18:41:52 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-29 18:41:52 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC74122%27 HTTP/1.1" 200 None
2026-03-29 18:41:52 [auto1.de] INFO: Scrape type for EC74122: 2
2026-03-29 18:41:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f7f938c-6705-56f6-8369-1a2c88126fb1 with identifier: EC74122
2026-03-29 18:41:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f7f938c-6705-56f6-8369-1a2c88126fb1 with scrape type 2
2026-03-29 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f7f938c-6705-56f6-8369-1a2c88126fb1 with scrape type 2
2026-03-29 18:41:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f7f938c-6705-56f6-8369-1a2c88126fb1, identifier: EC74122
2026-03-29 18:41:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f7f938c-6705-56f6-8369-1a2c88126fb1 with identifier: EC74122
2026-03-29 18:41:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f7f938c-6705-56f6-8369-1a2c88126fb1 with identifier: EC74122
2026-03-29 18:41:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f7f938c-6705-56f6-8369-1a2c88126fb1 with identifier: EC74122 to the API
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:16:11Z',
'fuel_type': 'diesel',
'id': '4f7f938c-6705-56f6-8369-1a2c88126fb1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC74122',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 200627,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-23',
'seller_name': None,
'title': 'BMW 1er 120d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC74122%27 HTTP/1.1" 200 None
2026-03-29 18:41:53 [auto1.de] INFO: Saving data for EC74122: {'auction_closing_time': 1774883771.0, 'created_time': 1773775452.361819, 'last_price_update_time': 1774809713.201585}
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC74122') HTTP/1.1" 204 0
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ12041%27 HTTP/1.1" 200 None
2026-03-29 18:41:53 [auto1.de] INFO: Scrape type for EJ12041: 0
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM50806%27 HTTP/1.1" 200 None
2026-03-29 18:41:53 [auto1.de] INFO: Scrape type for WM50806: 2
2026-03-29 18:41:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f834236-0c7f-557c-9693-c1c9802a73b0 with identifier: WM50806
2026-03-29 18:41:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f834236-0c7f-557c-9693-c1c9802a73b0 with scrape type 2
2026-03-29 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f834236-0c7f-557c-9693-c1c9802a73b0 with scrape type 2
2026-03-29 18:41:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f834236-0c7f-557c-9693-c1c9802a73b0, identifier: WM50806
2026-03-29 18:41:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f834236-0c7f-557c-9693-c1c9802a73b0 with identifier: WM50806
2026-03-29 18:41:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f834236-0c7f-557c-9693-c1c9802a73b0 with identifier: WM50806
2026-03-29 18:41:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f834236-0c7f-557c-9693-c1c9802a73b0 with identifier: WM50806 to the API
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:59:35Z',
'fuel_type': 'petrol',
'id': '7f834236-0c7f-557c-9693-c1c9802a73b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM50806',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 189207,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-27',
'seller_name': None,
'title': 'MINI Countryman Cooper',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM50806%27 HTTP/1.1" 200 None
2026-03-29 18:41:53 [auto1.de] INFO: Saving data for WM50806: {'auction_closing_time': 1774886375.0, 'created_time': 1774607644.782619, 'last_price_update_time': 1774809713.71995}
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM50806') HTTP/1.1" 204 0
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV19329%27 HTTP/1.1" 200 None
2026-03-29 18:41:53 [auto1.de] INFO: Scrape type for WV19329: 2
2026-03-29 18:41:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd6390db-6343-5203-b9ae-707968dc0ea0 with identifier: WV19329
2026-03-29 18:41:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd6390db-6343-5203-b9ae-707968dc0ea0 with scrape type 2
2026-03-29 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd6390db-6343-5203-b9ae-707968dc0ea0 with scrape type 2
2026-03-29 18:41:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd6390db-6343-5203-b9ae-707968dc0ea0, identifier: WV19329
2026-03-29 18:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd6390db-6343-5203-b9ae-707968dc0ea0 with identifier: WV19329
2026-03-29 18:41:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd6390db-6343-5203-b9ae-707968dc0ea0 with identifier: WV19329
2026-03-29 18:41:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd6390db-6343-5203-b9ae-707968dc0ea0 with identifier: WV19329 to the API
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 195,
'expiration_date': '2026-03-30T15:13:21Z',
'fuel_type': 'diesel',
'id': 'bd6390db-6343-5203-b9ae-707968dc0ea0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV19329',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 351077,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-27',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2017}
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV19329%27 HTTP/1.1" 200 None
2026-03-29 18:41:54 [auto1.de] INFO: Saving data for WV19329: {'auction_closing_time': 1774883601.0, 'created_time': 1773303613.39509, 'last_price_update_time': 1774809714.265667}
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV19329') HTTP/1.1" 204 0
2026-03-29 18:41:54 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24569%27 HTTP/1.1" 200 None
2026-03-29 18:41:54 [auto1.de] INFO: Scrape type for KX24569: 0
2026-03-29 18:41:54 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83154%27 HTTP/1.1" 200 None
2026-03-29 18:41:54 [auto1.de] INFO: Scrape type for KA83154: 0
2026-03-29 18:41:54 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66334%27 HTTP/1.1" 200 None
2026-03-29 18:41:54 [auto1.de] INFO: Scrape type for VR66334: 0
2026-03-29 18:41:54 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55400%27 HTTP/1.1" 200 None
2026-03-29 18:41:54 [auto1.de] INFO: Scrape type for WW55400: 0
2026-03-29 18:41:54 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-29 18:41:54 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86141%27 HTTP/1.1" 200 None
2026-03-29 18:41:54 [auto1.de] INFO: Scrape type for JB86141: 2
2026-03-29 18:41:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5c1fd9e-d176-56bd-ad90-46043809d1e1 with identifier: JB86141
2026-03-29 18:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5c1fd9e-d176-56bd-ad90-46043809d1e1 with scrape type 2
2026-03-29 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5c1fd9e-d176-56bd-ad90-46043809d1e1 with scrape type 2
2026-03-29 18:41:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5c1fd9e-d176-56bd-ad90-46043809d1e1, identifier: JB86141
2026-03-29 18:41:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5c1fd9e-d176-56bd-ad90-46043809d1e1 with identifier: JB86141
2026-03-29 18:41:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5c1fd9e-d176-56bd-ad90-46043809d1e1 with identifier: JB86141
2026-03-29 18:41:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5c1fd9e-d176-56bd-ad90-46043809d1e1 with identifier: JB86141 to the API
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:43:38Z',
'fuel_type': 'diesel',
'id': 'd5c1fd9e-d176-56bd-ad90-46043809d1e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB86141',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 252922,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-06',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2016}
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86141%27 HTTP/1.1" 200 None
2026-03-29 18:41:54 [auto1.de] INFO: Saving data for JB86141: {'auction_closing_time': 1774885418.0, 'created_time': 1773303080.55393, 'last_price_update_time': 1774809714.840878}
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB86141') HTTP/1.1" 204 0
2026-03-29 18:41:54 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU38402%27 HTTP/1.1" 200 None
2026-03-29 18:41:54 [auto1.de] INFO: Scrape type for EU38402: 2
2026-03-29 18:41:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 367e5e3f-8025-59cc-b512-cd2739e303b1 with identifier: EU38402
2026-03-29 18:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 367e5e3f-8025-59cc-b512-cd2739e303b1 with scrape type 2
2026-03-29 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 367e5e3f-8025-59cc-b512-cd2739e303b1 with scrape type 2
2026-03-29 18:41:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 367e5e3f-8025-59cc-b512-cd2739e303b1, identifier: EU38402
2026-03-29 18:41:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 367e5e3f-8025-59cc-b512-cd2739e303b1 with identifier: EU38402
2026-03-29 18:41:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 367e5e3f-8025-59cc-b512-cd2739e303b1 with identifier: EU38402
2026-03-29 18:41:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 367e5e3f-8025-59cc-b512-cd2739e303b1 with identifier: EU38402 to the API
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:00:42Z',
'fuel_type': 'petrol',
'id': '367e5e3f-8025-59cc-b512-cd2739e303b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU38402',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 64386,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-21',
'seller_name': None,
'title': 'Renault Megane 1.2 Paris',
'transmission': 'manual',
'trim': 'Paris',
'year': 2014}
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU38402%27 HTTP/1.1" 200 None
2026-03-29 18:41:55 [auto1.de] INFO: Saving data for EU38402: {'auction_closing_time': 1774882842.0, 'created_time': 1774521614.803885, 'last_price_update_time': 1774809715.245747}
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU38402') HTTP/1.1" 204 0
2026-03-29 18:41:55 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:55 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX41680%27 HTTP/1.1" 200 None
2026-03-29 18:41:55 [auto1.de] INFO: Scrape type for NX41680: 2
2026-03-29 18:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with identifier: NX41680
2026-03-29 18:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with scrape type 2
2026-03-29 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with scrape type 2
2026-03-29 18:41:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 139a3cd3-d0c5-5bf5-969a-41347fc2d737, identifier: NX41680
2026-03-29 18:41:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with identifier: NX41680
2026-03-29 18:41:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with identifier: NX41680
2026-03-29 18:41:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with identifier: NX41680 to the API
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:01:54Z',
'fuel_type': 'diesel',
'id': '139a3cd3-d0c5-5bf5-969a-41347fc2d737',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX41680',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 286058,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-07',
'seller_name': None,
'title': 'Volkswagen Touran 1.9 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2009}
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX41680%27 HTTP/1.1" 200 None
2026-03-29 18:41:55 [auto1.de] INFO: Saving data for NX41680: {'auction_closing_time': 1774882914.0, 'created_time': 1774293875.220949, 'last_price_update_time': 1774809715.681445}
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX41680') HTTP/1.1" 204 0
2026-03-29 18:41:55 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF46634%27 HTTP/1.1" 200 None
2026-03-29 18:41:55 [auto1.de] INFO: Scrape type for WF46634: 0
2026-03-29 18:41:55 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK74159%27 HTTP/1.1" 200 None
2026-03-29 18:41:55 [auto1.de] INFO: Scrape type for MK74159: 2
2026-03-29 18:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b328be0f-faf5-54e8-abc9-06a3d8c84d10 with identifier: MK74159
2026-03-29 18:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b328be0f-faf5-54e8-abc9-06a3d8c84d10 with scrape type 2
2026-03-29 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b328be0f-faf5-54e8-abc9-06a3d8c84d10 with scrape type 2
2026-03-29 18:41:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b328be0f-faf5-54e8-abc9-06a3d8c84d10, identifier: MK74159
2026-03-29 18:41:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:55 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-29 18:41:55 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX24898%27 HTTP/1.1" 200 None
2026-03-29 18:41:55 [auto1.de] INFO: Scrape type for AX24898: 2
2026-03-29 18:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b88c956-0637-58d3-9fb4-559647cdea4f with identifier: AX24898
2026-03-29 18:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b88c956-0637-58d3-9fb4-559647cdea4f with scrape type 2
2026-03-29 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b88c956-0637-58d3-9fb4-559647cdea4f with scrape type 2
2026-03-29 18:41:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b88c956-0637-58d3-9fb4-559647cdea4f, identifier: AX24898
2026-03-29 18:41:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b328be0f-faf5-54e8-abc9-06a3d8c84d10 with identifier: MK74159
2026-03-29 18:41:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b328be0f-faf5-54e8-abc9-06a3d8c84d10 with identifier: MK74159
2026-03-29 18:41:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b328be0f-faf5-54e8-abc9-06a3d8c84d10 with identifier: MK74159 to the API
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:10:39Z',
'fuel_type': 'petrol',
'id': 'b328be0f-faf5-54e8-abc9-06a3d8c84d10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK74159',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 194088,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-08-06',
'seller_name': None,
'title': 'Toyota RAV 4 1.8 Bblue',
'transmission': 'manual',
'trim': 'Bblue',
'year': 2003}
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK74159%27 HTTP/1.1" 200 None
2026-03-29 18:41:56 [auto1.de] INFO: Saving data for MK74159: {'auction_closing_time': 1774883439.0, 'created_time': 1774607644.142176, 'last_price_update_time': 1774809716.359413}
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK74159') HTTP/1.1" 204 0
2026-03-29 18:41:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b88c956-0637-58d3-9fb4-559647cdea4f with identifier: AX24898
2026-03-29 18:41:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b88c956-0637-58d3-9fb4-559647cdea4f with identifier: AX24898
2026-03-29 18:41:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b88c956-0637-58d3-9fb4-559647cdea4f with identifier: AX24898 to the API
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:38:00Z',
'fuel_type': 'diesel',
'id': '8b88c956-0637-58d3-9fb4-559647cdea4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX24898',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 194736,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-07',
'seller_name': None,
'title': 'Ford Focus 1.5 TDCi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2015}
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX24898%27 HTTP/1.1" 200 None
2026-03-29 18:41:56 [auto1.de] INFO: Saving data for AX24898: {'auction_closing_time': 1774885080.0, 'created_time': 1773859000.797888, 'last_price_update_time': 1774809716.816796}
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX24898') HTTP/1.1" 204 0
2026-03-29 18:41:56 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-29 18:41:56 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20186%27 HTTP/1.1" 200 None
2026-03-29 18:41:56 [auto1.de] INFO: Scrape type for JY20186: 2
2026-03-29 18:41:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccb5350a-8276-59c1-b328-a1679a181ac8 with identifier: JY20186
2026-03-29 18:41:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccb5350a-8276-59c1-b328-a1679a181ac8 with scrape type 2
2026-03-29 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccb5350a-8276-59c1-b328-a1679a181ac8 with scrape type 2
2026-03-29 18:41:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccb5350a-8276-59c1-b328-a1679a181ac8, identifier: JY20186
2026-03-29 18:41:56 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-29 18:41:56 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD44773%27 HTTP/1.1" 200 None
2026-03-29 18:41:56 [auto1.de] INFO: Scrape type for GD44773: 0
2026-03-29 18:41:56 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-29 18:41:56 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-29 18:41:56 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-29 18:41:56 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV00012%27 HTTP/1.1" 200 None
2026-03-29 18:41:56 [auto1.de] INFO: Scrape type for CV00012: 0
2026-03-29 18:41:56 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-29 18:41:56 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-29 18:41:56 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-29 18:41:56 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD76267%27 HTTP/1.1" 200 None
2026-03-29 18:41:57 [auto1.de] INFO: Scrape type for WD76267: 0
2026-03-29 18:41:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccb5350a-8276-59c1-b328-a1679a181ac8 with identifier: JY20186
2026-03-29 18:41:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccb5350a-8276-59c1-b328-a1679a181ac8 with identifier: JY20186
2026-03-29 18:41:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccb5350a-8276-59c1-b328-a1679a181ac8 with identifier: JY20186 to the API
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:23:12Z',
'fuel_type': 'petrol',
'id': 'ccb5350a-8276-59c1-b328-a1679a181ac8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY20186',
'listing': 'auction',
'make': 'MG Rover',
'model': 'MGF',
'odometer': 90591,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-11-13',
'seller_name': None,
'title': 'MG Rover MGF 1.8 Basis',
'transmission': 'automatic',
'trim': 'Basis',
'year': 2000}
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20186%27 HTTP/1.1" 200 None
2026-03-29 18:41:57 [auto1.de] INFO: Saving data for JY20186: {'auction_closing_time': 1774884192.0, 'created_time': 1774521513.161552, 'last_price_update_time': 1774809717.302696}
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY20186') HTTP/1.1" 204 0
2026-03-29 18:41:57 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-29 18:41:57 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-29 18:41:57 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96832%27 HTTP/1.1" 200 None
2026-03-29 18:41:57 [auto1.de] INFO: Scrape type for BV96832: 0
2026-03-29 18:41:57 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-29 18:41:57 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA59135%27 HTTP/1.1" 200 None
2026-03-29 18:41:57 [auto1.de] INFO: Scrape type for FA59135: 2
2026-03-29 18:41:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bff56ec-3cd3-5581-b680-7155ce09e3fb with identifier: FA59135
2026-03-29 18:41:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bff56ec-3cd3-5581-b680-7155ce09e3fb with scrape type 2
2026-03-29 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bff56ec-3cd3-5581-b680-7155ce09e3fb with scrape type 2
2026-03-29 18:41:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bff56ec-3cd3-5581-b680-7155ce09e3fb, identifier: FA59135
2026-03-29 18:41:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bff56ec-3cd3-5581-b680-7155ce09e3fb with identifier: FA59135
2026-03-29 18:41:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bff56ec-3cd3-5581-b680-7155ce09e3fb with identifier: FA59135
2026-03-29 18:41:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bff56ec-3cd3-5581-b680-7155ce09e3fb with identifier: FA59135 to the API
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:18:02Z',
'fuel_type': 'petrol',
'id': '4bff56ec-3cd3-5581-b680-7155ce09e3fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA59135',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Alto',
'odometer': 106039,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-16',
'seller_name': None,
'title': 'Suzuki Alto 1.0 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2011}
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA59135%27 HTTP/1.1" 200 None
2026-03-29 18:41:57 [auto1.de] INFO: Saving data for FA59135: {'auction_closing_time': 1774883882.0, 'created_time': 1774293440.805188, 'last_price_update_time': 1774809717.869099}
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA59135') HTTP/1.1" 204 0
2026-03-29 18:41:57 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-29 18:41:57 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE81869%27 HTTP/1.1" 200 None
2026-03-29 18:41:57 [auto1.de] INFO: Scrape type for YE81869: 2
2026-03-29 18:41:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with identifier: YE81869
2026-03-29 18:41:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with scrape type 2
2026-03-29 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with scrape type 2
2026-03-29 18:41:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6fb1fd1-f457-5987-ab8c-66c45c13f8a8, identifier: YE81869
2026-03-29 18:41:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with identifier: YE81869
2026-03-29 18:41:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with identifier: YE81869
2026-03-29 18:41:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with identifier: YE81869 to the API
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:29Z',
'fuel_type': 'petrol',
'id': 'f6fb1fd1-f457-5987-ab8c-66c45c13f8a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE81869',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 227204,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-02',
'seller_name': None,
'title': 'Volkswagen Passat 1.4 TSI ACT Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2015}
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE81869%27 HTTP/1.1" 200 None
2026-03-29 18:41:58 [auto1.de] INFO: Saving data for YE81869: {'auction_closing_time': 1774885589.0, 'created_time': 1773469073.781054, 'last_price_update_time': 1774809718.317685}
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE81869') HTTP/1.1" 204 0
2026-03-29 18:41:58 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG82377%27 HTTP/1.1" 200 None
2026-03-29 18:41:58 [auto1.de] INFO: Scrape type for JG82377: 2
2026-03-29 18:41:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8782c6e8-24fc-5985-b70a-74fd2779b13b with identifier: JG82377
2026-03-29 18:41:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8782c6e8-24fc-5985-b70a-74fd2779b13b with scrape type 2
2026-03-29 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8782c6e8-24fc-5985-b70a-74fd2779b13b with scrape type 2
2026-03-29 18:41:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8782c6e8-24fc-5985-b70a-74fd2779b13b, identifier: JG82377
2026-03-29 18:41:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8782c6e8-24fc-5985-b70a-74fd2779b13b with identifier: JG82377
2026-03-29 18:41:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8782c6e8-24fc-5985-b70a-74fd2779b13b with identifier: JG82377
2026-03-29 18:41:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8782c6e8-24fc-5985-b70a-74fd2779b13b with identifier: JG82377 to the API
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:56:39Z',
'fuel_type': 'petrol',
'id': '8782c6e8-24fc-5985-b70a-74fd2779b13b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG82377',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 252141,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-06-10',
'seller_name': None,
'title': 'Volkswagen Golf V 1.4 Tour',
'transmission': 'manual',
'trim': 'Tour',
'year': 2007}
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG82377%27 HTTP/1.1" 200 None
2026-03-29 18:41:58 [auto1.de] INFO: Saving data for JG82377: {'auction_closing_time': 1774886199.0, 'created_time': 1773340715.593671, 'last_price_update_time': 1774809718.759649}
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG82377') HTTP/1.1" 204 0
2026-03-29 18:41:58 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ77265%27 HTTP/1.1" 200 None
2026-03-29 18:41:58 [auto1.de] INFO: Scrape type for GJ77265: 2
2026-03-29 18:41:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3046c5c0-5ff4-513f-87b3-7f52d44d5bb7 with identifier: GJ77265
2026-03-29 18:41:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3046c5c0-5ff4-513f-87b3-7f52d44d5bb7 with scrape type 2
2026-03-29 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3046c5c0-5ff4-513f-87b3-7f52d44d5bb7 with scrape type 2
2026-03-29 18:41:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3046c5c0-5ff4-513f-87b3-7f52d44d5bb7, identifier: GJ77265
2026-03-29 18:41:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3046c5c0-5ff4-513f-87b3-7f52d44d5bb7 with identifier: GJ77265
2026-03-29 18:41:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3046c5c0-5ff4-513f-87b3-7f52d44d5bb7 with identifier: GJ77265
2026-03-29 18:41:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3046c5c0-5ff4-513f-87b3-7f52d44d5bb7 with identifier: GJ77265 to the API
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:45:28Z',
'fuel_type': 'petrol',
'id': '3046c5c0-5ff4-513f-87b3-7f52d44d5bb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ77265',
'listing': 'auction',
'make': 'Opel',
'model': 'Adam',
'odometer': 16372,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-17',
'seller_name': None,
'title': 'Opel Adam 1.2 Jam',
'transmission': 'manual',
'trim': 'Jam',
'year': 2013}
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ77265%27 HTTP/1.1" 200 None
2026-03-29 18:41:59 [auto1.de] INFO: Saving data for GJ77265: {'auction_closing_time': 1774885528.0, 'created_time': 1774522023.113825, 'last_price_update_time': 1774809719.153584}
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ77265') HTTP/1.1" 204 0
2026-03-29 18:41:59 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-29 18:41:59 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-29 18:41:59 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-29 18:41:59 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-29 18:41:59 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18365%27 HTTP/1.1" 200 None
2026-03-29 18:41:59 [auto1.de] INFO: Scrape type for BY18365: 2
2026-03-29 18:41:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with identifier: BY18365
2026-03-29 18:41:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with scrape type 2
2026-03-29 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with scrape type 2
2026-03-29 18:41:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3eca5d5e-4fd9-5d81-b41b-fa5387c208af, identifier: BY18365
2026-03-29 18:41:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with identifier: BY18365
2026-03-29 18:41:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with identifier: BY18365
2026-03-29 18:41:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with identifier: BY18365 to the API
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 83,
'expiration_date': '2026-03-30T15:07:30Z',
'fuel_type': 'petrol',
'id': '3eca5d5e-4fd9-5d81-b41b-fa5387c208af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY18365',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Ignis',
'odometer': 18764,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-12-03',
'seller_name': None,
'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2024}
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18365%27 HTTP/1.1" 200 None
2026-03-29 18:41:59 [auto1.de] INFO: Saving data for BY18365: {'auction_closing_time': 1774883250.0, 'created_time': 1774293976.229033, 'last_price_update_time': 1774809719.620241}
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY18365') HTTP/1.1" 204 0
2026-03-29 18:41:59 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80624%27 HTTP/1.1" 200 None
2026-03-29 18:41:59 [auto1.de] INFO: Scrape type for FX80624: 2
2026-03-29 18:41:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e24b636-5475-51f6-984d-8436e3a131d2 with identifier: FX80624
2026-03-29 18:41:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e24b636-5475-51f6-984d-8436e3a131d2 with scrape type 2
2026-03-29 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e24b636-5475-51f6-984d-8436e3a131d2 with scrape type 2
2026-03-29 18:41:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e24b636-5475-51f6-984d-8436e3a131d2, identifier: FX80624
2026-03-29 18:41:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e24b636-5475-51f6-984d-8436e3a131d2 with identifier: FX80624
2026-03-29 18:41:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e24b636-5475-51f6-984d-8436e3a131d2 with identifier: FX80624
2026-03-29 18:41:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e24b636-5475-51f6-984d-8436e3a131d2 with identifier: FX80624 to the API
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:46:30Z',
'fuel_type': 'diesel',
'id': '1e24b636-5475-51f6-984d-8436e3a131d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX80624',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 160568,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-04',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2016}
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80624%27 HTTP/1.1" 200 None
2026-03-29 18:42:00 [auto1.de] INFO: Saving data for FX80624: {'auction_closing_time': 1774885590.0, 'created_time': 1773945872.686088, 'last_price_update_time': 1774809720.187452}
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX80624') HTTP/1.1" 204 0
2026-03-29 18:42:00 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS45422%27 HTTP/1.1" 200 None
2026-03-29 18:42:00 [auto1.de] INFO: Scrape type for PS45422: 0
2026-03-29 18:42:00 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-29 18:42:00 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX75432%27 HTTP/1.1" 200 None
2026-03-29 18:42:00 [auto1.de] INFO: Scrape type for GX75432: 2
2026-03-29 18:42:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3241154-3c4f-55b7-a05b-7a9db02c11ab with identifier: GX75432
2026-03-29 18:42:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3241154-3c4f-55b7-a05b-7a9db02c11ab with scrape type 2
2026-03-29 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3241154-3c4f-55b7-a05b-7a9db02c11ab with scrape type 2
2026-03-29 18:42:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3241154-3c4f-55b7-a05b-7a9db02c11ab, identifier: GX75432
2026-03-29 18:42:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3241154-3c4f-55b7-a05b-7a9db02c11ab with identifier: GX75432
2026-03-29 18:42:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3241154-3c4f-55b7-a05b-7a9db02c11ab with identifier: GX75432
2026-03-29 18:42:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3241154-3c4f-55b7-a05b-7a9db02c11ab with identifier: GX75432 to the API
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:41:08Z',
'fuel_type': 'petrol',
'id': 'f3241154-3c4f-55b7-a05b-7a9db02c11ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX75432',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 95465,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-25',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis Prime',
'transmission': 'automatic',
'trim': 'Basis Prime',
'year': 2018}
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX75432%27 HTTP/1.1" 200 None
2026-03-29 18:42:00 [auto1.de] INFO: Saving data for GX75432: {'auction_closing_time': 1774885268.0, 'created_time': 1774522571.130744, 'last_price_update_time': 1774809720.593386}
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX75432') HTTP/1.1" 204 0
2026-03-29 18:42:00 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96721%27 HTTP/1.1" 200 None
2026-03-29 18:42:00 [auto1.de] INFO: Scrape type for YA96721: 2
2026-03-29 18:42:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af68b64e-d440-5c50-8b6a-a33f6f8c29c2 with identifier: YA96721
2026-03-29 18:42:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af68b64e-d440-5c50-8b6a-a33f6f8c29c2 with scrape type 2
2026-03-29 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af68b64e-d440-5c50-8b6a-a33f6f8c29c2 with scrape type 2
2026-03-29 18:42:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af68b64e-d440-5c50-8b6a-a33f6f8c29c2, identifier: YA96721
2026-03-29 18:42:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af68b64e-d440-5c50-8b6a-a33f6f8c29c2 with identifier: YA96721
2026-03-29 18:42:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af68b64e-d440-5c50-8b6a-a33f6f8c29c2 with identifier: YA96721
2026-03-29 18:42:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af68b64e-d440-5c50-8b6a-a33f6f8c29c2 with identifier: YA96721 to the API
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:09:40Z',
'fuel_type': 'diesel',
'id': 'af68b64e-d440-5c50-8b6a-a33f6f8c29c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA96721',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 166419,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-30',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2009}
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96721%27 HTTP/1.1" 200 None
2026-03-29 18:42:01 [auto1.de] INFO: Saving data for YA96721: {'auction_closing_time': 1774883380.0, 'created_time': 1774550022.14355, 'last_price_update_time': 1774809721.005971}
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA96721') HTTP/1.1" 204 0
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU33144%27 HTTP/1.1" 200 None
2026-03-29 18:42:01 [auto1.de] INFO: Scrape type for TU33144: 2
2026-03-29 18:42:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a379f190-5340-5001-af2d-eb7bbbaf28b0 with identifier: TU33144
2026-03-29 18:42:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a379f190-5340-5001-af2d-eb7bbbaf28b0 with scrape type 2
2026-03-29 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a379f190-5340-5001-af2d-eb7bbbaf28b0 with scrape type 2
2026-03-29 18:42:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a379f190-5340-5001-af2d-eb7bbbaf28b0, identifier: TU33144
2026-03-29 18:42:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a379f190-5340-5001-af2d-eb7bbbaf28b0 with identifier: TU33144
2026-03-29 18:42:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a379f190-5340-5001-af2d-eb7bbbaf28b0 with identifier: TU33144
2026-03-29 18:42:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a379f190-5340-5001-af2d-eb7bbbaf28b0 with identifier: TU33144 to the API
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:49:03Z',
'fuel_type': 'petrol',
'id': 'a379f190-5340-5001-af2d-eb7bbbaf28b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU33144',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 93455,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-28',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.2 TSI',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU33144%27 HTTP/1.1" 200 None
2026-03-29 18:42:01 [auto1.de] INFO: Saving data for TU33144: {'auction_closing_time': 1774885743.0, 'created_time': 1773774326.429819, 'last_price_update_time': 1774809721.457797}
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU33144') HTTP/1.1" 204 0
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM45973%27 HTTP/1.1" 200 None
2026-03-29 18:42:01 [auto1.de] INFO: Scrape type for GM45973: 2
2026-03-29 18:42:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85a4af3a-454f-5c05-968d-10cbc315d670 with identifier: GM45973
2026-03-29 18:42:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85a4af3a-454f-5c05-968d-10cbc315d670 with scrape type 2
2026-03-29 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85a4af3a-454f-5c05-968d-10cbc315d670 with scrape type 2
2026-03-29 18:42:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85a4af3a-454f-5c05-968d-10cbc315d670, identifier: GM45973
2026-03-29 18:42:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85a4af3a-454f-5c05-968d-10cbc315d670 with identifier: GM45973
2026-03-29 18:42:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85a4af3a-454f-5c05-968d-10cbc315d670 with identifier: GM45973
2026-03-29 18:42:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85a4af3a-454f-5c05-968d-10cbc315d670 with identifier: GM45973 to the API
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:20:02Z',
'fuel_type': 'diesel',
'id': '85a4af3a-454f-5c05-968d-10cbc315d670',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM45973',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumper',
'odometer': 57890,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-29',
'seller_name': None,
'title': 'Citroen Jumper 2.2 Blue-HDi 33 L2H1 Control Start&Stop',
'transmission': 'manual',
'trim': '33 L2H1 Control Start&Stop',
'year': 2021}
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM45973%27 HTTP/1.1" 200 None
2026-03-29 18:42:01 [auto1.de] INFO: Saving data for GM45973: {'auction_closing_time': 1774884002.0, 'created_time': 1773138765.659527, 'last_price_update_time': 1774809721.911886}
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM45973') HTTP/1.1" 204 0
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ52813%27 HTTP/1.1" 200 None
2026-03-29 18:42:01 [auto1.de] INFO: Scrape type for EJ52813: 2
2026-03-29 18:42:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0ce38ba-56b2-5717-8e1e-435664f98629 with identifier: EJ52813
2026-03-29 18:42:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0ce38ba-56b2-5717-8e1e-435664f98629 with scrape type 2
2026-03-29 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0ce38ba-56b2-5717-8e1e-435664f98629 with scrape type 2
2026-03-29 18:42:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0ce38ba-56b2-5717-8e1e-435664f98629, identifier: EJ52813
2026-03-29 18:42:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0ce38ba-56b2-5717-8e1e-435664f98629 with identifier: EJ52813
2026-03-29 18:42:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0ce38ba-56b2-5717-8e1e-435664f98629 with identifier: EJ52813
2026-03-29 18:42:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0ce38ba-56b2-5717-8e1e-435664f98629 with identifier: EJ52813 to the API
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:14:50Z',
'fuel_type': 'petrol',
'id': 'a0ce38ba-56b2-5717-8e1e-435664f98629',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ52813',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 30142,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-26',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2011}
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ52813%27 HTTP/1.1" 200 None
2026-03-29 18:42:02 [auto1.de] INFO: Saving data for EJ52813: {'auction_closing_time': 1774883690.0, 'created_time': 1773429030.880557, 'last_price_update_time': 1774809722.377471}
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ52813') HTTP/1.1" 204 0
2026-03-29 18:42:02 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63279%27 HTTP/1.1" 200 None
2026-03-29 18:42:02 [auto1.de] INFO: Scrape type for WC63279: 0
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE80644%27 HTTP/1.1" 200 None
2026-03-29 18:42:02 [auto1.de] INFO: Scrape type for CE80644: 0
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52940%27 HTTP/1.1" 200 None
2026-03-29 18:42:02 [auto1.de] INFO: Scrape type for BX52940: 2
2026-03-29 18:42:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1175ce4-7c16-548c-9189-ef5ea835886e with identifier: BX52940
2026-03-29 18:42:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1175ce4-7c16-548c-9189-ef5ea835886e with scrape type 2
2026-03-29 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1175ce4-7c16-548c-9189-ef5ea835886e with scrape type 2
2026-03-29 18:42:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1175ce4-7c16-548c-9189-ef5ea835886e, identifier: BX52940
2026-03-29 18:42:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1175ce4-7c16-548c-9189-ef5ea835886e with identifier: BX52940
2026-03-29 18:42:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1175ce4-7c16-548c-9189-ef5ea835886e with identifier: BX52940
2026-03-29 18:42:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1175ce4-7c16-548c-9189-ef5ea835886e with identifier: BX52940 to the API
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 380,
'expiration_date': '2026-03-30T15:54:16Z',
'fuel_type': 'petrol',
'id': 'd1175ce4-7c16-548c-9189-ef5ea835886e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX52940',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 102653,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 45 AMG 4Matic Sport',
'transmission': 'automatic',
'trim': '4Matic Sport',
'year': 2018}
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52940%27 HTTP/1.1" 200 None
2026-03-29 18:42:02 [auto1.de] INFO: Saving data for BX52940: {'auction_closing_time': 1774886056.0, 'created_time': 1773859485.331411, 'last_price_update_time': 1774809722.886149}
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX52940') HTTP/1.1" 204 0
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL02906%27 HTTP/1.1" 200 None
2026-03-29 18:42:03 [auto1.de] INFO: Scrape type for BL02906: 0
2026-03-29 18:42:03 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-29 18:42:03 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW79477%27 HTTP/1.1" 200 None
2026-03-29 18:42:03 [auto1.de] INFO: Scrape type for WW79477: 2
2026-03-29 18:42:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with identifier: WW79477
2026-03-29 18:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with scrape type 2
2026-03-29 18:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with scrape type 2
2026-03-29 18:42:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d024d65-1a7e-57a9-a3bb-65b68b2474e3, identifier: WW79477
2026-03-29 18:42:03 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-29 18:42:03 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX52884%27 HTTP/1.1" 200 None
2026-03-29 18:42:03 [auto1.de] INFO: Scrape type for SX52884: 0
2026-03-29 18:42:03 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-29 18:42:03 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV05301%27 HTTP/1.1" 200 None
2026-03-29 18:42:03 [auto1.de] INFO: Scrape type for RV05301: 2
2026-03-29 18:42:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with identifier: RV05301
2026-03-29 18:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with scrape type 2
2026-03-29 18:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with scrape type 2
2026-03-29 18:42:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 431ce18c-82c4-57bf-b8f5-21e7299e3ba4, identifier: RV05301
2026-03-29 18:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with identifier: WW79477
2026-03-29 18:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with identifier: WW79477
2026-03-29 18:42:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with identifier: WW79477 to the API
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:25:40Z',
'fuel_type': 'petrol',
'id': '5d024d65-1a7e-57a9-a3bb-65b68b2474e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW79477',
'listing': 'auction',
'make': 'Seat',
'model': 'Altea',
'odometer': 148452,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-31',
'seller_name': None,
'title': 'Seat Altea 1.2 TSI Style Ecomotive',
'transmission': 'manual',
'trim': 'Style Ecomotive',
'year': 2011}
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW79477%27 HTTP/1.1" 200 None
2026-03-29 18:42:03 [auto1.de] INFO: Saving data for WW79477: {'auction_closing_time': 1774884340.0, 'created_time': 1774262252.696002, 'last_price_update_time': 1774809723.566681}
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW79477') HTTP/1.1" 204 0
2026-03-29 18:42:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with identifier: RV05301
2026-03-29 18:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with identifier: RV05301
2026-03-29 18:42:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with identifier: RV05301 to the API
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:59:10Z',
'fuel_type': 'diesel',
'id': '431ce18c-82c4-57bf-b8f5-21e7299e3ba4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV05301',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 180724,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-06',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake AMG Line',
'transmission': 'manual',
'trim': 'AMG Line',
'year': 2017}
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV05301%27 HTTP/1.1" 200 None
2026-03-29 18:42:03 [auto1.de] INFO: Saving data for RV05301: {'auction_closing_time': 1774886350.0, 'created_time': 1773830149.684609, 'last_price_update_time': 1774809723.984198}
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV05301') HTTP/1.1" 204 0
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06358%27 HTTP/1.1" 200 None
2026-03-29 18:42:04 [auto1.de] INFO: Scrape type for MU06358: 2
2026-03-29 18:42:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e13031e2-25fe-5d9b-b630-da83a3035d19 with identifier: MU06358
2026-03-29 18:42:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e13031e2-25fe-5d9b-b630-da83a3035d19 with scrape type 2
2026-03-29 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e13031e2-25fe-5d9b-b630-da83a3035d19 with scrape type 2
2026-03-29 18:42:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e13031e2-25fe-5d9b-b630-da83a3035d19, identifier: MU06358
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54610%27 HTTP/1.1" 200 None
2026-03-29 18:42:04 [auto1.de] INFO: Scrape type for HH54610: 0
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-29 18:42:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e13031e2-25fe-5d9b-b630-da83a3035d19 with identifier: MU06358
2026-03-29 18:42:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e13031e2-25fe-5d9b-b630-da83a3035d19 with identifier: MU06358
2026-03-29 18:42:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e13031e2-25fe-5d9b-b630-da83a3035d19 with identifier: MU06358 to the API
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:36:51Z',
'fuel_type': 'petrol',
'id': 'e13031e2-25fe-5d9b-b630-da83a3035d19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU06358',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 147417,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-06',
'seller_name': None,
'title': 'Seat Ibiza 1.4 I-Tech',
'transmission': 'manual',
'trim': 'I-Tech',
'year': 2013}
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06358%27 HTTP/1.1" 200 None
2026-03-29 18:42:04 [auto1.de] INFO: Saving data for MU06358: {'auction_closing_time': 1774885011.0, 'created_time': 1774636344.503339, 'last_price_update_time': 1774809724.483677}
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU06358') HTTP/1.1" 204 0
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE87881%27 HTTP/1.1" 200 None
2026-03-29 18:42:04 [auto1.de] INFO: Scrape type for GE87881: 0
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY60733%27 HTTP/1.1" 200 None
2026-03-29 18:42:04 [auto1.de] INFO: Scrape type for ZY60733: 2
2026-03-29 18:42:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef912cf3-25f3-590a-9145-0c863fbb96ed with identifier: ZY60733
2026-03-29 18:42:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef912cf3-25f3-590a-9145-0c863fbb96ed with scrape type 2
2026-03-29 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef912cf3-25f3-590a-9145-0c863fbb96ed with scrape type 2
2026-03-29 18:42:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef912cf3-25f3-590a-9145-0c863fbb96ed, identifier: ZY60733
2026-03-29 18:42:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef912cf3-25f3-590a-9145-0c863fbb96ed with identifier: ZY60733
2026-03-29 18:42:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef912cf3-25f3-590a-9145-0c863fbb96ed with identifier: ZY60733
2026-03-29 18:42:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef912cf3-25f3-590a-9145-0c863fbb96ed with identifier: ZY60733 to the API
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:15:36Z',
'fuel_type': 'petrol',
'id': 'ef912cf3-25f3-590a-9145-0c863fbb96ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY60733',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 132793,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-12',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2014}
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY60733%27 HTTP/1.1" 200 None
2026-03-29 18:42:05 [auto1.de] INFO: Saving data for ZY60733: {'auction_closing_time': 1774883736.0, 'created_time': 1774636477.082943, 'last_price_update_time': 1774809725.059149}
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY60733') HTTP/1.1" 204 0
2026-03-29 18:42:05 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-29 18:42:05 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK32978%27 HTTP/1.1" 200 None
2026-03-29 18:42:05 [auto1.de] INFO: Scrape type for GK32978: 0
2026-03-29 18:42:05 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-29 18:42:05 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-29 18:42:05 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-29 18:42:05 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH74073%27 HTTP/1.1" 200 None
2026-03-29 18:42:05 [auto1.de] INFO: Scrape type for GH74073: 2
2026-03-29 18:42:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7be6b64-4dec-5cd6-849f-da7d39d696fa with identifier: GH74073
2026-03-29 18:42:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7be6b64-4dec-5cd6-849f-da7d39d696fa with scrape type 2
2026-03-29 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7be6b64-4dec-5cd6-849f-da7d39d696fa with scrape type 2
2026-03-29 18:42:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7be6b64-4dec-5cd6-849f-da7d39d696fa, identifier: GH74073
2026-03-29 18:42:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7be6b64-4dec-5cd6-849f-da7d39d696fa with identifier: GH74073
2026-03-29 18:42:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7be6b64-4dec-5cd6-849f-da7d39d696fa with identifier: GH74073
2026-03-29 18:42:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7be6b64-4dec-5cd6-849f-da7d39d696fa with identifier: GH74073 to the API
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:14:30Z',
'fuel_type': 'diesel',
'id': 'c7be6b64-4dec-5cd6-849f-da7d39d696fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH74073',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 291267,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-10',
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH74073%27 HTTP/1.1" 200 None
2026-03-29 18:42:05 [auto1.de] INFO: Saving data for GH74073: {'auction_closing_time': 1774883670.0, 'created_time': 1774608332.946838, 'last_price_update_time': 1774809725.503018}
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH74073') HTTP/1.1" 204 0
2026-03-29 18:42:05 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC93569%27 HTTP/1.1" 200 None
2026-03-29 18:42:05 [auto1.de] INFO: Scrape type for LC93569: 0
2026-03-29 18:42:05 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ84301%27 HTTP/1.1" 200 None
2026-03-29 18:42:05 [auto1.de] INFO: Scrape type for XJ84301: 0
2026-03-29 18:42:05 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-29 18:42:05 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-29 18:42:05 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC49390%27 HTTP/1.1" 200 None
2026-03-29 18:42:05 [auto1.de] INFO: Scrape type for GC49390: 2
2026-03-29 18:42:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74bf406a-3d7b-532a-9d1e-3cf9e6bad79e with identifier: GC49390
2026-03-29 18:42:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74bf406a-3d7b-532a-9d1e-3cf9e6bad79e with scrape type 2
2026-03-29 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74bf406a-3d7b-532a-9d1e-3cf9e6bad79e with scrape type 2
2026-03-29 18:42:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74bf406a-3d7b-532a-9d1e-3cf9e6bad79e, identifier: GC49390
2026-03-29 18:42:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74bf406a-3d7b-532a-9d1e-3cf9e6bad79e with identifier: GC49390
2026-03-29 18:42:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74bf406a-3d7b-532a-9d1e-3cf9e6bad79e with identifier: GC49390
2026-03-29 18:42:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74bf406a-3d7b-532a-9d1e-3cf9e6bad79e with identifier: GC49390 to the API
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 154,
'expiration_date': '2026-03-30T15:29:04Z',
'fuel_type': 'petrol',
'id': '74bf406a-3d7b-532a-9d1e-3cf9e6bad79e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC49390',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 80905,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-22',
'seller_name': None,
'title': 'Renault Captur 1.3 TCe Edition One',
'transmission': 'automatic',
'trim': 'Edition One',
'year': 2020}
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC49390%27 HTTP/1.1" 200 None
2026-03-29 18:42:06 [auto1.de] INFO: Saving data for GC49390: {'auction_closing_time': 1774884544.0, 'created_time': 1774636536.221248, 'last_price_update_time': 1774809726.036475}
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC49390') HTTP/1.1" 204 0
2026-03-29 18:42:06 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-29 18:42:06 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-29 18:42:06 [auto1.de] INFO: Found listing with ID: VW88901
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW88901%27 HTTP/1.1" 200 None
2026-03-29 18:42:06 [auto1.de] INFO: Scrape type for VW88901: 2
2026-03-29 18:42:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 734623e2-60ec-5290-98cb-68d04e7eb2f0 with identifier: VW88901
2026-03-29 18:42:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 734623e2-60ec-5290-98cb-68d04e7eb2f0 with scrape type 2
2026-03-29 18:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 734623e2-60ec-5290-98cb-68d04e7eb2f0 with scrape type 2
2026-03-29 18:42:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 734623e2-60ec-5290-98cb-68d04e7eb2f0, identifier: VW88901
2026-03-29 18:42:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 734623e2-60ec-5290-98cb-68d04e7eb2f0 with identifier: VW88901
2026-03-29 18:42:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 734623e2-60ec-5290-98cb-68d04e7eb2f0 with identifier: VW88901
2026-03-29 18:42:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 734623e2-60ec-5290-98cb-68d04e7eb2f0 with identifier: VW88901 to the API
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:36:36Z',
'fuel_type': 'petrol',
'id': '734623e2-60ec-5290-98cb-68d04e7eb2f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW88901',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 28181,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-12',
'seller_name': None,
'title': 'Volkswagen T-Cross 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2023}
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW88901%27 HTTP/1.1" 200 None
2026-03-29 18:42:06 [auto1.de] INFO: Saving data for VW88901: {'auction_closing_time': 1774884996.0, 'created_time': 1774033867.114763, 'last_price_update_time': 1774809726.573633}
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW88901') HTTP/1.1" 204 0
2026-03-29 18:42:06 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10933%27 HTTP/1.1" 200 None
2026-03-29 18:42:06 [auto1.de] INFO: Scrape type for DK10933: 0
2026-03-29 18:42:06 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-29 18:42:06 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY38898%27 HTTP/1.1" 200 None
2026-03-29 18:42:06 [auto1.de] INFO: Scrape type for ZY38898: 2
2026-03-29 18:42:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55a13684-c1a1-5d35-91ad-820ae00d4766 with identifier: ZY38898
2026-03-29 18:42:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55a13684-c1a1-5d35-91ad-820ae00d4766 with scrape type 2
2026-03-29 18:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55a13684-c1a1-5d35-91ad-820ae00d4766 with scrape type 2
2026-03-29 18:42:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55a13684-c1a1-5d35-91ad-820ae00d4766, identifier: ZY38898
2026-03-29 18:42:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55a13684-c1a1-5d35-91ad-820ae00d4766 with identifier: ZY38898
2026-03-29 18:42:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55a13684-c1a1-5d35-91ad-820ae00d4766 with identifier: ZY38898
2026-03-29 18:42:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55a13684-c1a1-5d35-91ad-820ae00d4766 with identifier: ZY38898 to the API
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:28:20Z',
'fuel_type': 'diesel',
'id': '55a13684-c1a1-5d35-91ad-820ae00d4766',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY38898',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 119365,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-07',
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-29 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY38898%27 HTTP/1.1" 200 None
2026-03-29 18:42:07 [auto1.de] INFO: Saving data for ZY38898: {'auction_closing_time': 1774884500.0, 'created_time': 1774294319.567424, 'last_price_update_time': 1774809727.057337}
2026-03-29 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY38898') HTTP/1.1" 204 0
2026-03-29 18:42:07 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-29 18:42:07 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-29 18:42:07 [auto1.de] INFO: Found listing with ID: UW42720
2026-03-29 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW42720%27 HTTP/1.1" 200 None
2026-03-29 18:42:07 [auto1.de] INFO: Scrape type for UW42720: 2
2026-03-29 18:42:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3923db3-539e-52cb-980f-208a13f8cb89 with identifier: UW42720
2026-03-29 18:42:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3923db3-539e-52cb-980f-208a13f8cb89 with scrape type 2
2026-03-29 18:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3923db3-539e-52cb-980f-208a13f8cb89 with scrape type 2
2026-03-29 18:42:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3923db3-539e-52cb-980f-208a13f8cb89, identifier: UW42720
2026-03-29 18:42:07 [scrapy.extensions.logstats] INFO: Crawled 129 pages (at 9 pages/min), scraped 1041 items (at 105 items/min)
2026-03-29 18:42:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:42:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3923db3-539e-52cb-980f-208a13f8cb89 with identifier: UW42720
2026-03-29 18:42:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3923db3-539e-52cb-980f-208a13f8cb89 with identifier: UW42720
2026-03-29 18:42:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3923db3-539e-52cb-980f-208a13f8cb89 with identifier: UW42720 to the API
2026-03-29 18:42:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:07:58Z',
'fuel_type': 'petrol',
'id': 'e3923db3-539e-52cb-980f-208a13f8cb89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW42720',
'listing': 'auction',
'make': 'Citroen',
'model': 'C1',
'odometer': 81535,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-18',
'seller_name': None,
'title': 'Citroen C1 1.0 Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2011}
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW42720%27 HTTP/1.1" 200 None
2026-03-29 18:42:08 [auto1.de] INFO: Saving data for UW42720: {'auction_closing_time': 1774883278.0, 'created_time': 1774032341.577132, 'last_price_update_time': 1774809728.37875}
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW42720') HTTP/1.1" 204 0
2026-03-29 18:42:08 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF79557%27 HTTP/1.1" 200 None
2026-03-29 18:42:08 [auto1.de] INFO: Scrape type for WF79557: 0
2026-03-29 18:42:08 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS34798%27 HTTP/1.1" 200 None
2026-03-29 18:42:08 [auto1.de] INFO: Scrape type for JS34798: 0
2026-03-29 18:42:08 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-29 18:42:08 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-29 18:42:08 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT07076%27 HTTP/1.1" 200 None
2026-03-29 18:42:08 [auto1.de] INFO: Scrape type for TT07076: 0
2026-03-29 18:42:08 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-29 18:42:08 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-29 18:42:08 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-29 18:42:08 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-29 18:42:08 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65369%27 HTTP/1.1" 200 None
2026-03-29 18:42:08 [auto1.de] INFO: Scrape type for CA65369: 2
2026-03-29 18:42:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with identifier: CA65369
2026-03-29 18:42:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with scrape type 2
2026-03-29 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with scrape type 2
2026-03-29 18:42:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1, identifier: CA65369
2026-03-29 18:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with identifier: CA65369
2026-03-29 18:42:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with identifier: CA65369
2026-03-29 18:42:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with identifier: CA65369 to the API
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:07:24Z',
'fuel_type': 'petrol',
'id': '6f2a883d-36f1-5cb8-9b78-ac7715eef8a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA65369',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 102905,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-20',
'seller_name': None,
'title': 'Nissan Qashqai 1.2 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2015}
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65369%27 HTTP/1.1" 200 None
2026-03-29 18:42:08 [auto1.de] INFO: Saving data for CA65369: {'auction_closing_time': 1774883244.0, 'created_time': 1773399912.007961, 'last_price_update_time': 1774809728.960846}
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA65369') HTTP/1.1" 204 0
2026-03-29 18:42:09 [auto1.de] INFO: Found listing with ID: US56502
2026-03-29 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US56502%27 HTTP/1.1" 200 None
2026-03-29 18:42:09 [auto1.de] INFO: Scrape type for US56502: 0
2026-03-29 18:42:09 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-29 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD28198%27 HTTP/1.1" 200 None
2026-03-29 18:42:09 [auto1.de] INFO: Scrape type for SD28198: 2
2026-03-29 18:42:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with identifier: SD28198
2026-03-29 18:42:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with scrape type 2
2026-03-29 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with scrape type 2
2026-03-29 18:42:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84fe5ade-85e6-5fcb-a92a-02bebc918c4c, identifier: SD28198
2026-03-29 18:42:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with identifier: SD28198
2026-03-29 18:42:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with identifier: SD28198
2026-03-29 18:42:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with identifier: SD28198 to the API
2026-03-29 18:42:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:52:57Z',
'fuel_type': 'petrol',
'id': '84fe5ade-85e6-5fcb-a92a-02bebc918c4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD28198',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 58422,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-08',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 250',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD28198%27 HTTP/1.1" 200 None
2026-03-29 18:42:10 [auto1.de] INFO: Saving data for SD28198: {'auction_closing_time': 1774885977.0, 'created_time': 1774349177.001502, 'last_price_update_time': 1774809730.453619}
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD28198') HTTP/1.1" 204 0
2026-03-29 18:42:10 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX86281%27 HTTP/1.1" 200 None
2026-03-29 18:42:10 [auto1.de] INFO: Scrape type for MX86281: 2
2026-03-29 18:42:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a5259f-d720-55e2-b188-398a5d3c2f51 with identifier: MX86281
2026-03-29 18:42:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a5259f-d720-55e2-b188-398a5d3c2f51 with scrape type 2
2026-03-29 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7a5259f-d720-55e2-b188-398a5d3c2f51 with scrape type 2
2026-03-29 18:42:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7a5259f-d720-55e2-b188-398a5d3c2f51, identifier: MX86281
2026-03-29 18:42:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7a5259f-d720-55e2-b188-398a5d3c2f51 with identifier: MX86281
2026-03-29 18:42:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7a5259f-d720-55e2-b188-398a5d3c2f51 with identifier: MX86281
2026-03-29 18:42:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7a5259f-d720-55e2-b188-398a5d3c2f51 with identifier: MX86281 to the API
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:24:32Z',
'fuel_type': 'petrol',
'id': 'b7a5259f-d720-55e2-b188-398a5d3c2f51',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX86281',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 50809,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-10',
'seller_name': None,
'title': 'Skoda Fabia 1.0 MPI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2019}
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX86281%27 HTTP/1.1" 200 None
2026-03-29 18:42:10 [auto1.de] INFO: Saving data for MX86281: {'auction_closing_time': 1774884272.0, 'created_time': 1774522135.06888, 'last_price_update_time': 1774809730.861984}
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX86281') HTTP/1.1" 204 0
2026-03-29 18:42:10 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:10 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV48270%27 HTTP/1.1" 200 None
2026-03-29 18:42:10 [auto1.de] INFO: Scrape type for NV48270: 0
2026-03-29 18:42:10 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-29 18:42:10 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ83217%27 HTTP/1.1" 200 None
2026-03-29 18:42:10 [auto1.de] INFO: Scrape type for UJ83217: 0
2026-03-29 18:42:10 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW30650%27 HTTP/1.1" 200 None
2026-03-29 18:42:10 [auto1.de] INFO: Scrape type for HW30650: 0
2026-03-29 18:42:10 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-29 18:42:10 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ36407%27 HTTP/1.1" 200 None
2026-03-29 18:42:10 [auto1.de] INFO: Scrape type for GJ36407: 2
2026-03-29 18:42:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fc638e2-5f9a-5427-83ef-8968cffef920 with identifier: GJ36407
2026-03-29 18:42:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc638e2-5f9a-5427-83ef-8968cffef920 with scrape type 2
2026-03-29 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fc638e2-5f9a-5427-83ef-8968cffef920 with scrape type 2
2026-03-29 18:42:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fc638e2-5f9a-5427-83ef-8968cffef920, identifier: GJ36407
2026-03-29 18:42:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fc638e2-5f9a-5427-83ef-8968cffef920 with identifier: GJ36407
2026-03-29 18:42:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fc638e2-5f9a-5427-83ef-8968cffef920 with identifier: GJ36407
2026-03-29 18:42:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fc638e2-5f9a-5427-83ef-8968cffef920 with identifier: GJ36407 to the API
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 178,
'expiration_date': '2026-03-30T15:14:39Z',
'fuel_type': 'petrol',
'id': '9fc638e2-5f9a-5427-83ef-8968cffef920',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ36407',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 17861,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-28',
'seller_name': None,
'title': 'MINI Countryman Cooper S Classic Trim',
'transmission': 'automatic',
'trim': 'Classic Trim',
'year': 2022}
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ36407%27 HTTP/1.1" 200 None
2026-03-29 18:42:11 [auto1.de] INFO: Saving data for GJ36407: {'auction_closing_time': 1774883679.0, 'created_time': 1774262881.080456, 'last_price_update_time': 1774809731.400411}
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ36407') HTTP/1.1" 204 0
2026-03-29 18:42:11 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-29 18:42:11 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64315%27 HTTP/1.1" 200 None
2026-03-29 18:42:11 [auto1.de] INFO: Scrape type for ME64315: 0
2026-03-29 18:42:11 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41369%27 HTTP/1.1" 200 None
2026-03-29 18:42:11 [auto1.de] INFO: Scrape type for WX41369: 2
2026-03-29 18:42:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b174d140-f8da-58ec-b72b-b43d631e9093 with identifier: WX41369
2026-03-29 18:42:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b174d140-f8da-58ec-b72b-b43d631e9093 with scrape type 2
2026-03-29 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b174d140-f8da-58ec-b72b-b43d631e9093 with scrape type 2
2026-03-29 18:42:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b174d140-f8da-58ec-b72b-b43d631e9093, identifier: WX41369
2026-03-29 18:42:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b174d140-f8da-58ec-b72b-b43d631e9093 with identifier: WX41369
2026-03-29 18:42:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b174d140-f8da-58ec-b72b-b43d631e9093 with identifier: WX41369
2026-03-29 18:42:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b174d140-f8da-58ec-b72b-b43d631e9093 with identifier: WX41369 to the API
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:02:35Z',
'fuel_type': 'petrol',
'id': 'b174d140-f8da-58ec-b72b-b43d631e9093',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX41369',
'listing': 'auction',
'make': 'Opel',
'model': 'Adam',
'odometer': 112785,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-26',
'seller_name': None,
'title': 'Opel Adam 1.0 Turbo Jam ecoFlex',
'transmission': 'manual',
'trim': 'Jam ecoFlex',
'year': 2015}
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41369%27 HTTP/1.1" 200 None
2026-03-29 18:42:11 [auto1.de] INFO: Saving data for WX41369: {'auction_closing_time': 1774882955.0, 'created_time': 1773732648.753932, 'last_price_update_time': 1774809731.888387}
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX41369') HTTP/1.1" 204 0
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF72599%27 HTTP/1.1" 200 None
2026-03-29 18:42:12 [auto1.de] INFO: Scrape type for YF72599: 0
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89074%27 HTTP/1.1" 200 None
2026-03-29 18:42:12 [auto1.de] INFO: Scrape type for DK89074: 2
2026-03-29 18:42:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23de73ab-f3f2-5907-acaa-45b867a47b4b with identifier: DK89074
2026-03-29 18:42:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23de73ab-f3f2-5907-acaa-45b867a47b4b with scrape type 2
2026-03-29 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23de73ab-f3f2-5907-acaa-45b867a47b4b with scrape type 2
2026-03-29 18:42:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23de73ab-f3f2-5907-acaa-45b867a47b4b, identifier: DK89074
2026-03-29 18:42:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23de73ab-f3f2-5907-acaa-45b867a47b4b with identifier: DK89074
2026-03-29 18:42:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23de73ab-f3f2-5907-acaa-45b867a47b4b with identifier: DK89074
2026-03-29 18:42:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23de73ab-f3f2-5907-acaa-45b867a47b4b with identifier: DK89074 to the API
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:07:16Z',
'fuel_type': 'petrol',
'id': '23de73ab-f3f2-5907-acaa-45b867a47b4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK89074',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 197846,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-14',
'seller_name': None,
'title': 'Renault Clio 1.2 Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2010}
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89074%27 HTTP/1.1" 200 None
2026-03-29 18:42:12 [auto1.de] INFO: Saving data for DK89074: {'auction_closing_time': 1774883236.0, 'created_time': 1773132202.410904, 'last_price_update_time': 1774809732.468026}
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK89074') HTTP/1.1" 204 0
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA79718%27 HTTP/1.1" 200 None
2026-03-29 18:42:12 [auto1.de] INFO: Scrape type for ZA79718: 0
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN48285%27 HTTP/1.1" 200 None
2026-03-29 18:42:12 [auto1.de] INFO: Scrape type for MN48285: 2
2026-03-29 18:42:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad054cd1-62a1-5d06-a4b6-e136f1036163 with identifier: MN48285
2026-03-29 18:42:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad054cd1-62a1-5d06-a4b6-e136f1036163 with scrape type 2
2026-03-29 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad054cd1-62a1-5d06-a4b6-e136f1036163 with scrape type 2
2026-03-29 18:42:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad054cd1-62a1-5d06-a4b6-e136f1036163, identifier: MN48285
2026-03-29 18:42:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad054cd1-62a1-5d06-a4b6-e136f1036163 with identifier: MN48285
2026-03-29 18:42:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad054cd1-62a1-5d06-a4b6-e136f1036163 with identifier: MN48285
2026-03-29 18:42:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad054cd1-62a1-5d06-a4b6-e136f1036163 with identifier: MN48285 to the API
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:40:14Z',
'fuel_type': 'petrol',
'id': 'ad054cd1-62a1-5d06-a4b6-e136f1036163',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN48285',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 24838,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-21',
'seller_name': None,
'title': 'Volkswagen T-Cross 1.0 TSI Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2019}
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN48285%27 HTTP/1.1" 200 None
2026-03-29 18:42:12 [auto1.de] INFO: Saving data for MN48285: {'auction_closing_time': 1774885214.0, 'created_time': 1774118869.985095, 'last_price_update_time': 1774809732.887022}
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN48285') HTTP/1.1" 204 0
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY50059%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Scrape type for SY50059: 0
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF62684%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Scrape type for FF62684: 2
2026-03-29 18:42:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 215e824f-a442-5a7a-b2ec-75faf13aca6f with identifier: FF62684
2026-03-29 18:42:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 215e824f-a442-5a7a-b2ec-75faf13aca6f with scrape type 2
2026-03-29 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 215e824f-a442-5a7a-b2ec-75faf13aca6f with scrape type 2
2026-03-29 18:42:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 215e824f-a442-5a7a-b2ec-75faf13aca6f, identifier: FF62684
2026-03-29 18:42:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 215e824f-a442-5a7a-b2ec-75faf13aca6f with identifier: FF62684
2026-03-29 18:42:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 215e824f-a442-5a7a-b2ec-75faf13aca6f with identifier: FF62684
2026-03-29 18:42:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 215e824f-a442-5a7a-b2ec-75faf13aca6f with identifier: FF62684 to the API
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:46:48Z',
'fuel_type': 'petrol',
'id': '215e824f-a442-5a7a-b2ec-75faf13aca6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF62684',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 103952,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-27',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Beats',
'transmission': 'manual',
'trim': 'Beats',
'year': 2016}
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF62684%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Saving data for FF62684: {'auction_closing_time': 1774885608.0, 'created_time': 1773859767.788987, 'last_price_update_time': 1774809733.455226}
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF62684') HTTP/1.1" 204 0
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP24406%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Scrape type for PP24406: 0
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72093%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Scrape type for MZ72093: 2
2026-03-29 18:42:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffd932ac-a650-5134-891f-2570af428783 with identifier: MZ72093
2026-03-29 18:42:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffd932ac-a650-5134-891f-2570af428783 with scrape type 2
2026-03-29 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffd932ac-a650-5134-891f-2570af428783 with scrape type 2
2026-03-29 18:42:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffd932ac-a650-5134-891f-2570af428783, identifier: MZ72093
2026-03-29 18:42:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffd932ac-a650-5134-891f-2570af428783 with identifier: MZ72093
2026-03-29 18:42:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffd932ac-a650-5134-891f-2570af428783 with identifier: MZ72093
2026-03-29 18:42:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffd932ac-a650-5134-891f-2570af428783 with identifier: MZ72093 to the API
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:09:28Z',
'fuel_type': 'diesel',
'id': 'ffd932ac-a650-5134-891f-2570af428783',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ72093',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 218488,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-13',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Join',
'transmission': 'automatic',
'trim': 'Join',
'year': 2019}
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72093%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Saving data for MZ72093: {'auction_closing_time': 1774883368.0, 'created_time': 1774636304.219324, 'last_price_update_time': 1774809733.879072}
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ72093') HTTP/1.1" 204 0
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM50450%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Scrape type for FM50450: 0
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77095%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Scrape type for TB77095: 0
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB40017%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Scrape type for YB40017: 2
2026-03-29 18:42:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62335a8b-68e1-5bb9-af11-29207488c39c with identifier: YB40017
2026-03-29 18:42:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62335a8b-68e1-5bb9-af11-29207488c39c with scrape type 2
2026-03-29 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62335a8b-68e1-5bb9-af11-29207488c39c with scrape type 2
2026-03-29 18:42:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62335a8b-68e1-5bb9-af11-29207488c39c, identifier: YB40017
2026-03-29 18:42:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62335a8b-68e1-5bb9-af11-29207488c39c with identifier: YB40017
2026-03-29 18:42:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62335a8b-68e1-5bb9-af11-29207488c39c with identifier: YB40017
2026-03-29 18:42:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62335a8b-68e1-5bb9-af11-29207488c39c with identifier: YB40017 to the API
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:12:14Z',
'fuel_type': 'petrol',
'id': '62335a8b-68e1-5bb9-af11-29207488c39c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB40017',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 124323,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-18',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2015}
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB40017%27 HTTP/1.1" 200 None
2026-03-29 18:42:14 [auto1.de] INFO: Saving data for YB40017: {'auction_closing_time': 1774883534.0, 'created_time': 1774608287.495337, 'last_price_update_time': 1774809734.380615}
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB40017') HTTP/1.1" 204 0
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71363%27 HTTP/1.1" 200 None
2026-03-29 18:42:14 [auto1.de] INFO: Scrape type for HL71363: 2
2026-03-29 18:42:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed3b527b-ba2e-5a21-947c-98087d16aa66 with identifier: HL71363
2026-03-29 18:42:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed3b527b-ba2e-5a21-947c-98087d16aa66 with scrape type 2
2026-03-29 18:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed3b527b-ba2e-5a21-947c-98087d16aa66 with scrape type 2
2026-03-29 18:42:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed3b527b-ba2e-5a21-947c-98087d16aa66, identifier: HL71363
2026-03-29 18:42:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed3b527b-ba2e-5a21-947c-98087d16aa66 with identifier: HL71363
2026-03-29 18:42:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed3b527b-ba2e-5a21-947c-98087d16aa66 with identifier: HL71363
2026-03-29 18:42:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed3b527b-ba2e-5a21-947c-98087d16aa66 with identifier: HL71363 to the API
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:31:37Z',
'fuel_type': 'diesel',
'id': 'ed3b527b-ba2e-5a21-947c-98087d16aa66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL71363',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 137709,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-06',
'seller_name': None,
'title': 'Seat Ateca 2.0 TDI Xcellence 4Drive',
'transmission': 'automatic',
'trim': 'Xcellence 4Drive',
'year': 2018}
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71363%27 HTTP/1.1" 200 None
2026-03-29 18:42:14 [auto1.de] INFO: Saving data for HL71363: {'auction_closing_time': 1774884697.0, 'created_time': 1773137201.201656, 'last_price_update_time': 1774809734.824519}
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL71363') HTTP/1.1" 204 0
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ89308%27 HTTP/1.1" 200 None
2026-03-29 18:42:14 [auto1.de] INFO: Scrape type for FZ89308: 2
2026-03-29 18:42:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with identifier: FZ89308
2026-03-29 18:42:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with scrape type 2
2026-03-29 18:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with scrape type 2
2026-03-29 18:42:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a58b375-3a87-59f9-ae00-7f403ab98cf2, identifier: FZ89308
2026-03-29 18:42:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with identifier: FZ89308
2026-03-29 18:42:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with identifier: FZ89308
2026-03-29 18:42:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with identifier: FZ89308 to the API
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 380,
'expiration_date': '2026-03-30T15:24:12Z',
'fuel_type': 'petrol',
'id': '1a58b375-3a87-59f9-ae00-7f403ab98cf2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ89308',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 90524,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-24',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 45 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2015}
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ89308%27 HTTP/1.1" 200 None
2026-03-29 18:42:15 [auto1.de] INFO: Saving data for FZ89308: {'auction_closing_time': 1774884252.0, 'created_time': 1773402633.913659, 'last_price_update_time': 1774809735.348999}
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ89308') HTTP/1.1" 204 0
2026-03-29 18:42:15 [auto1.de] INFO: Found listing with ID: US92808
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US92808%27 HTTP/1.1" 200 None
2026-03-29 18:42:15 [auto1.de] INFO: Scrape type for US92808: 2
2026-03-29 18:42:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 043cb944-7be5-5ff5-b28d-fe814ebeef02 with identifier: US92808
2026-03-29 18:42:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043cb944-7be5-5ff5-b28d-fe814ebeef02 with scrape type 2
2026-03-29 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 043cb944-7be5-5ff5-b28d-fe814ebeef02 with scrape type 2
2026-03-29 18:42:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 043cb944-7be5-5ff5-b28d-fe814ebeef02, identifier: US92808
2026-03-29 18:42:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 043cb944-7be5-5ff5-b28d-fe814ebeef02 with identifier: US92808
2026-03-29 18:42:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 043cb944-7be5-5ff5-b28d-fe814ebeef02 with identifier: US92808
2026-03-29 18:42:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 043cb944-7be5-5ff5-b28d-fe814ebeef02 with identifier: US92808 to the API
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:26:16Z',
'fuel_type': 'petrol',
'id': '043cb944-7be5-5ff5-b28d-fe814ebeef02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US92808',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 137176,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-24',
'seller_name': None,
'title': 'Seat Alhambra 1.4 TSI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2013}
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US92808%27 HTTP/1.1" 200 None
2026-03-29 18:42:15 [auto1.de] INFO: Saving data for US92808: {'auction_closing_time': 1774884376.0, 'created_time': 1774264926.92802, 'last_price_update_time': 1774809735.798268}
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US92808') HTTP/1.1" 204 0
2026-03-29 18:42:15 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-29 18:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:15 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:15 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-29 18:42:15 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-29 18:42:15 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-29 18:42:15 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG17640%27 HTTP/1.1" 200 None
2026-03-29 18:42:15 [auto1.de] INFO: Scrape type for SG17640: 2
2026-03-29 18:42:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d24fdf72-8f38-5f2a-8daf-4114237b5712 with identifier: SG17640
2026-03-29 18:42:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d24fdf72-8f38-5f2a-8daf-4114237b5712 with scrape type 2
2026-03-29 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d24fdf72-8f38-5f2a-8daf-4114237b5712 with scrape type 2
2026-03-29 18:42:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d24fdf72-8f38-5f2a-8daf-4114237b5712, identifier: SG17640
2026-03-29 18:42:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d24fdf72-8f38-5f2a-8daf-4114237b5712 with identifier: SG17640
2026-03-29 18:42:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d24fdf72-8f38-5f2a-8daf-4114237b5712 with identifier: SG17640
2026-03-29 18:42:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d24fdf72-8f38-5f2a-8daf-4114237b5712 with identifier: SG17640 to the API
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:57:16Z',
'fuel_type': 'petrol',
'id': 'd24fdf72-8f38-5f2a-8daf-4114237b5712',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG17640',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 77728,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-05',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2017}
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG17640%27 HTTP/1.1" 200 None
2026-03-29 18:42:16 [auto1.de] INFO: Saving data for SG17640: {'auction_closing_time': 1774886236.0, 'created_time': 1773306899.596154, 'last_price_update_time': 1774809736.363776}
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG17640') HTTP/1.1" 204 0
2026-03-29 18:42:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27642%27 HTTP/1.1" 200 None
2026-03-29 18:42:16 [auto1.de] INFO: Scrape type for WW27642: 2
2026-03-29 18:42:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51543cbd-6818-59ad-b179-5923b3e80ac4 with identifier: WW27642
2026-03-29 18:42:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51543cbd-6818-59ad-b179-5923b3e80ac4 with scrape type 2
2026-03-29 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51543cbd-6818-59ad-b179-5923b3e80ac4 with scrape type 2
2026-03-29 18:42:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51543cbd-6818-59ad-b179-5923b3e80ac4, identifier: WW27642
2026-03-29 18:42:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51543cbd-6818-59ad-b179-5923b3e80ac4 with identifier: WW27642
2026-03-29 18:42:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51543cbd-6818-59ad-b179-5923b3e80ac4 with identifier: WW27642
2026-03-29 18:42:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51543cbd-6818-59ad-b179-5923b3e80ac4 with identifier: WW27642 to the API
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:52:41Z',
'fuel_type': 'diesel',
'id': '51543cbd-6818-59ad-b179-5923b3e80ac4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW27642',
'listing': 'auction',
'make': 'Volvo',
'model': 'V50',
'odometer': 401344,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-31',
'seller_name': None,
'title': 'Volvo V50 2.0 D3 Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2012}
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27642%27 HTTP/1.1" 200 None
2026-03-29 18:42:16 [auto1.de] INFO: Saving data for WW27642: {'auction_closing_time': 1774885961.0, 'created_time': 1773402631.432604, 'last_price_update_time': 1774809736.772148}
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW27642') HTTP/1.1" 204 0
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC18235%27 HTTP/1.1" 200 None
2026-03-29 18:42:16 [auto1.de] INFO: Scrape type for JC18235: 2
2026-03-29 18:42:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88ca809-2852-5afb-b963-f5e0ce351df4 with identifier: JC18235
2026-03-29 18:42:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88ca809-2852-5afb-b963-f5e0ce351df4 with scrape type 2
2026-03-29 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e88ca809-2852-5afb-b963-f5e0ce351df4 with scrape type 2
2026-03-29 18:42:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e88ca809-2852-5afb-b963-f5e0ce351df4, identifier: JC18235
2026-03-29 18:42:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e88ca809-2852-5afb-b963-f5e0ce351df4 with identifier: JC18235
2026-03-29 18:42:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e88ca809-2852-5afb-b963-f5e0ce351df4 with identifier: JC18235
2026-03-29 18:42:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e88ca809-2852-5afb-b963-f5e0ce351df4 with identifier: JC18235 to the API
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:10:49Z',
'fuel_type': 'diesel',
'id': 'e88ca809-2852-5afb-b963-f5e0ce351df4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC18235',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 154106,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-09-30',
'seller_name': None,
'title': 'Ford Transit 2.0 TDE FT 300 Kurz',
'transmission': 'manual',
'trim': 'FT 300 Kurz',
'year': 2004}
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC18235%27 HTTP/1.1" 200 None
2026-03-29 18:42:17 [auto1.de] INFO: Saving data for JC18235: {'auction_closing_time': 1774883449.0, 'created_time': 1774522280.986612, 'last_price_update_time': 1774809737.271595}
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC18235') HTTP/1.1" 204 0
2026-03-29 18:42:17 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-29 18:42:17 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51050%27 HTTP/1.1" 200 None
2026-03-29 18:42:17 [auto1.de] INFO: Scrape type for SM51050: 2
2026-03-29 18:42:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 879cd69e-6018-5cec-839c-86b90860c660 with identifier: SM51050
2026-03-29 18:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 879cd69e-6018-5cec-839c-86b90860c660 with scrape type 2
2026-03-29 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 879cd69e-6018-5cec-839c-86b90860c660 with scrape type 2
2026-03-29 18:42:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 879cd69e-6018-5cec-839c-86b90860c660, identifier: SM51050
2026-03-29 18:42:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 879cd69e-6018-5cec-839c-86b90860c660 with identifier: SM51050
2026-03-29 18:42:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 879cd69e-6018-5cec-839c-86b90860c660 with identifier: SM51050
2026-03-29 18:42:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 879cd69e-6018-5cec-839c-86b90860c660 with identifier: SM51050 to the API
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:20:38Z',
'fuel_type': 'diesel',
'id': '879cd69e-6018-5cec-839c-86b90860c660',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM51050',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 222193,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-02',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2015}
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51050%27 HTTP/1.1" 200 None
2026-03-29 18:42:17 [auto1.de] INFO: Saving data for SM51050: {'auction_closing_time': 1774884038.0, 'created_time': 1774521347.413869, 'last_price_update_time': 1774809737.693164}
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM51050') HTTP/1.1" 204 0
2026-03-29 18:42:17 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52276%27 HTTP/1.1" 200 None
2026-03-29 18:42:17 [auto1.de] INFO: Scrape type for RS52276: 2
2026-03-29 18:42:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with identifier: RS52276
2026-03-29 18:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with scrape type 2
2026-03-29 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with scrape type 2
2026-03-29 18:42:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a1ef24b-0de9-5da0-97e9-5b85172f74c7, identifier: RS52276
2026-03-29 18:42:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with identifier: RS52276
2026-03-29 18:42:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with identifier: RS52276
2026-03-29 18:42:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with identifier: RS52276 to the API
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:24:59Z',
'fuel_type': 'diesel',
'id': '5a1ef24b-0de9-5da0-97e9-5b85172f74c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS52276',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 138688,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-21',
'seller_name': None,
'title': 'Nissan Juke 1.5 Turbodiesel N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2018}
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52276%27 HTTP/1.1" 200 None
2026-03-29 18:42:18 [auto1.de] INFO: Saving data for RS52276: {'auction_closing_time': 1774884299.0, 'created_time': 1773686860.273271, 'last_price_update_time': 1774809738.157088}
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS52276') HTTP/1.1" 204 0
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY51453%27 HTTP/1.1" 200 None
2026-03-29 18:42:18 [auto1.de] INFO: Scrape type for EY51453: 0
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12091%27 HTTP/1.1" 200 None
2026-03-29 18:42:18 [auto1.de] INFO: Scrape type for HP12091: 2
2026-03-29 18:42:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e81ed744-89ee-5f5f-811c-d7066ab082ff with identifier: HP12091
2026-03-29 18:42:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e81ed744-89ee-5f5f-811c-d7066ab082ff with scrape type 2
2026-03-29 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e81ed744-89ee-5f5f-811c-d7066ab082ff with scrape type 2
2026-03-29 18:42:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e81ed744-89ee-5f5f-811c-d7066ab082ff, identifier: HP12091
2026-03-29 18:42:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e81ed744-89ee-5f5f-811c-d7066ab082ff with identifier: HP12091
2026-03-29 18:42:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e81ed744-89ee-5f5f-811c-d7066ab082ff with identifier: HP12091
2026-03-29 18:42:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e81ed744-89ee-5f5f-811c-d7066ab082ff with identifier: HP12091 to the API
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:34:06Z',
'fuel_type': 'diesel',
'id': 'e81ed744-89ee-5f5f-811c-d7066ab082ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP12091',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 180046,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-03',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi Vision 4WD',
'transmission': 'automatic',
'trim': 'Vision 4WD',
'year': 2011}
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12091%27 HTTP/1.1" 200 None
2026-03-29 18:42:18 [auto1.de] INFO: Saving data for HP12091: {'auction_closing_time': 1774884846.0, 'created_time': 1773304933.369629, 'last_price_update_time': 1774809738.613934}
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP12091') HTTP/1.1" 204 0
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02075%27 HTTP/1.1" 200 None
2026-03-29 18:42:18 [auto1.de] INFO: Scrape type for SJ02075: 2
2026-03-29 18:42:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec67ed56-0091-57b5-bfad-1c365132b915 with identifier: SJ02075
2026-03-29 18:42:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec67ed56-0091-57b5-bfad-1c365132b915 with scrape type 2
2026-03-29 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec67ed56-0091-57b5-bfad-1c365132b915 with scrape type 2
2026-03-29 18:42:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec67ed56-0091-57b5-bfad-1c365132b915, identifier: SJ02075
2026-03-29 18:42:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec67ed56-0091-57b5-bfad-1c365132b915 with identifier: SJ02075
2026-03-29 18:42:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec67ed56-0091-57b5-bfad-1c365132b915 with identifier: SJ02075
2026-03-29 18:42:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec67ed56-0091-57b5-bfad-1c365132b915 with identifier: SJ02075 to the API
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:13:32Z',
'fuel_type': 'diesel',
'id': 'ec67ed56-0091-57b5-bfad-1c365132b915',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ02075',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 186241,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-09',
'seller_name': None,
'title': 'BMW 1er 123d',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02075%27 HTTP/1.1" 200 None
2026-03-29 18:42:19 [auto1.de] INFO: Saving data for SJ02075: {'auction_closing_time': 1774883612.0, 'created_time': 1773305763.373075, 'last_price_update_time': 1774809739.104563}
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ02075') HTTP/1.1" 204 0
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT88605%27 HTTP/1.1" 200 None
2026-03-29 18:42:19 [auto1.de] INFO: Scrape type for NT88605: 0
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ60236%27 HTTP/1.1" 200 None
2026-03-29 18:42:19 [auto1.de] INFO: Scrape type for KJ60236: 0
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37620%27 HTTP/1.1" 200 None
2026-03-29 18:42:19 [auto1.de] INFO: Scrape type for JV37620: 2
2026-03-29 18:42:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48682df9-ad7a-598c-bbfe-9eca263cfed2 with identifier: JV37620
2026-03-29 18:42:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48682df9-ad7a-598c-bbfe-9eca263cfed2 with scrape type 2
2026-03-29 18:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48682df9-ad7a-598c-bbfe-9eca263cfed2 with scrape type 2
2026-03-29 18:42:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48682df9-ad7a-598c-bbfe-9eca263cfed2, identifier: JV37620
2026-03-29 18:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48682df9-ad7a-598c-bbfe-9eca263cfed2 with identifier: JV37620
2026-03-29 18:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48682df9-ad7a-598c-bbfe-9eca263cfed2 with identifier: JV37620
2026-03-29 18:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48682df9-ad7a-598c-bbfe-9eca263cfed2 with identifier: JV37620 to the API
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:19:17Z',
'fuel_type': 'diesel',
'id': '48682df9-ad7a-598c-bbfe-9eca263cfed2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV37620',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 246377,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-23',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2017}
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37620%27 HTTP/1.1" 200 None
2026-03-29 18:42:19 [auto1.de] INFO: Saving data for JV37620: {'auction_closing_time': 1774883957.0, 'created_time': 1773305735.521012, 'last_price_update_time': 1774809739.676259}
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV37620') HTTP/1.1" 204 0
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE90964%27 HTTP/1.1" 200 None
2026-03-29 18:42:19 [auto1.de] INFO: Scrape type for UE90964: 0
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: JG45711
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG45711%27 HTTP/1.1" 200 None
2026-03-29 18:42:19 [auto1.de] INFO: Scrape type for JG45711: 2
2026-03-29 18:42:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 046527bb-f8cc-54ae-9dab-cfb21ba8abb8 with identifier: JG45711
2026-03-29 18:42:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 046527bb-f8cc-54ae-9dab-cfb21ba8abb8 with scrape type 2
2026-03-29 18:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 046527bb-f8cc-54ae-9dab-cfb21ba8abb8 with scrape type 2
2026-03-29 18:42:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 046527bb-f8cc-54ae-9dab-cfb21ba8abb8, identifier: JG45711
2026-03-29 18:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 046527bb-f8cc-54ae-9dab-cfb21ba8abb8 with identifier: JG45711
2026-03-29 18:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 046527bb-f8cc-54ae-9dab-cfb21ba8abb8 with identifier: JG45711
2026-03-29 18:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 046527bb-f8cc-54ae-9dab-cfb21ba8abb8 with identifier: JG45711 to the API
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:59:21Z',
'fuel_type': 'diesel',
'id': '046527bb-f8cc-54ae-9dab-cfb21ba8abb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG45711',
'listing': 'auction',
'make': 'Fiat',
'model': 'Ducato',
'odometer': 119132,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-02-24',
'seller_name': None,
'title': 'Fiat Ducato 2.2 JTD 100',
'transmission': 'manual',
'trim': '100',
'year': 2008}
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG45711%27 HTTP/1.1" 200 None
2026-03-29 18:42:20 [auto1.de] INFO: Saving data for JG45711: {'auction_closing_time': 1774886361.0, 'created_time': 1773991278.76183, 'last_price_update_time': 1774809740.131207}
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG45711') HTTP/1.1" 204 0
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH30739%27 HTTP/1.1" 200 None
2026-03-29 18:42:20 [auto1.de] INFO: Scrape type for LH30739: 2
2026-03-29 18:42:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92fce3e4-2fd1-5e43-bba4-773faf4c8b55 with identifier: LH30739
2026-03-29 18:42:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92fce3e4-2fd1-5e43-bba4-773faf4c8b55 with scrape type 2
2026-03-29 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92fce3e4-2fd1-5e43-bba4-773faf4c8b55 with scrape type 2
2026-03-29 18:42:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92fce3e4-2fd1-5e43-bba4-773faf4c8b55, identifier: LH30739
2026-03-29 18:42:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92fce3e4-2fd1-5e43-bba4-773faf4c8b55 with identifier: LH30739
2026-03-29 18:42:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92fce3e4-2fd1-5e43-bba4-773faf4c8b55 with identifier: LH30739
2026-03-29 18:42:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92fce3e4-2fd1-5e43-bba4-773faf4c8b55 with identifier: LH30739 to the API
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 249,
'expiration_date': '2026-03-30T15:47:52Z',
'fuel_type': 'diesel',
'id': '92fce3e4-2fd1-5e43-bba4-773faf4c8b55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH30739',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 122455,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-17',
'seller_name': None,
'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Momentum Pro AWD',
'transmission': 'automatic',
'trim': 'Momentum Pro AWD',
'year': 2019}
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH30739%27 HTTP/1.1" 200 None
2026-03-29 18:42:20 [auto1.de] INFO: Saving data for LH30739: {'auction_closing_time': 1774885672.0, 'created_time': 1774522376.357835, 'last_price_update_time': 1774809740.664454}
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH30739') HTTP/1.1" 204 0
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48459%27 HTTP/1.1" 200 None
2026-03-29 18:42:20 [auto1.de] INFO: Scrape type for WS48459: 0
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY09817%27 HTTP/1.1" 200 None
2026-03-29 18:42:20 [auto1.de] INFO: Scrape type for NY09817: 2
2026-03-29 18:42:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with identifier: NY09817
2026-03-29 18:42:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with scrape type 2
2026-03-29 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with scrape type 2
2026-03-29 18:42:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 957d5b54-b9d7-5f17-9a31-2ece5d6101a4, identifier: NY09817
2026-03-29 18:42:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with identifier: NY09817
2026-03-29 18:42:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with identifier: NY09817
2026-03-29 18:42:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with identifier: NY09817 to the API
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:05:03Z',
'fuel_type': 'petrol',
'id': '957d5b54-b9d7-5f17-9a31-2ece5d6101a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY09817',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 167683,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-03',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.5 TSI ACT Carat BlueMotion',
'transmission': 'automatic',
'trim': 'Carat BlueMotion',
'year': 2018}
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY09817%27 HTTP/1.1" 200 None
2026-03-29 18:42:21 [auto1.de] INFO: Saving data for NY09817: {'auction_closing_time': 1774883103.0, 'created_time': 1774608037.358498, 'last_price_update_time': 1774809741.15661}
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY09817') HTTP/1.1" 204 0
2026-03-29 18:42:21 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:21 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP54088%27 HTTP/1.1" 200 None
2026-03-29 18:42:21 [auto1.de] INFO: Scrape type for DP54088: 0
2026-03-29 18:42:21 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL69510%27 HTTP/1.1" 200 None
2026-03-29 18:42:21 [auto1.de] INFO: Scrape type for TL69510: 2
2026-03-29 18:42:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f972975e-5b75-5849-b630-26553e6dd0d5 with identifier: TL69510
2026-03-29 18:42:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f972975e-5b75-5849-b630-26553e6dd0d5 with scrape type 2
2026-03-29 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f972975e-5b75-5849-b630-26553e6dd0d5 with scrape type 2
2026-03-29 18:42:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f972975e-5b75-5849-b630-26553e6dd0d5, identifier: TL69510
2026-03-29 18:42:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f972975e-5b75-5849-b630-26553e6dd0d5 with identifier: TL69510
2026-03-29 18:42:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f972975e-5b75-5849-b630-26553e6dd0d5 with identifier: TL69510
2026-03-29 18:42:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f972975e-5b75-5849-b630-26553e6dd0d5 with identifier: TL69510 to the API
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:16:33Z',
'fuel_type': 'diesel',
'id': 'f972975e-5b75-5849-b630-26553e6dd0d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL69510',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 70004,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-06',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi 340 L1 Trail',
'transmission': 'manual',
'trim': '340 L1 Trail',
'year': 2022}
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL69510%27 HTTP/1.1" 200 None
2026-03-29 18:42:21 [auto1.de] INFO: Saving data for TL69510: {'auction_closing_time': 1774883793.0, 'created_time': 1773426861.937701, 'last_price_update_time': 1774809741.700742}
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL69510') HTTP/1.1" 204 0
2026-03-29 18:42:21 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-29 18:42:21 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-29 18:42:21 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-29 18:42:21 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-29 18:42:21 [auto1.de] INFO: Scrape type for XN32134: 2
2026-03-29 18:42:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with identifier: XN32134
2026-03-29 18:42:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with scrape type 2
2026-03-29 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with scrape type 2
2026-03-29 18:42:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d, identifier: XN32134
2026-03-29 18:42:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with identifier: XN32134
2026-03-29 18:42:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with identifier: XN32134
2026-03-29 18:42:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with identifier: XN32134 to the API
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:11:55Z',
'fuel_type': 'petrol',
'id': '40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN32134',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 55805,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-27',
'seller_name': None,
'title': 'Kia Sportage 2.0 LX 2WD',
'transmission': 'manual',
'trim': 'LX 2WD',
'year': 2009}
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-29 18:42:22 [auto1.de] INFO: Saving data for XN32134: {'auction_closing_time': 1774883515.0, 'created_time': 1774290706.952195, 'last_price_update_time': 1774809742.139501}
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN32134') HTTP/1.1" 204 0
2026-03-29 18:42:22 [auto1.de] INFO: Found listing with ID: PC42452
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42452%27 HTTP/1.1" 200 None
2026-03-29 18:42:22 [auto1.de] INFO: Scrape type for PC42452: 2
2026-03-29 18:42:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7990960-29d4-5cc7-81ec-de117496537c with identifier: PC42452
2026-03-29 18:42:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7990960-29d4-5cc7-81ec-de117496537c with scrape type 2
2026-03-29 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7990960-29d4-5cc7-81ec-de117496537c with scrape type 2
2026-03-29 18:42:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7990960-29d4-5cc7-81ec-de117496537c, identifier: PC42452
2026-03-29 18:42:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7990960-29d4-5cc7-81ec-de117496537c with identifier: PC42452
2026-03-29 18:42:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7990960-29d4-5cc7-81ec-de117496537c with identifier: PC42452
2026-03-29 18:42:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7990960-29d4-5cc7-81ec-de117496537c with identifier: PC42452 to the API
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:49:21Z',
'fuel_type': 'petrol',
'id': 'f7990960-29d4-5cc7-81ec-de117496537c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC42452',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 67792,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-28',
'seller_name': None,
'title': 'BMW 2er 218i Gran Coupe M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2022}
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42452%27 HTTP/1.1" 200 None
2026-03-29 18:42:22 [auto1.de] INFO: Saving data for PC42452: {'auction_closing_time': 1774885761.0, 'created_time': 1774349388.445346, 'last_price_update_time': 1774809742.567235}
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC42452') HTTP/1.1" 204 0
2026-03-29 18:42:22 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-29 18:42:22 [auto1.de] INFO: Scrape type for EC38320: 2
2026-03-29 18:42:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a6a751a-545c-5e48-a2ef-e082675a23e7 with identifier: EC38320
2026-03-29 18:42:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a6a751a-545c-5e48-a2ef-e082675a23e7 with scrape type 2
2026-03-29 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a6a751a-545c-5e48-a2ef-e082675a23e7 with scrape type 2
2026-03-29 18:42:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a6a751a-545c-5e48-a2ef-e082675a23e7, identifier: EC38320
2026-03-29 18:42:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a6a751a-545c-5e48-a2ef-e082675a23e7 with identifier: EC38320
2026-03-29 18:42:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a6a751a-545c-5e48-a2ef-e082675a23e7 with identifier: EC38320
2026-03-29 18:42:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a6a751a-545c-5e48-a2ef-e082675a23e7 with identifier: EC38320 to the API
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:15:17Z',
'fuel_type': 'petrol',
'id': '6a6a751a-545c-5e48-a2ef-e082675a23e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC38320',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 126278,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-23',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 THP Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2016}
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-29 18:42:23 [auto1.de] INFO: Saving data for EC38320: {'auction_closing_time': 1774883717.0, 'created_time': 1774290672.439097, 'last_price_update_time': 1774809743.175706}
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC38320') HTTP/1.1" 204 0
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH26863%27 HTTP/1.1" 200 None
2026-03-29 18:42:23 [auto1.de] INFO: Scrape type for YH26863: 2
2026-03-29 18:42:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8edb4f8-105f-5624-9893-056650b72f2b with identifier: YH26863
2026-03-29 18:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8edb4f8-105f-5624-9893-056650b72f2b with scrape type 2
2026-03-29 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8edb4f8-105f-5624-9893-056650b72f2b with scrape type 2
2026-03-29 18:42:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8edb4f8-105f-5624-9893-056650b72f2b, identifier: YH26863
2026-03-29 18:42:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8edb4f8-105f-5624-9893-056650b72f2b with identifier: YH26863
2026-03-29 18:42:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8edb4f8-105f-5624-9893-056650b72f2b with identifier: YH26863
2026-03-29 18:42:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8edb4f8-105f-5624-9893-056650b72f2b with identifier: YH26863 to the API
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:57:41Z',
'fuel_type': 'petrol',
'id': 'e8edb4f8-105f-5624-9893-056650b72f2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH26863',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 113386,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-07',
'seller_name': None,
'title': 'Ford S-Max 1.5 EcoBoost ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2018}
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH26863%27 HTTP/1.1" 200 None
2026-03-29 18:42:23 [auto1.de] INFO: Saving data for YH26863: {'auction_closing_time': 1774886261.0, 'created_time': 1773402357.088851, 'last_price_update_time': 1774809743.651185}
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH26863') HTTP/1.1" 204 0
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA30893%27 HTTP/1.1" 200 None
2026-03-29 18:42:23 [auto1.de] INFO: Scrape type for TA30893: 0
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH72575%27 HTTP/1.1" 200 None
2026-03-29 18:42:23 [auto1.de] INFO: Scrape type for DH72575: 0
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84583%27 HTTP/1.1" 200 None
2026-03-29 18:42:23 [auto1.de] INFO: Scrape type for NV84583: 0
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER69054%27 HTTP/1.1" 200 None
2026-03-29 18:42:23 [auto1.de] INFO: Scrape type for ER69054: 0
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP40831%27 HTTP/1.1" 200 None
2026-03-29 18:42:23 [auto1.de] INFO: Scrape type for UP40831: 0
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY98084%27 HTTP/1.1" 200 None
2026-03-29 18:42:23 [auto1.de] INFO: Scrape type for UY98084: 0
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY46967%27 HTTP/1.1" 200 None
2026-03-29 18:42:23 [auto1.de] INFO: Scrape type for FY46967: 0
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB38942%27 HTTP/1.1" 200 None
2026-03-29 18:42:23 [auto1.de] INFO: Scrape type for WB38942: 2
2026-03-29 18:42:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with identifier: WB38942
2026-03-29 18:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with scrape type 2
2026-03-29 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with scrape type 2
2026-03-29 18:42:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab, identifier: WB38942
2026-03-29 18:42:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with identifier: WB38942
2026-03-29 18:42:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with identifier: WB38942
2026-03-29 18:42:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with identifier: WB38942 to the API
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:45:41Z',
'fuel_type': 'diesel',
'id': '2d45d5e5-db05-5086-b7f8-c10b9b19e8ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB38942',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 353125,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-23',
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
'transmission': 'automatic',
'trim': 'BlueMotion',
'year': 2012}
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB38942%27 HTTP/1.1" 200 None
2026-03-29 18:42:24 [auto1.de] INFO: Saving data for WB38942: {'auction_closing_time': 1774885541.0, 'created_time': 1773830331.780469, 'last_price_update_time': 1774809744.218504}
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB38942') HTTP/1.1" 204 0
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50752%27 HTTP/1.1" 200 None
2026-03-29 18:42:24 [auto1.de] INFO: Scrape type for XS50752: 0
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR98326%27 HTTP/1.1" 200 None
2026-03-29 18:42:24 [auto1.de] INFO: Scrape type for LR98326: 0
2026-03-29 18:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:24 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-29 18:42:24 [auto1.de] INFO: Scrape type for PL89727: 2
2026-03-29 18:42:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with identifier: PL89727
2026-03-29 18:42:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with scrape type 2
2026-03-29 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with scrape type 2
2026-03-29 18:42:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7bb5e19-d667-5aa4-b5b4-efe0be29c07b, identifier: PL89727
2026-03-29 18:42:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with identifier: PL89727
2026-03-29 18:42:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with identifier: PL89727
2026-03-29 18:42:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with identifier: PL89727 to the API
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 195,
'expiration_date': '2026-03-30T15:03:41Z',
'fuel_type': 'diesel',
'id': 'a7bb5e19-d667-5aa4-b5b4-efe0be29c07b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL89727',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 99632,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-27',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2017}
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-29 18:42:25 [auto1.de] INFO: Saving data for PL89727: {'auction_closing_time': 1774883021.0, 'created_time': 1773400140.066234, 'last_price_update_time': 1774809745.178228}
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL89727') HTTP/1.1" 204 0
2026-03-29 18:42:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:25 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD34588%27 HTTP/1.1" 200 None
2026-03-29 18:42:25 [auto1.de] INFO: Scrape type for WD34588: 0
2026-03-29 18:42:25 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU96107%27 HTTP/1.1" 200 None
2026-03-29 18:42:25 [auto1.de] INFO: Scrape type for DU96107: 2
2026-03-29 18:42:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with identifier: DU96107
2026-03-29 18:42:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with scrape type 2
2026-03-29 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with scrape type 2
2026-03-29 18:42:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 431d12da-7f3a-5e79-942f-3b06fcca8ab7, identifier: DU96107
2026-03-29 18:42:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with identifier: DU96107
2026-03-29 18:42:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with identifier: DU96107
2026-03-29 18:42:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with identifier: DU96107 to the API
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:58:30Z',
'fuel_type': 'petrol',
'id': '431d12da-7f3a-5e79-942f-3b06fcca8ab7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU96107',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 143658,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-26',
'seller_name': None,
'title': 'Hyundai i30 1.6 GDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2012}
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU96107%27 HTTP/1.1" 200 None
2026-03-29 18:42:25 [auto1.de] INFO: Saving data for DU96107: {'auction_closing_time': 1774886310.0, 'created_time': 1773811828.120291, 'last_price_update_time': 1774809745.618061}
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU96107') HTTP/1.1" 204 0
2026-03-29 18:42:25 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28686%27 HTTP/1.1" 200 None
2026-03-29 18:42:25 [auto1.de] INFO: Scrape type for RA28686: 2
2026-03-29 18:42:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 574becf0-b859-54ae-96da-b2709a867805 with identifier: RA28686
2026-03-29 18:42:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 574becf0-b859-54ae-96da-b2709a867805 with scrape type 2
2026-03-29 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 574becf0-b859-54ae-96da-b2709a867805 with scrape type 2
2026-03-29 18:42:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 574becf0-b859-54ae-96da-b2709a867805, identifier: RA28686
2026-03-29 18:42:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 574becf0-b859-54ae-96da-b2709a867805 with identifier: RA28686
2026-03-29 18:42:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 574becf0-b859-54ae-96da-b2709a867805 with identifier: RA28686
2026-03-29 18:42:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 574becf0-b859-54ae-96da-b2709a867805 with identifier: RA28686 to the API
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:47:30Z',
'fuel_type': 'diesel',
'id': '574becf0-b859-54ae-96da-b2709a867805',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA28686',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 234099,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-18',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2014}
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28686%27 HTTP/1.1" 200 None
2026-03-29 18:42:26 [auto1.de] INFO: Saving data for RA28686: {'auction_closing_time': 1774885650.0, 'created_time': 1773427134.557706, 'last_price_update_time': 1774809746.171581}
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA28686') HTTP/1.1" 204 0
2026-03-29 18:42:26 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-29 18:42:26 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-29 18:42:26 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW90276%27 HTTP/1.1" 200 None
2026-03-29 18:42:26 [auto1.de] INFO: Scrape type for DW90276: 2
2026-03-29 18:42:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9cb8f80-896c-555d-a79d-028ef21c50ef with identifier: DW90276
2026-03-29 18:42:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9cb8f80-896c-555d-a79d-028ef21c50ef with scrape type 2
2026-03-29 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9cb8f80-896c-555d-a79d-028ef21c50ef with scrape type 2
2026-03-29 18:42:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9cb8f80-896c-555d-a79d-028ef21c50ef, identifier: DW90276
2026-03-29 18:42:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9cb8f80-896c-555d-a79d-028ef21c50ef with identifier: DW90276
2026-03-29 18:42:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9cb8f80-896c-555d-a79d-028ef21c50ef with identifier: DW90276
2026-03-29 18:42:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9cb8f80-896c-555d-a79d-028ef21c50ef with identifier: DW90276 to the API
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:07:00Z',
'fuel_type': 'diesel',
'id': 'd9cb8f80-896c-555d-a79d-028ef21c50ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW90276',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 120718,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-02',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Multivan Generation Six 4Motion',
'transmission': 'automatic',
'trim': 'Multivan Generation Six 4Motion',
'year': 2017}
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW90276%27 HTTP/1.1" 200 None
2026-03-29 18:42:26 [auto1.de] INFO: Saving data for DW90276: {'auction_closing_time': 1774883220.0, 'created_time': 1773858928.621445, 'last_price_update_time': 1774809746.63271}
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW90276') HTTP/1.1" 204 0
2026-03-29 18:42:26 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA17642%27 HTTP/1.1" 200 None
2026-03-29 18:42:26 [auto1.de] INFO: Scrape type for UA17642: 0
2026-03-29 18:42:26 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM57013%27 HTTP/1.1" 200 None
2026-03-29 18:42:26 [auto1.de] INFO: Scrape type for YM57013: 2
2026-03-29 18:42:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5964004e-ccba-5eb3-b356-c02efb1ccb3c with identifier: YM57013
2026-03-29 18:42:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c with scrape type 2
2026-03-29 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c with scrape type 2
2026-03-29 18:42:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5964004e-ccba-5eb3-b356-c02efb1ccb3c, identifier: YM57013
2026-03-29 18:42:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5964004e-ccba-5eb3-b356-c02efb1ccb3c with identifier: YM57013
2026-03-29 18:42:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5964004e-ccba-5eb3-b356-c02efb1ccb3c with identifier: YM57013
2026-03-29 18:42:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5964004e-ccba-5eb3-b356-c02efb1ccb3c with identifier: YM57013 to the API
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:10:44Z',
'fuel_type': 'diesel',
'id': '5964004e-ccba-5eb3-b356-c02efb1ccb3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM57013',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Citan',
'odometer': 211087,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-26',
'seller_name': None,
'title': 'Mercedes-Benz Citan 111 CDI lang Tourer Edition',
'transmission': 'manual',
'trim': 'lang Tourer Edition',
'year': 2017}
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM57013%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Saving data for YM57013: {'auction_closing_time': 1774883444.0, 'created_time': 1774607764.271107, 'last_price_update_time': 1774809747.098711}
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM57013') HTTP/1.1" 204 0
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH04951%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Scrape type for TH04951: 0
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF57163%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Scrape type for TF57163: 0
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA13082%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Scrape type for GA13082: 0
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68072%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Scrape type for DR68072: 0
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF61357%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Scrape type for BF61357: 0
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX15527%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Scrape type for GX15527: 2
2026-03-29 18:42:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612e31c7-00f2-5460-90f2-80f2586d9e8a with identifier: GX15527
2026-03-29 18:42:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612e31c7-00f2-5460-90f2-80f2586d9e8a with scrape type 2
2026-03-29 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612e31c7-00f2-5460-90f2-80f2586d9e8a with scrape type 2
2026-03-29 18:42:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 612e31c7-00f2-5460-90f2-80f2586d9e8a, identifier: GX15527
2026-03-29 18:42:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 612e31c7-00f2-5460-90f2-80f2586d9e8a with identifier: GX15527
2026-03-29 18:42:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 612e31c7-00f2-5460-90f2-80f2586d9e8a with identifier: GX15527
2026-03-29 18:42:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 612e31c7-00f2-5460-90f2-80f2586d9e8a with identifier: GX15527 to the API
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:08:43Z',
'fuel_type': 'petrol',
'id': '612e31c7-00f2-5460-90f2-80f2586d9e8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX15527',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 96818,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-05',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX15527%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Saving data for GX15527: {'auction_closing_time': 1774883323.0, 'created_time': 1773945776.74106, 'last_price_update_time': 1774809747.637994}
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX15527') HTTP/1.1" 204 0
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH34813%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Scrape type for MH34813: 0
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY70185%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Scrape type for XY70185: 2
2026-03-29 18:42:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4f42c70-f1cd-555e-931f-ce1c7966d398 with identifier: XY70185
2026-03-29 18:42:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4f42c70-f1cd-555e-931f-ce1c7966d398 with scrape type 2
2026-03-29 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4f42c70-f1cd-555e-931f-ce1c7966d398 with scrape type 2
2026-03-29 18:42:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4f42c70-f1cd-555e-931f-ce1c7966d398, identifier: XY70185
2026-03-29 18:42:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4f42c70-f1cd-555e-931f-ce1c7966d398 with identifier: XY70185
2026-03-29 18:42:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4f42c70-f1cd-555e-931f-ce1c7966d398 with identifier: XY70185
2026-03-29 18:42:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4f42c70-f1cd-555e-931f-ce1c7966d398 with identifier: XY70185 to the API
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:51:29Z',
'fuel_type': 'diesel',
'id': 'b4f42c70-f1cd-555e-931f-ce1c7966d398',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY70185',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 153718,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-01',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Style Plus',
'transmission': 'automatic',
'trim': 'Style Plus',
'year': 2016}
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY70185%27 HTTP/1.1" 200 None
2026-03-29 18:42:28 [auto1.de] INFO: Saving data for XY70185: {'auction_closing_time': 1774885889.0, 'created_time': 1773830936.852536, 'last_price_update_time': 1774809748.21188}
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY70185') HTTP/1.1" 204 0
2026-03-29 18:42:28 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-29 18:42:28 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-29 18:42:28 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY99054%27 HTTP/1.1" 200 None
2026-03-29 18:42:28 [auto1.de] INFO: Scrape type for MY99054: 0
2026-03-29 18:42:28 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP67164%27 HTTP/1.1" 200 None
2026-03-29 18:42:28 [auto1.de] INFO: Scrape type for LP67164: 2
2026-03-29 18:42:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b22a011-37d1-58d3-830f-3caee704e09f with identifier: LP67164
2026-03-29 18:42:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b22a011-37d1-58d3-830f-3caee704e09f with scrape type 2
2026-03-29 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b22a011-37d1-58d3-830f-3caee704e09f with scrape type 2
2026-03-29 18:42:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b22a011-37d1-58d3-830f-3caee704e09f, identifier: LP67164
2026-03-29 18:42:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b22a011-37d1-58d3-830f-3caee704e09f with identifier: LP67164
2026-03-29 18:42:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b22a011-37d1-58d3-830f-3caee704e09f with identifier: LP67164
2026-03-29 18:42:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b22a011-37d1-58d3-830f-3caee704e09f with identifier: LP67164 to the API
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 121,
'expiration_date': '2026-03-30T15:20:08Z',
'fuel_type': 'petrol',
'id': '9b22a011-37d1-58d3-830f-3caee704e09f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP67164',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 69589,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-15',
'seller_name': None,
'title': 'Mazda CX-3 2.0 Skyactiv-G Sports-Line',
'transmission': 'manual',
'trim': 'Sports-Line',
'year': 2019}
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP67164%27 HTTP/1.1" 200 None
2026-03-29 18:42:28 [auto1.de] INFO: Saving data for LP67164: {'auction_closing_time': 1774884008.0, 'created_time': 1774294549.272413, 'last_price_update_time': 1774809748.738943}
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LP67164') HTTP/1.1" 204 0
2026-03-29 18:42:28 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF64276%27 HTTP/1.1" 200 None
2026-03-29 18:42:28 [auto1.de] INFO: Scrape type for ZF64276: 2
2026-03-29 18:42:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a45055d-84d7-5467-9f23-59e3a60e9d42 with identifier: ZF64276
2026-03-29 18:42:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a45055d-84d7-5467-9f23-59e3a60e9d42 with scrape type 2
2026-03-29 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a45055d-84d7-5467-9f23-59e3a60e9d42 with scrape type 2
2026-03-29 18:42:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a45055d-84d7-5467-9f23-59e3a60e9d42, identifier: ZF64276
2026-03-29 18:42:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a45055d-84d7-5467-9f23-59e3a60e9d42 with identifier: ZF64276
2026-03-29 18:42:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a45055d-84d7-5467-9f23-59e3a60e9d42 with identifier: ZF64276
2026-03-29 18:42:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a45055d-84d7-5467-9f23-59e3a60e9d42 with identifier: ZF64276 to the API
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'petrol',
'id': '5a45055d-84d7-5467-9f23-59e3a60e9d42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF64276',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 161794,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-22',
'seller_name': None,
'title': 'BMW 1er 114i',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF64276%27 HTTP/1.1" 200 None
2026-03-29 18:42:29 [auto1.de] INFO: Saving data for ZF64276: {'auction_closing_time': 1774884600.0, 'created_time': 1773945097.385173, 'last_price_update_time': 1774809749.166255}
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF64276') HTTP/1.1" 204 0
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH67229%27 HTTP/1.1" 200 None
2026-03-29 18:42:29 [auto1.de] INFO: Scrape type for VH67229: 0
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF45027%27 HTTP/1.1" 200 None
2026-03-29 18:42:29 [auto1.de] INFO: Scrape type for MF45027: 2
2026-03-29 18:42:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c401126b-fee5-592a-863c-040d7aab7840 with identifier: MF45027
2026-03-29 18:42:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c401126b-fee5-592a-863c-040d7aab7840 with scrape type 2
2026-03-29 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c401126b-fee5-592a-863c-040d7aab7840 with scrape type 2
2026-03-29 18:42:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c401126b-fee5-592a-863c-040d7aab7840, identifier: MF45027
2026-03-29 18:42:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c401126b-fee5-592a-863c-040d7aab7840 with identifier: MF45027
2026-03-29 18:42:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c401126b-fee5-592a-863c-040d7aab7840 with identifier: MF45027
2026-03-29 18:42:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c401126b-fee5-592a-863c-040d7aab7840 with identifier: MF45027 to the API
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:46:53Z',
'fuel_type': 'diesel',
'id': 'c401126b-fee5-592a-863c-040d7aab7840',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF45027',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 193577,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-03',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'automatic',
'trim': 'RS',
'year': 2015}
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF45027%27 HTTP/1.1" 200 None
2026-03-29 18:42:29 [auto1.de] INFO: Saving data for MF45027: {'auction_closing_time': 1774885613.0, 'created_time': 1773469059.546648, 'last_price_update_time': 1774809749.668169}
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF45027') HTTP/1.1" 204 0
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU39152%27 HTTP/1.1" 200 None
2026-03-29 18:42:29 [auto1.de] INFO: Scrape type for BU39152: 0
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-29 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:29 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13181%27 HTTP/1.1" 200 None
2026-03-29 18:42:29 [auto1.de] INFO: Scrape type for NV13181: 2
2026-03-29 18:42:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with identifier: NV13181
2026-03-29 18:42:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with scrape type 2
2026-03-29 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with scrape type 2
2026-03-29 18:42:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce, identifier: NV13181
2026-03-29 18:42:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with identifier: NV13181
2026-03-29 18:42:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with identifier: NV13181
2026-03-29 18:42:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with identifier: NV13181 to the API
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:14:50Z',
'fuel_type': 'diesel',
'id': 'ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV13181',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 276650,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-08-16',
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'manual',
'trim': '',
'year': 2005}
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13181%27 HTTP/1.1" 200 None
2026-03-29 18:42:30 [auto1.de] INFO: Saving data for NV13181: {'auction_closing_time': 1774883690.0, 'created_time': 1773427331.912878, 'last_price_update_time': 1774809750.361636}
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV13181') HTTP/1.1" 204 0
2026-03-29 18:42:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF91917%27 HTTP/1.1" 200 None
2026-03-29 18:42:30 [auto1.de] INFO: Scrape type for NF91917: 2
2026-03-29 18:42:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dec23b6c-c607-5770-91a4-69c613a59e00 with identifier: NF91917
2026-03-29 18:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dec23b6c-c607-5770-91a4-69c613a59e00 with scrape type 2
2026-03-29 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dec23b6c-c607-5770-91a4-69c613a59e00 with scrape type 2
2026-03-29 18:42:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dec23b6c-c607-5770-91a4-69c613a59e00, identifier: NF91917
2026-03-29 18:42:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dec23b6c-c607-5770-91a4-69c613a59e00 with identifier: NF91917
2026-03-29 18:42:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dec23b6c-c607-5770-91a4-69c613a59e00 with identifier: NF91917
2026-03-29 18:42:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dec23b6c-c607-5770-91a4-69c613a59e00 with identifier: NF91917 to the API
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:08:07Z',
'fuel_type': 'petrol',
'id': 'dec23b6c-c607-5770-91a4-69c613a59e00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF91917',
'listing': 'auction',
'make': 'Abarth',
'model': '595',
'odometer': 43521,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-30',
'seller_name': None,
'title': 'Abarth 595 1.4 Competizione',
'transmission': 'manual',
'trim': 'Competizione',
'year': 2019}
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF91917%27 HTTP/1.1" 200 None
2026-03-29 18:42:30 [auto1.de] INFO: Saving data for NF91917: {'auction_closing_time': 1774883287.0, 'created_time': 1773946318.794077, 'last_price_update_time': 1774809750.766772}
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF91917') HTTP/1.1" 204 0
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS69855%27 HTTP/1.1" 200 None
2026-03-29 18:42:30 [auto1.de] INFO: Scrape type for WS69855: 2
2026-03-29 18:42:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32af0df3-57f2-5180-b5a1-84e2433f86fc with identifier: WS69855
2026-03-29 18:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32af0df3-57f2-5180-b5a1-84e2433f86fc with scrape type 2
2026-03-29 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32af0df3-57f2-5180-b5a1-84e2433f86fc with scrape type 2
2026-03-29 18:42:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32af0df3-57f2-5180-b5a1-84e2433f86fc, identifier: WS69855
2026-03-29 18:42:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32af0df3-57f2-5180-b5a1-84e2433f86fc with identifier: WS69855
2026-03-29 18:42:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32af0df3-57f2-5180-b5a1-84e2433f86fc with identifier: WS69855
2026-03-29 18:42:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32af0df3-57f2-5180-b5a1-84e2433f86fc with identifier: WS69855 to the API
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:11:40Z',
'fuel_type': 'petrol',
'id': '32af0df3-57f2-5180-b5a1-84e2433f86fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS69855',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 52108,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-07',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2014}
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS69855%27 HTTP/1.1" 200 None
2026-03-29 18:42:31 [auto1.de] INFO: Saving data for WS69855: {'auction_closing_time': 1774883500.0, 'created_time': 1773308242.602443, 'last_price_update_time': 1774809751.607323}
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS69855') HTTP/1.1" 204 0
2026-03-29 18:42:31 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU76386%27 HTTP/1.1" 200 None
2026-03-29 18:42:31 [auto1.de] INFO: Scrape type for BU76386: 0
2026-03-29 18:42:31 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49418%27 HTTP/1.1" 200 None
2026-03-29 18:42:31 [auto1.de] INFO: Scrape type for TB49418: 2
2026-03-29 18:42:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b67c7ff8-120a-5144-ab8a-f43452b49b74 with identifier: TB49418
2026-03-29 18:42:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b67c7ff8-120a-5144-ab8a-f43452b49b74 with scrape type 2
2026-03-29 18:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b67c7ff8-120a-5144-ab8a-f43452b49b74 with scrape type 2
2026-03-29 18:42:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b67c7ff8-120a-5144-ab8a-f43452b49b74, identifier: TB49418
2026-03-29 18:42:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b67c7ff8-120a-5144-ab8a-f43452b49b74 with identifier: TB49418
2026-03-29 18:42:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b67c7ff8-120a-5144-ab8a-f43452b49b74 with identifier: TB49418
2026-03-29 18:42:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b67c7ff8-120a-5144-ab8a-f43452b49b74 with identifier: TB49418 to the API
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 333,
'expiration_date': '2026-03-30T15:13:40Z',
'fuel_type': 'petrol',
'id': 'b67c7ff8-120a-5144-ab8a-f43452b49b74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB49418',
'listing': 'auction',
'make': 'BMW',
'model': '6er',
'odometer': 113025,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-04-27',
'seller_name': None,
'title': 'BMW 6er 645 CI',
'transmission': 'automatic',
'trim': '',
'year': 2005}
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49418%27 HTTP/1.1" 200 None
2026-03-29 18:42:32 [auto1.de] INFO: Saving data for TB49418: {'auction_closing_time': 1774883620.0, 'created_time': 1773223597.423583, 'last_price_update_time': 1774809752.095971}
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB49418') HTTP/1.1" 204 0
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW80485%27 HTTP/1.1" 200 None
2026-03-29 18:42:32 [auto1.de] INFO: Scrape type for TW80485: 2
2026-03-29 18:42:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69eca622-3dd1-5870-a434-95dfb505d9f0 with identifier: TW80485
2026-03-29 18:42:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69eca622-3dd1-5870-a434-95dfb505d9f0 with scrape type 2
2026-03-29 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69eca622-3dd1-5870-a434-95dfb505d9f0 with scrape type 2
2026-03-29 18:42:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69eca622-3dd1-5870-a434-95dfb505d9f0, identifier: TW80485
2026-03-29 18:42:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69eca622-3dd1-5870-a434-95dfb505d9f0 with identifier: TW80485
2026-03-29 18:42:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69eca622-3dd1-5870-a434-95dfb505d9f0 with identifier: TW80485
2026-03-29 18:42:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69eca622-3dd1-5870-a434-95dfb505d9f0 with identifier: TW80485 to the API
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:59:50Z',
'fuel_type': 'petrol',
'id': '69eca622-3dd1-5870-a434-95dfb505d9f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW80485',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 186557,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-28',
'seller_name': None,
'title': 'BMW 1er 118i',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW80485%27 HTTP/1.1" 200 None
2026-03-29 18:42:32 [auto1.de] INFO: Saving data for TW80485: {'auction_closing_time': 1774886390.0, 'created_time': 1774521674.178073, 'last_price_update_time': 1774809752.521355}
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW80485') HTTP/1.1" 204 0
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD76793%27 HTTP/1.1" 200 None
2026-03-29 18:42:32 [auto1.de] INFO: Scrape type for JD76793: 0
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ00942%27 HTTP/1.1" 200 None
2026-03-29 18:42:32 [auto1.de] INFO: Scrape type for TZ00942: 0
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT36384%27 HTTP/1.1" 200 None
2026-03-29 18:42:32 [auto1.de] INFO: Scrape type for KT36384: 0
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY10898%27 HTTP/1.1" 200 None
2026-03-29 18:42:32 [auto1.de] INFO: Scrape type for TY10898: 0
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV64166%27 HTTP/1.1" 200 None
2026-03-29 18:42:32 [auto1.de] INFO: Scrape type for ZV64166: 2
2026-03-29 18:42:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with identifier: ZV64166
2026-03-29 18:42:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with scrape type 2
2026-03-29 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with scrape type 2
2026-03-29 18:42:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099, identifier: ZV64166
2026-03-29 18:42:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with identifier: ZV64166
2026-03-29 18:42:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with identifier: ZV64166
2026-03-29 18:42:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with identifier: ZV64166 to the API
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:46:49Z',
'fuel_type': 'diesel',
'id': '6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV64166',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 158433,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-28',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 CDI 4Matic BlueTEC Avantgarde',
'transmission': 'automatic',
'trim': '4Matic BlueTEC Avantgarde',
'year': 2015}
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV64166%27 HTTP/1.1" 200 None
2026-03-29 18:42:33 [auto1.de] INFO: Saving data for ZV64166: {'auction_closing_time': 1774885609.0, 'created_time': 1773859696.164347, 'last_price_update_time': 1774809753.148792}
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV64166') HTTP/1.1" 204 0
2026-03-29 18:42:33 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-29 18:42:33 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP38579%27 HTTP/1.1" 200 None
2026-03-29 18:42:33 [auto1.de] INFO: Scrape type for EP38579: 2
2026-03-29 18:42:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with identifier: EP38579
2026-03-29 18:42:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with scrape type 2
2026-03-29 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with scrape type 2
2026-03-29 18:42:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a468eef-e5e7-58be-b86c-eacf239dc4c7, identifier: EP38579
2026-03-29 18:42:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with identifier: EP38579
2026-03-29 18:42:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with identifier: EP38579
2026-03-29 18:42:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with identifier: EP38579 to the API
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:14:06Z',
'fuel_type': 'diesel',
'id': '1a468eef-e5e7-58be-b86c-eacf239dc4c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP38579',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 223402,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-08',
'seller_name': None,
'title': 'Audi A1 1.6 TDI Attraction',
'transmission': 'automatic',
'trim': 'Attraction',
'year': 2011}
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP38579%27 HTTP/1.1" 200 None
2026-03-29 18:42:33 [auto1.de] INFO: Saving data for EP38579: {'auction_closing_time': 1774883646.0, 'created_time': 1773400332.831506, 'last_price_update_time': 1774809753.708633}
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP38579') HTTP/1.1" 204 0
2026-03-29 18:42:33 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-29 18:42:33 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-29 18:42:33 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-29 18:42:33 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ64916%27 HTTP/1.1" 200 None
2026-03-29 18:42:33 [auto1.de] INFO: Scrape type for ZJ64916: 2
2026-03-29 18:42:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76d6ab45-cfab-5b41-948c-057f560d0c86 with identifier: ZJ64916
2026-03-29 18:42:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76d6ab45-cfab-5b41-948c-057f560d0c86 with scrape type 2
2026-03-29 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76d6ab45-cfab-5b41-948c-057f560d0c86 with scrape type 2
2026-03-29 18:42:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76d6ab45-cfab-5b41-948c-057f560d0c86, identifier: ZJ64916
2026-03-29 18:42:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76d6ab45-cfab-5b41-948c-057f560d0c86 with identifier: ZJ64916
2026-03-29 18:42:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76d6ab45-cfab-5b41-948c-057f560d0c86 with identifier: ZJ64916
2026-03-29 18:42:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76d6ab45-cfab-5b41-948c-057f560d0c86 with identifier: ZJ64916 to the API
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 145,
'expiration_date': '2026-03-30T15:22:04Z',
'fuel_type': 'petrol',
'id': '76d6ab45-cfab-5b41-948c-057f560d0c86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ64916',
'listing': 'auction',
'make': 'Mazda',
'model': '5',
'odometer': 227875,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-30',
'seller_name': None,
'title': 'Mazda 5 2.0 Top',
'transmission': 'manual',
'trim': 'Top',
'year': 2008}
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ64916%27 HTTP/1.1" 200 None
2026-03-29 18:42:34 [auto1.de] INFO: Saving data for ZJ64916: {'auction_closing_time': 1774884124.0, 'created_time': 1774033101.742341, 'last_price_update_time': 1774809754.110899}
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ64916') HTTP/1.1" 204 0
2026-03-29 18:42:34 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE21884%27 HTTP/1.1" 200 None
2026-03-29 18:42:34 [auto1.de] INFO: Scrape type for AE21884: 2
2026-03-29 18:42:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0250675-1b3d-5f97-92c7-d60ee3082ece with identifier: AE21884
2026-03-29 18:42:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0250675-1b3d-5f97-92c7-d60ee3082ece with scrape type 2
2026-03-29 18:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0250675-1b3d-5f97-92c7-d60ee3082ece with scrape type 2
2026-03-29 18:42:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0250675-1b3d-5f97-92c7-d60ee3082ece, identifier: AE21884
2026-03-29 18:42:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0250675-1b3d-5f97-92c7-d60ee3082ece with identifier: AE21884
2026-03-29 18:42:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0250675-1b3d-5f97-92c7-d60ee3082ece with identifier: AE21884
2026-03-29 18:42:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0250675-1b3d-5f97-92c7-d60ee3082ece with identifier: AE21884 to the API
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:02:18Z',
'fuel_type': 'diesel',
'id': 'c0250675-1b3d-5f97-92c7-d60ee3082ece',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE21884',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 182888,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-06',
'seller_name': None,
'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2015}
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE21884%27 HTTP/1.1" 200 None
2026-03-29 18:42:34 [auto1.de] INFO: Saving data for AE21884: {'auction_closing_time': 1774882938.0, 'created_time': 1773304264.800252, 'last_price_update_time': 1774809754.577872}
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE21884') HTTP/1.1" 204 0
2026-03-29 18:42:34 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU12915%27 HTTP/1.1" 200 None
2026-03-29 18:42:34 [auto1.de] INFO: Scrape type for FU12915: 0
2026-03-29 18:42:34 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU81814%27 HTTP/1.1" 200 None
2026-03-29 18:42:34 [auto1.de] INFO: Scrape type for BU81814: 0
2026-03-29 18:42:34 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92712%27 HTTP/1.1" 200 None
2026-03-29 18:42:34 [auto1.de] INFO: Scrape type for WT92712: 0
2026-03-29 18:42:34 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-29 18:42:34 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ73657%27 HTTP/1.1" 200 None
2026-03-29 18:42:34 [auto1.de] INFO: Scrape type for WJ73657: 0
2026-03-29 18:42:34 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU65331%27 HTTP/1.1" 200 None
2026-03-29 18:42:34 [auto1.de] INFO: Scrape type for JU65331: 0
2026-03-29 18:42:34 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP00850%27 HTTP/1.1" 200 None
2026-03-29 18:42:34 [auto1.de] INFO: Scrape type for HP00850: 2
2026-03-29 18:42:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49a94208-46b8-5a42-a383-e64a557f228c with identifier: HP00850
2026-03-29 18:42:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49a94208-46b8-5a42-a383-e64a557f228c with scrape type 2
2026-03-29 18:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49a94208-46b8-5a42-a383-e64a557f228c with scrape type 2
2026-03-29 18:42:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49a94208-46b8-5a42-a383-e64a557f228c, identifier: HP00850
2026-03-29 18:42:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49a94208-46b8-5a42-a383-e64a557f228c with identifier: HP00850
2026-03-29 18:42:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49a94208-46b8-5a42-a383-e64a557f228c with identifier: HP00850
2026-03-29 18:42:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49a94208-46b8-5a42-a383-e64a557f228c with identifier: HP00850 to the API
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:49:11Z',
'fuel_type': 'petrol',
'id': '49a94208-46b8-5a42-a383-e64a557f228c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP00850',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 240462,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-11',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2010}
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP00850%27 HTTP/1.1" 200 None
2026-03-29 18:42:35 [auto1.de] INFO: Saving data for HP00850: {'auction_closing_time': 1774885751.0, 'created_time': 1774521303.322181, 'last_price_update_time': 1774809755.059802}
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP00850') HTTP/1.1" 204 0
2026-03-29 18:42:35 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30155%27 HTTP/1.1" 200 None
2026-03-29 18:42:35 [auto1.de] INFO: Scrape type for ZL30155: 0
2026-03-29 18:42:35 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81331%27 HTTP/1.1" 200 None
2026-03-29 18:42:35 [auto1.de] INFO: Scrape type for DK81331: 0
2026-03-29 18:42:35 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-29 18:42:35 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14891%27 HTTP/1.1" 200 None
2026-03-29 18:42:35 [auto1.de] INFO: Scrape type for ZG14891: 0
2026-03-29 18:42:35 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-29 18:42:35 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-29 18:42:35 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89012%27 HTTP/1.1" 200 None
2026-03-29 18:42:35 [auto1.de] INFO: Scrape type for GG89012: 2
2026-03-29 18:42:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64215c5a-ab4d-5350-a044-f3423f6f20ea with identifier: GG89012
2026-03-29 18:42:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64215c5a-ab4d-5350-a044-f3423f6f20ea with scrape type 2
2026-03-29 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64215c5a-ab4d-5350-a044-f3423f6f20ea with scrape type 2
2026-03-29 18:42:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64215c5a-ab4d-5350-a044-f3423f6f20ea, identifier: GG89012
2026-03-29 18:42:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64215c5a-ab4d-5350-a044-f3423f6f20ea with identifier: GG89012
2026-03-29 18:42:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64215c5a-ab4d-5350-a044-f3423f6f20ea with identifier: GG89012
2026-03-29 18:42:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64215c5a-ab4d-5350-a044-f3423f6f20ea with identifier: GG89012 to the API
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:51:17Z',
'fuel_type': 'petrol',
'id': '64215c5a-ab4d-5350-a044-f3423f6f20ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG89012',
'listing': 'auction',
'make': 'Kia',
'model': "pro_cee'd",
'odometer': 57076,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-05',
'seller_name': None,
'title': "Kia pro_cee'd 1.6 GDI Edition 7",
'transmission': 'manual',
'trim': 'Edition 7',
'year': 2013}
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89012%27 HTTP/1.1" 200 None
2026-03-29 18:42:35 [auto1.de] INFO: Saving data for GG89012: {'auction_closing_time': 1774885877.0, 'created_time': 1773859450.64307, 'last_price_update_time': 1774809755.652874}
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG89012') HTTP/1.1" 204 0
2026-03-29 18:42:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:41 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ09497%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for RZ09497: 0
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF01905%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for LF01905: 0
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ17280%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for UJ17280: 0
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44839%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for TW44839: 0
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX15626%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for HX15626: 2
2026-03-29 18:42:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53ba7d2-e982-5a07-b326-7a88bf6b09d4 with identifier: HX15626
2026-03-29 18:42:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53ba7d2-e982-5a07-b326-7a88bf6b09d4 with scrape type 2
2026-03-29 18:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e53ba7d2-e982-5a07-b326-7a88bf6b09d4 with scrape type 2
2026-03-29 18:42:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e53ba7d2-e982-5a07-b326-7a88bf6b09d4, identifier: HX15626
2026-03-29 18:42:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e53ba7d2-e982-5a07-b326-7a88bf6b09d4 with identifier: HX15626
2026-03-29 18:42:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e53ba7d2-e982-5a07-b326-7a88bf6b09d4 with identifier: HX15626
2026-03-29 18:42:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e53ba7d2-e982-5a07-b326-7a88bf6b09d4 with identifier: HX15626 to the API
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 315,
'expiration_date': '2026-03-30T15:24:15Z',
'fuel_type': 'petrol',
'id': 'e53ba7d2-e982-5a07-b326-7a88bf6b09d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX15626',
'listing': 'auction',
'make': 'Porsche',
'model': 'Boxster',
'odometer': 80132,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-04',
'seller_name': None,
'title': 'Porsche Boxster S',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX15626%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Saving data for HX15626: {'auction_closing_time': 1774884255.0, 'created_time': 1774636311.592716, 'last_price_update_time': 1774809761.7862}
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX15626') HTTP/1.1" 204 0
2026-03-29 18:42:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX12921%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for YX12921: 0
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK21356%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for LK21356: 0
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL20580%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for RL20580: 0
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX39550%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for AX39550: 0
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG53828%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for CG53828: 2
2026-03-29 18:42:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 197ab80b-7653-51b6-8eba-5e39043d2371 with identifier: CG53828
2026-03-29 18:42:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 197ab80b-7653-51b6-8eba-5e39043d2371 with scrape type 2
2026-03-29 18:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 197ab80b-7653-51b6-8eba-5e39043d2371 with scrape type 2
2026-03-29 18:42:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 197ab80b-7653-51b6-8eba-5e39043d2371, identifier: CG53828
2026-03-29 18:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 197ab80b-7653-51b6-8eba-5e39043d2371 with identifier: CG53828
2026-03-29 18:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 197ab80b-7653-51b6-8eba-5e39043d2371 with identifier: CG53828
2026-03-29 18:42:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 197ab80b-7653-51b6-8eba-5e39043d2371 with identifier: CG53828 to the API
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:58:12Z',
'fuel_type': 'petrol',
'id': '197ab80b-7653-51b6-8eba-5e39043d2371',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG53828',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 197331,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-03',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2012}
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG53828%27 HTTP/1.1" 200 None
2026-03-29 18:42:42 [auto1.de] INFO: Saving data for CG53828: {'auction_closing_time': 1774886292.0, 'created_time': 1774510238.835104, 'last_price_update_time': 1774809762.39804}
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG53828') HTTP/1.1" 204 0
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: GK27432
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: VK36740
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF33157%27 HTTP/1.1" 200 None
2026-03-29 18:42:42 [auto1.de] INFO: Scrape type for RF33157: 2
2026-03-29 18:42:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2b92293-3558-573a-893f-6fb8b8f4a7d9 with identifier: RF33157
2026-03-29 18:42:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2b92293-3558-573a-893f-6fb8b8f4a7d9 with scrape type 2
2026-03-29 18:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2b92293-3558-573a-893f-6fb8b8f4a7d9 with scrape type 2
2026-03-29 18:42:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2b92293-3558-573a-893f-6fb8b8f4a7d9, identifier: RF33157
2026-03-29 18:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2b92293-3558-573a-893f-6fb8b8f4a7d9 with identifier: RF33157
2026-03-29 18:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2b92293-3558-573a-893f-6fb8b8f4a7d9 with identifier: RF33157
2026-03-29 18:42:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2b92293-3558-573a-893f-6fb8b8f4a7d9 with identifier: RF33157 to the API
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:27:40Z',
'fuel_type': 'petrol',
'id': 'e2b92293-3558-573a-893f-6fb8b8f4a7d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF33157',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 137869,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-08',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.0 eTSI Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2020}
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF33157%27 HTTP/1.1" 200 None
2026-03-29 18:42:42 [auto1.de] INFO: Saving data for RF33157: {'auction_closing_time': 1774884460.0, 'created_time': 1773305292.94173, 'last_price_update_time': 1774809762.852102}
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF33157') HTTP/1.1" 204 0
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT67031%27 HTTP/1.1" 200 None
2026-03-29 18:42:42 [auto1.de] INFO: Scrape type for JT67031: 0
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA51695%27 HTTP/1.1" 200 None
2026-03-29 18:42:42 [auto1.de] INFO: Scrape type for MA51695: 0
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL78522%27 HTTP/1.1" 200 None
2026-03-29 18:42:42 [auto1.de] INFO: Scrape type for VL78522: 0
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU90427%27 HTTP/1.1" 200 None
2026-03-29 18:42:42 [auto1.de] INFO: Scrape type for FU90427: 0
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH91647%27 HTTP/1.1" 200 None
2026-03-29 18:42:42 [auto1.de] INFO: Scrape type for TH91647: 2
2026-03-29 18:42:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b16c36ef-11c6-5a37-9bae-dba3598991ec with identifier: TH91647
2026-03-29 18:42:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b16c36ef-11c6-5a37-9bae-dba3598991ec with scrape type 2
2026-03-29 18:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b16c36ef-11c6-5a37-9bae-dba3598991ec with scrape type 2
2026-03-29 18:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b16c36ef-11c6-5a37-9bae-dba3598991ec, identifier: TH91647
2026-03-29 18:42:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b16c36ef-11c6-5a37-9bae-dba3598991ec with identifier: TH91647
2026-03-29 18:42:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b16c36ef-11c6-5a37-9bae-dba3598991ec with identifier: TH91647
2026-03-29 18:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b16c36ef-11c6-5a37-9bae-dba3598991ec with identifier: TH91647 to the API
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:50:17Z',
'fuel_type': 'petrol',
'id': 'b16c36ef-11c6-5a37-9bae-dba3598991ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH91647',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 44119,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-23',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2015}
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH91647%27 HTTP/1.1" 200 None
2026-03-29 18:42:43 [auto1.de] INFO: Saving data for TH91647: {'auction_closing_time': 1774885817.0, 'created_time': 1774262980.476949, 'last_price_update_time': 1774809763.367459}
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH91647') HTTP/1.1" 204 0
2026-03-29 18:42:43 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-29 18:42:43 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-29 18:42:43 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-29 18:42:43 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ75768%27 HTTP/1.1" 200 None
2026-03-29 18:42:43 [auto1.de] INFO: Scrape type for LJ75768: 0
2026-03-29 18:42:43 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ79213%27 HTTP/1.1" 200 None
2026-03-29 18:42:43 [auto1.de] INFO: Scrape type for SJ79213: 2
2026-03-29 18:42:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54776cde-b369-572e-ab46-f5a017a02a66 with identifier: SJ79213
2026-03-29 18:42:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54776cde-b369-572e-ab46-f5a017a02a66 with scrape type 2
2026-03-29 18:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54776cde-b369-572e-ab46-f5a017a02a66 with scrape type 2
2026-03-29 18:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54776cde-b369-572e-ab46-f5a017a02a66, identifier: SJ79213
2026-03-29 18:42:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54776cde-b369-572e-ab46-f5a017a02a66 with identifier: SJ79213
2026-03-29 18:42:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54776cde-b369-572e-ab46-f5a017a02a66 with identifier: SJ79213
2026-03-29 18:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54776cde-b369-572e-ab46-f5a017a02a66 with identifier: SJ79213 to the API
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:33:18Z',
'fuel_type': 'petrol',
'id': '54776cde-b369-572e-ab46-f5a017a02a66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ79213',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 116058,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-15',
'seller_name': None,
'title': 'Ford Kuga 2.5 Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2010}
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ79213%27 HTTP/1.1" 200 None
2026-03-29 18:42:43 [auto1.de] INFO: Saving data for SJ79213: {'auction_closing_time': 1774884798.0, 'created_time': 1773401349.434459, 'last_price_update_time': 1774809763.925494}
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ79213') HTTP/1.1" 204 0
2026-03-29 18:42:43 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH37188%27 HTTP/1.1" 200 None
2026-03-29 18:42:43 [auto1.de] INFO: Scrape type for MH37188: 0
2026-03-29 18:42:43 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-29 18:42:43 [auto1.de] INFO: Scrape type for DK31638: 2
2026-03-29 18:42:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 164f7313-845f-5b9e-9e16-8353f2ea1d92 with identifier: DK31638
2026-03-29 18:42:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 164f7313-845f-5b9e-9e16-8353f2ea1d92 with scrape type 2
2026-03-29 18:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 164f7313-845f-5b9e-9e16-8353f2ea1d92 with scrape type 2
2026-03-29 18:42:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 164f7313-845f-5b9e-9e16-8353f2ea1d92, identifier: DK31638
2026-03-29 18:42:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 164f7313-845f-5b9e-9e16-8353f2ea1d92 with identifier: DK31638
2026-03-29 18:42:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 164f7313-845f-5b9e-9e16-8353f2ea1d92 with identifier: DK31638
2026-03-29 18:42:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 164f7313-845f-5b9e-9e16-8353f2ea1d92 with identifier: DK31638 to the API
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 468,
'expiration_date': '2026-03-30T15:20:11Z',
'fuel_type': 'petrol',
'id': '164f7313-845f-5b9e-9e16-8353f2ea1d92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK31638',
'listing': 'auction',
'make': 'Jeep',
'model': 'Grand Cherokee',
'odometer': 86432,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-15',
'seller_name': None,
'title': 'Jeep Grand Cherokee 6.4 V8 HEMI SRT',
'transmission': 'automatic',
'trim': 'HEMI SRT',
'year': 2015}
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-29 18:42:44 [auto1.de] INFO: Saving data for DK31638: {'auction_closing_time': 1774884011.0, 'created_time': 1774262901.066826, 'last_price_update_time': 1774809764.422018}
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK31638') HTTP/1.1" 204 0
2026-03-29 18:42:44 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM12066%27 HTTP/1.1" 200 None
2026-03-29 18:42:44 [auto1.de] INFO: Scrape type for GM12066: 0
2026-03-29 18:42:44 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-29 18:42:44 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-29 18:42:44 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC91683%27 HTTP/1.1" 200 None
2026-03-29 18:42:44 [auto1.de] INFO: Scrape type for PC91683: 2
2026-03-29 18:42:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 754b93c1-df6a-58e8-b540-cbc9b10c69f3 with identifier: PC91683
2026-03-29 18:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 754b93c1-df6a-58e8-b540-cbc9b10c69f3 with scrape type 2
2026-03-29 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 754b93c1-df6a-58e8-b540-cbc9b10c69f3 with scrape type 2
2026-03-29 18:42:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 754b93c1-df6a-58e8-b540-cbc9b10c69f3, identifier: PC91683
2026-03-29 18:42:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 754b93c1-df6a-58e8-b540-cbc9b10c69f3 with identifier: PC91683
2026-03-29 18:42:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 754b93c1-df6a-58e8-b540-cbc9b10c69f3 with identifier: PC91683
2026-03-29 18:42:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 754b93c1-df6a-58e8-b540-cbc9b10c69f3 with identifier: PC91683 to the API
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:10:32Z',
'fuel_type': 'diesel',
'id': '754b93c1-df6a-58e8-b540-cbc9b10c69f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC91683',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 212389,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-25',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2016}
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC91683%27 HTTP/1.1" 200 None
2026-03-29 18:42:44 [auto1.de] INFO: Saving data for PC91683: {'auction_closing_time': 1774883432.0, 'created_time': 1773426826.734233, 'last_price_update_time': 1774809764.867889}
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC91683') HTTP/1.1" 204 0
2026-03-29 18:42:44 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-29 18:42:44 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG51341%27 HTTP/1.1" 200 None
2026-03-29 18:42:44 [auto1.de] INFO: Scrape type for XG51341: 2
2026-03-29 18:42:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1a76675-8238-50c3-8d59-2182802745f4 with identifier: XG51341
2026-03-29 18:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a76675-8238-50c3-8d59-2182802745f4 with scrape type 2
2026-03-29 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1a76675-8238-50c3-8d59-2182802745f4 with scrape type 2
2026-03-29 18:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1a76675-8238-50c3-8d59-2182802745f4, identifier: XG51341
2026-03-29 18:42:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1a76675-8238-50c3-8d59-2182802745f4 with identifier: XG51341
2026-03-29 18:42:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1a76675-8238-50c3-8d59-2182802745f4 with identifier: XG51341
2026-03-29 18:42:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1a76675-8238-50c3-8d59-2182802745f4 with identifier: XG51341 to the API
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:47:37Z',
'fuel_type': 'diesel',
'id': 'e1a76675-8238-50c3-8d59-2182802745f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG51341',
'listing': 'auction',
'make': 'Nissan',
'model': 'Pulsar',
'odometer': 132343,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-25',
'seller_name': None,
'title': 'Nissan Pulsar 1.5 Turbodiesel N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2017}
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG51341%27 HTTP/1.1" 200 None
2026-03-29 18:42:45 [auto1.de] INFO: Saving data for XG51341: {'auction_closing_time': 1774885657.0, 'created_time': 1773305529.269679, 'last_price_update_time': 1774809765.413993}
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG51341') HTTP/1.1" 204 0
2026-03-29 18:42:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:45 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:45 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00370%27 HTTP/1.1" 200 None
2026-03-29 18:42:45 [auto1.de] INFO: Scrape type for BS00370: 2
2026-03-29 18:42:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c261eba5-387d-5572-afb8-50f1004bf8ac with identifier: BS00370
2026-03-29 18:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c261eba5-387d-5572-afb8-50f1004bf8ac with scrape type 2
2026-03-29 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c261eba5-387d-5572-afb8-50f1004bf8ac with scrape type 2
2026-03-29 18:42:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c261eba5-387d-5572-afb8-50f1004bf8ac, identifier: BS00370
2026-03-29 18:42:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c261eba5-387d-5572-afb8-50f1004bf8ac with identifier: BS00370
2026-03-29 18:42:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c261eba5-387d-5572-afb8-50f1004bf8ac with identifier: BS00370
2026-03-29 18:42:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c261eba5-387d-5572-afb8-50f1004bf8ac with identifier: BS00370 to the API
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:07:42Z',
'fuel_type': 'petrol',
'id': 'c261eba5-387d-5572-afb8-50f1004bf8ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS00370',
'listing': 'auction',
'make': 'MINI',
'model': 'Cabrio',
'odometer': 114453,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-13',
'seller_name': None,
'title': 'MINI Cabrio Cooper S',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00370%27 HTTP/1.1" 200 None
2026-03-29 18:42:46 [auto1.de] INFO: Saving data for BS00370: {'auction_closing_time': 1774883262.0, 'created_time': 1773917573.028637, 'last_price_update_time': 1774809766.365996}
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS00370') HTTP/1.1" 204 0
2026-03-29 18:42:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:46 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN50102%27 HTTP/1.1" 200 None
2026-03-29 18:42:46 [auto1.de] INFO: Scrape type for GN50102: 0
2026-03-29 18:42:46 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD47083%27 HTTP/1.1" 200 None
2026-03-29 18:42:46 [auto1.de] INFO: Scrape type for HD47083: 2
2026-03-29 18:42:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94c02190-556b-5fea-ab36-2963e29bd29c with identifier: HD47083
2026-03-29 18:42:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94c02190-556b-5fea-ab36-2963e29bd29c with scrape type 2
2026-03-29 18:42:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94c02190-556b-5fea-ab36-2963e29bd29c with scrape type 2
2026-03-29 18:42:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94c02190-556b-5fea-ab36-2963e29bd29c, identifier: HD47083
2026-03-29 18:42:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94c02190-556b-5fea-ab36-2963e29bd29c with identifier: HD47083
2026-03-29 18:42:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94c02190-556b-5fea-ab36-2963e29bd29c with identifier: HD47083
2026-03-29 18:42:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94c02190-556b-5fea-ab36-2963e29bd29c with identifier: HD47083 to the API
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:10:43Z',
'fuel_type': 'diesel',
'id': '94c02190-556b-5fea-ab36-2963e29bd29c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD47083',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 163082,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-07',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI Xcellence',
'transmission': 'manual',
'trim': 'Xcellence',
'year': 2017}
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD47083%27 HTTP/1.1" 200 None
2026-03-29 18:42:46 [auto1.de] INFO: Saving data for HD47083: {'auction_closing_time': 1774883443.0, 'created_time': 1774521432.995276, 'last_price_update_time': 1774809766.784754}
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD47083') HTTP/1.1" 204 0
2026-03-29 18:42:46 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-29 18:42:46 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-29 18:42:46 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-29 18:42:46 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-29 18:42:46 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW56933%27 HTTP/1.1" 200 None
2026-03-29 18:42:46 [auto1.de] INFO: Scrape type for XW56933: 0
2026-03-29 18:42:46 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53994%27 HTTP/1.1" 200 None
2026-03-29 18:42:46 [auto1.de] INFO: Scrape type for CT53994: 2
2026-03-29 18:42:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80d2dad0-7181-5cd1-9608-e2d3918173ba with identifier: CT53994
2026-03-29 18:42:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80d2dad0-7181-5cd1-9608-e2d3918173ba with scrape type 2
2026-03-29 18:42:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80d2dad0-7181-5cd1-9608-e2d3918173ba with scrape type 2
2026-03-29 18:42:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80d2dad0-7181-5cd1-9608-e2d3918173ba, identifier: CT53994
2026-03-29 18:42:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80d2dad0-7181-5cd1-9608-e2d3918173ba with identifier: CT53994
2026-03-29 18:42:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80d2dad0-7181-5cd1-9608-e2d3918173ba with identifier: CT53994
2026-03-29 18:42:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80d2dad0-7181-5cd1-9608-e2d3918173ba with identifier: CT53994 to the API
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:37:40Z',
'fuel_type': 'petrol',
'id': '80d2dad0-7181-5cd1-9608-e2d3918173ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT53994',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 137039,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-19',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53994%27 HTTP/1.1" 200 None
2026-03-29 18:42:47 [auto1.de] INFO: Saving data for CT53994: {'auction_closing_time': 1774885060.0, 'created_time': 1773859659.327243, 'last_price_update_time': 1774809767.253278}
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT53994') HTTP/1.1" 204 0
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA63217%27 HTTP/1.1" 200 None
2026-03-29 18:42:47 [auto1.de] INFO: Scrape type for MA63217: 2
2026-03-29 18:42:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc28b1bd-2cff-5eba-b094-81a3cbee9eed with identifier: MA63217
2026-03-29 18:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc28b1bd-2cff-5eba-b094-81a3cbee9eed with scrape type 2
2026-03-29 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc28b1bd-2cff-5eba-b094-81a3cbee9eed with scrape type 2
2026-03-29 18:42:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc28b1bd-2cff-5eba-b094-81a3cbee9eed, identifier: MA63217
2026-03-29 18:42:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc28b1bd-2cff-5eba-b094-81a3cbee9eed with identifier: MA63217
2026-03-29 18:42:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc28b1bd-2cff-5eba-b094-81a3cbee9eed with identifier: MA63217
2026-03-29 18:42:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc28b1bd-2cff-5eba-b094-81a3cbee9eed with identifier: MA63217 to the API
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:26:56Z',
'fuel_type': 'petrol',
'id': 'dc28b1bd-2cff-5eba-b094-81a3cbee9eed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA63217',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 97005,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-23',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 CrossPolo',
'transmission': 'manual',
'trim': 'Cross',
'year': 2009}
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA63217%27 HTTP/1.1" 200 None
2026-03-29 18:42:47 [auto1.de] INFO: Saving data for MA63217: {'auction_closing_time': 1774884416.0, 'created_time': 1773945680.124632, 'last_price_update_time': 1774809767.753433}
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA63217') HTTP/1.1" 204 0
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: UT49919
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW05271%27 HTTP/1.1" 200 None
2026-03-29 18:42:47 [auto1.de] INFO: Scrape type for LW05271: 0
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: DE59201
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE59201%27 HTTP/1.1" 200 None
2026-03-29 18:42:47 [auto1.de] INFO: Scrape type for DE59201: 2
2026-03-29 18:42:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7ff64b2-63de-597a-9e11-8128352df070 with identifier: DE59201
2026-03-29 18:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7ff64b2-63de-597a-9e11-8128352df070 with scrape type 2
2026-03-29 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7ff64b2-63de-597a-9e11-8128352df070 with scrape type 2
2026-03-29 18:42:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7ff64b2-63de-597a-9e11-8128352df070, identifier: DE59201
2026-03-29 18:42:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7ff64b2-63de-597a-9e11-8128352df070 with identifier: DE59201
2026-03-29 18:42:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7ff64b2-63de-597a-9e11-8128352df070 with identifier: DE59201
2026-03-29 18:42:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7ff64b2-63de-597a-9e11-8128352df070 with identifier: DE59201 to the API
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:43:30Z',
'fuel_type': 'diesel',
'id': 'c7ff64b2-63de-597a-9e11-8128352df070',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE59201',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'MiTo',
'odometer': 173626,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-31',
'seller_name': None,
'title': 'Alfa Romeo MiTo 1.3 JTD Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2011}
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE59201%27 HTTP/1.1" 200 None
2026-03-29 18:42:48 [auto1.de] INFO: Saving data for DE59201: {'auction_closing_time': 1774885410.0, 'created_time': 1774033877.238789, 'last_price_update_time': 1774809768.195701}
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE59201') HTTP/1.1" 204 0
2026-03-29 18:42:48 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-29 18:42:48 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-29 18:42:48 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK18770%27 HTTP/1.1" 200 None
2026-03-29 18:42:48 [auto1.de] INFO: Scrape type for XK18770: 2
2026-03-29 18:42:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d30f394-1371-5fc2-941d-d139fce0970c with identifier: XK18770
2026-03-29 18:42:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d30f394-1371-5fc2-941d-d139fce0970c with scrape type 2
2026-03-29 18:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d30f394-1371-5fc2-941d-d139fce0970c with scrape type 2
2026-03-29 18:42:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d30f394-1371-5fc2-941d-d139fce0970c, identifier: XK18770
2026-03-29 18:42:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d30f394-1371-5fc2-941d-d139fce0970c with identifier: XK18770
2026-03-29 18:42:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d30f394-1371-5fc2-941d-d139fce0970c with identifier: XK18770
2026-03-29 18:42:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d30f394-1371-5fc2-941d-d139fce0970c with identifier: XK18770 to the API
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:43:18Z',
'fuel_type': 'diesel',
'id': '3d30f394-1371-5fc2-941d-d139fce0970c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK18770',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 122046,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-31',
'seller_name': None,
'title': 'Ford Focus 1.5 EcoBlue TDCi Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2020}
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK18770%27 HTTP/1.1" 200 None
2026-03-29 18:42:48 [auto1.de] INFO: Saving data for XK18770: {'auction_closing_time': 1774885398.0, 'created_time': 1773985178.460841, 'last_price_update_time': 1774809768.691369}
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK18770') HTTP/1.1" 204 0
2026-03-29 18:42:48 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-29 18:42:48 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-29 18:42:48 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP95900%27 HTTP/1.1" 200 None
2026-03-29 18:42:48 [auto1.de] INFO: Scrape type for XP95900: 0
2026-03-29 18:42:48 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21062%27 HTTP/1.1" 200 None
2026-03-29 18:42:48 [auto1.de] INFO: Scrape type for RX21062: 2
2026-03-29 18:42:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82272a7b-f8a4-55f4-9661-187b7c878674 with identifier: RX21062
2026-03-29 18:42:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82272a7b-f8a4-55f4-9661-187b7c878674 with scrape type 2
2026-03-29 18:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82272a7b-f8a4-55f4-9661-187b7c878674 with scrape type 2
2026-03-29 18:42:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82272a7b-f8a4-55f4-9661-187b7c878674, identifier: RX21062
2026-03-29 18:42:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82272a7b-f8a4-55f4-9661-187b7c878674 with identifier: RX21062
2026-03-29 18:42:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82272a7b-f8a4-55f4-9661-187b7c878674 with identifier: RX21062
2026-03-29 18:42:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82272a7b-f8a4-55f4-9661-187b7c878674 with identifier: RX21062 to the API
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 227,
'expiration_date': '2026-03-30T15:12:55Z',
'fuel_type': 'petrol',
'id': '82272a7b-f8a4-55f4-9661-187b7c878674',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX21062',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 9140,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-15',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic Edition '
'Avantgarde',
'transmission': 'automatic',
'trim': '4Matic Edition Avantgarde',
'year': 2025}
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21062%27 HTTP/1.1" 200 None
2026-03-29 18:42:49 [auto1.de] INFO: Saving data for RX21062: {'auction_closing_time': 1774883575.0, 'created_time': 1773773459.754662, 'last_price_update_time': 1774809769.181041}
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX21062') HTTP/1.1" 204 0
2026-03-29 18:42:49 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-29 18:42:49 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD63369%27 HTTP/1.1" 200 None
2026-03-29 18:42:49 [auto1.de] INFO: Scrape type for UD63369: 0
2026-03-29 18:42:49 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-29 18:42:49 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND25281%27 HTTP/1.1" 200 None
2026-03-29 18:42:49 [auto1.de] INFO: Scrape type for ND25281: 2
2026-03-29 18:42:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b801ca3-962c-5835-8738-55ba3ee7a4f6 with identifier: ND25281
2026-03-29 18:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b801ca3-962c-5835-8738-55ba3ee7a4f6 with scrape type 2
2026-03-29 18:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b801ca3-962c-5835-8738-55ba3ee7a4f6 with scrape type 2
2026-03-29 18:42:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b801ca3-962c-5835-8738-55ba3ee7a4f6, identifier: ND25281
2026-03-29 18:42:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b801ca3-962c-5835-8738-55ba3ee7a4f6 with identifier: ND25281
2026-03-29 18:42:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b801ca3-962c-5835-8738-55ba3ee7a4f6 with identifier: ND25281
2026-03-29 18:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b801ca3-962c-5835-8738-55ba3ee7a4f6 with identifier: ND25281 to the API
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:48:52Z',
'fuel_type': 'petrol',
'id': '0b801ca3-962c-5835-8738-55ba3ee7a4f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND25281',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 99677,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-20',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2014}
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND25281%27 HTTP/1.1" 200 None
2026-03-29 18:42:49 [auto1.de] INFO: Saving data for ND25281: {'auction_closing_time': 1774885732.0, 'created_time': 1774636268.910582, 'last_price_update_time': 1774809769.610746}
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND25281') HTTP/1.1" 204 0
2026-03-29 18:42:49 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ16106%27 HTTP/1.1" 200 None
2026-03-29 18:42:49 [auto1.de] INFO: Scrape type for HZ16106: 0
2026-03-29 18:42:49 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-29 18:42:49 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD67792%27 HTTP/1.1" 200 None
2026-03-29 18:42:49 [auto1.de] INFO: Scrape type for SD67792: 2
2026-03-29 18:42:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21316b4c-87d4-55ae-8e44-c6578ebbc316 with identifier: SD67792
2026-03-29 18:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21316b4c-87d4-55ae-8e44-c6578ebbc316 with scrape type 2
2026-03-29 18:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21316b4c-87d4-55ae-8e44-c6578ebbc316 with scrape type 2
2026-03-29 18:42:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21316b4c-87d4-55ae-8e44-c6578ebbc316, identifier: SD67792
2026-03-29 18:42:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21316b4c-87d4-55ae-8e44-c6578ebbc316 with identifier: SD67792
2026-03-29 18:42:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21316b4c-87d4-55ae-8e44-c6578ebbc316 with identifier: SD67792
2026-03-29 18:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21316b4c-87d4-55ae-8e44-c6578ebbc316 with identifier: SD67792 to the API
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:22:33Z',
'fuel_type': 'petrol',
'id': '21316b4c-87d4-55ae-8e44-c6578ebbc316',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD67792',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 60280,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-02',
'seller_name': None,
'title': 'Volkswagen Beetle 1.2 TSI Design',
'transmission': 'manual',
'trim': 'Design',
'year': 2013}
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD67792%27 HTTP/1.1" 200 None
2026-03-29 18:42:50 [auto1.de] INFO: Saving data for SD67792: {'auction_closing_time': 1774884153.0, 'created_time': 1774608004.102277, 'last_price_update_time': 1774809770.190674}
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD67792') HTTP/1.1" 204 0
2026-03-29 18:42:50 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21956%27 HTTP/1.1" 200 None
2026-03-29 18:42:50 [auto1.de] INFO: Scrape type for LE21956: 2
2026-03-29 18:42:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: accea6fc-5443-5750-909d-52739c987d57 with identifier: LE21956
2026-03-29 18:42:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item accea6fc-5443-5750-909d-52739c987d57 with scrape type 2
2026-03-29 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item accea6fc-5443-5750-909d-52739c987d57 with scrape type 2
2026-03-29 18:42:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: accea6fc-5443-5750-909d-52739c987d57, identifier: LE21956
2026-03-29 18:42:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: accea6fc-5443-5750-909d-52739c987d57 with identifier: LE21956
2026-03-29 18:42:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: accea6fc-5443-5750-909d-52739c987d57 with identifier: LE21956
2026-03-29 18:42:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: accea6fc-5443-5750-909d-52739c987d57 with identifier: LE21956 to the API
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:43:52Z',
'fuel_type': 'petrol',
'id': 'accea6fc-5443-5750-909d-52739c987d57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE21956',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 85475,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-28',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 200 BlueEfficiency',
'transmission': 'automatic',
'trim': 'BlueEfficiency',
'year': 2011}
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21956%27 HTTP/1.1" 200 None
2026-03-29 18:42:50 [auto1.de] INFO: Saving data for LE21956: {'auction_closing_time': 1774885432.0, 'created_time': 1774032665.6297, 'last_price_update_time': 1774809770.682924}
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE21956') HTTP/1.1" 204 0
2026-03-29 18:42:50 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06987%27 HTTP/1.1" 200 None
2026-03-29 18:42:50 [auto1.de] INFO: Scrape type for AU06987: 0
2026-03-29 18:42:50 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC73852%27 HTTP/1.1" 200 None
2026-03-29 18:42:50 [auto1.de] INFO: Scrape type for SC73852: 0
2026-03-29 18:42:50 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-29 18:42:50 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:50 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-29 18:42:50 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL60481%27 HTTP/1.1" 200 None
2026-03-29 18:42:50 [auto1.de] INFO: Scrape type for SL60481: 0
2026-03-29 18:42:50 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX98211%27 HTTP/1.1" 200 None
2026-03-29 18:42:50 [auto1.de] INFO: Scrape type for SX98211: 0
2026-03-29 18:42:50 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU55800%27 HTTP/1.1" 200 None
2026-03-29 18:42:50 [auto1.de] INFO: Scrape type for YU55800: 2
2026-03-29 18:42:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0916ffe3-44cd-5787-9fca-947f936d4181 with identifier: YU55800
2026-03-29 18:42:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0916ffe3-44cd-5787-9fca-947f936d4181 with scrape type 2
2026-03-29 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0916ffe3-44cd-5787-9fca-947f936d4181 with scrape type 2
2026-03-29 18:42:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0916ffe3-44cd-5787-9fca-947f936d4181, identifier: YU55800
2026-03-29 18:42:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0916ffe3-44cd-5787-9fca-947f936d4181 with identifier: YU55800
2026-03-29 18:42:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0916ffe3-44cd-5787-9fca-947f936d4181 with identifier: YU55800
2026-03-29 18:42:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0916ffe3-44cd-5787-9fca-947f936d4181 with identifier: YU55800 to the API
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:57:39Z',
'fuel_type': 'petrol',
'id': '0916ffe3-44cd-5787-9fca-947f936d4181',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU55800',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 131884,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-20',
'seller_name': None,
'title': 'Renault Megane 1.2 BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2013}
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU55800%27 HTTP/1.1" 200 None
2026-03-29 18:42:51 [auto1.de] INFO: Saving data for YU55800: {'auction_closing_time': 1774886259.0, 'created_time': 1773775657.535171, 'last_price_update_time': 1774809771.278}
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU55800') HTTP/1.1" 204 0
2026-03-29 18:42:51 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41795%27 HTTP/1.1" 200 None
2026-03-29 18:42:51 [auto1.de] INFO: Scrape type for VE41795: 0
2026-03-29 18:42:51 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-29 18:42:51 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV56207%27 HTTP/1.1" 200 None
2026-03-29 18:42:51 [auto1.de] INFO: Scrape type for PV56207: 2
2026-03-29 18:42:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb22af45-881f-5892-a577-6abd03dacda0 with identifier: PV56207
2026-03-29 18:42:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb22af45-881f-5892-a577-6abd03dacda0 with scrape type 2
2026-03-29 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb22af45-881f-5892-a577-6abd03dacda0 with scrape type 2
2026-03-29 18:42:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb22af45-881f-5892-a577-6abd03dacda0, identifier: PV56207
2026-03-29 18:42:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb22af45-881f-5892-a577-6abd03dacda0 with identifier: PV56207
2026-03-29 18:42:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb22af45-881f-5892-a577-6abd03dacda0 with identifier: PV56207
2026-03-29 18:42:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb22af45-881f-5892-a577-6abd03dacda0 with identifier: PV56207 to the API
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:56:41Z',
'fuel_type': 'diesel',
'id': 'cb22af45-881f-5892-a577-6abd03dacda0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV56207',
'listing': 'auction',
'make': 'Toyota',
'model': 'Land Cruiser',
'odometer': 361677,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-04-08',
'seller_name': None,
'title': 'Toyota Land Cruiser 3.0 Turbodiesel Spezial',
'transmission': 'manual',
'trim': 'Spezial',
'year': 2001}
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV56207%27 HTTP/1.1" 200 None
2026-03-29 18:42:51 [auto1.de] INFO: Saving data for PV56207: {'auction_closing_time': 1774886201.0, 'created_time': 1774607664.433637, 'last_price_update_time': 1774809771.850235}
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV56207') HTTP/1.1" 204 0
2026-03-29 18:42:51 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH92244%27 HTTP/1.1" 200 None
2026-03-29 18:42:51 [auto1.de] INFO: Scrape type for NH92244: 0
2026-03-29 18:42:51 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-29 18:42:51 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-29 18:42:51 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97430%27 HTTP/1.1" 200 None
2026-03-29 18:42:51 [auto1.de] INFO: Scrape type for PB97430: 0
2026-03-29 18:42:51 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY43681%27 HTTP/1.1" 200 None
2026-03-29 18:42:51 [auto1.de] INFO: Scrape type for YY43681: 0
2026-03-29 18:42:51 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-29 18:42:51 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW00961%27 HTTP/1.1" 200 None
2026-03-29 18:42:51 [auto1.de] INFO: Scrape type for DW00961: 2
2026-03-29 18:42:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c01bdfc6-e73c-5106-9ad7-4c5c2598782f with identifier: DW00961
2026-03-29 18:42:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c01bdfc6-e73c-5106-9ad7-4c5c2598782f with scrape type 2
2026-03-29 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c01bdfc6-e73c-5106-9ad7-4c5c2598782f with scrape type 2
2026-03-29 18:42:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c01bdfc6-e73c-5106-9ad7-4c5c2598782f, identifier: DW00961
2026-03-29 18:42:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c01bdfc6-e73c-5106-9ad7-4c5c2598782f with identifier: DW00961
2026-03-29 18:42:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c01bdfc6-e73c-5106-9ad7-4c5c2598782f with identifier: DW00961
2026-03-29 18:42:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c01bdfc6-e73c-5106-9ad7-4c5c2598782f with identifier: DW00961 to the API
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:05:40Z',
'fuel_type': 'diesel',
'id': 'c01bdfc6-e73c-5106-9ad7-4c5c2598782f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW00961',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 193916,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-27',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 340 L2 Trend',
'transmission': 'manual',
'trim': '340 L2 Trend',
'year': 2016}
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW00961%27 HTTP/1.1" 200 None
2026-03-29 18:42:52 [auto1.de] INFO: Saving data for DW00961: {'auction_closing_time': 1774883140.0, 'created_time': 1773138584.560725, 'last_price_update_time': 1774809772.425356}
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW00961') HTTP/1.1" 204 0
2026-03-29 18:42:52 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-29 18:42:52 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ13308%27 HTTP/1.1" 200 None
2026-03-29 18:42:52 [auto1.de] INFO: Scrape type for MJ13308: 2
2026-03-29 18:42:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 008cc6e2-55c5-5480-8821-9f7a501d47fe with identifier: MJ13308
2026-03-29 18:42:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 008cc6e2-55c5-5480-8821-9f7a501d47fe with scrape type 2
2026-03-29 18:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 008cc6e2-55c5-5480-8821-9f7a501d47fe with scrape type 2
2026-03-29 18:42:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 008cc6e2-55c5-5480-8821-9f7a501d47fe, identifier: MJ13308
2026-03-29 18:42:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 008cc6e2-55c5-5480-8821-9f7a501d47fe with identifier: MJ13308
2026-03-29 18:42:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 008cc6e2-55c5-5480-8821-9f7a501d47fe with identifier: MJ13308
2026-03-29 18:42:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 008cc6e2-55c5-5480-8821-9f7a501d47fe with identifier: MJ13308 to the API
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:45:54Z',
'fuel_type': 'diesel',
'id': '008cc6e2-55c5-5480-8821-9f7a501d47fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ13308',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 206699,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-05',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
'transmission': 'automatic',
'trim': 'Platinum Edition 4WD',
'year': 2015}
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ13308%27 HTTP/1.1" 200 None
2026-03-29 18:42:52 [auto1.de] INFO: Saving data for MJ13308: {'auction_closing_time': 1774885554.0, 'created_time': 1774607763.846868, 'last_price_update_time': 1774809772.91889}
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ13308') HTTP/1.1" 204 0
2026-03-29 18:42:53 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD43064%27 HTTP/1.1" 200 None
2026-03-29 18:42:53 [auto1.de] INFO: Scrape type for BD43064: 2
2026-03-29 18:42:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with identifier: BD43064
2026-03-29 18:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with scrape type 2
2026-03-29 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with scrape type 2
2026-03-29 18:42:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9b4c7af-39c1-50a8-830b-407d7c60fdf5, identifier: BD43064
2026-03-29 18:42:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with identifier: BD43064
2026-03-29 18:42:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with identifier: BD43064
2026-03-29 18:42:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with identifier: BD43064 to the API
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:25:19Z',
'fuel_type': 'petrol',
'id': 'e9b4c7af-39c1-50a8-830b-407d7c60fdf5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD43064',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 101599,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-21',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 FSI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2011}
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD43064%27 HTTP/1.1" 200 None
2026-03-29 18:42:53 [auto1.de] INFO: Saving data for BD43064: {'auction_closing_time': 1774884319.0, 'created_time': 1773305440.876803, 'last_price_update_time': 1774809773.468237}
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD43064') HTTP/1.1" 204 0
2026-03-29 18:42:53 [auto1.de] INFO: Found listing with ID: AJ27375
2026-03-29 18:42:53 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB62347%27 HTTP/1.1" 200 None
2026-03-29 18:42:53 [auto1.de] INFO: Scrape type for YB62347: 2
2026-03-29 18:42:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10a7be19-c2b6-534e-a5df-66b929f96b56 with identifier: YB62347
2026-03-29 18:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10a7be19-c2b6-534e-a5df-66b929f96b56 with scrape type 2
2026-03-29 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10a7be19-c2b6-534e-a5df-66b929f96b56 with scrape type 2
2026-03-29 18:42:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10a7be19-c2b6-534e-a5df-66b929f96b56, identifier: YB62347
2026-03-29 18:42:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10a7be19-c2b6-534e-a5df-66b929f96b56 with identifier: YB62347
2026-03-29 18:42:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10a7be19-c2b6-534e-a5df-66b929f96b56 with identifier: YB62347
2026-03-29 18:42:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10a7be19-c2b6-534e-a5df-66b929f96b56 with identifier: YB62347 to the API
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:24:36Z',
'fuel_type': 'diesel',
'id': '10a7be19-c2b6-534e-a5df-66b929f96b56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB62347',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 172224,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-12',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi EcoBlue Cool&Connect',
'transmission': 'automatic',
'trim': 'Cool&Connect',
'year': 2019}
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB62347%27 HTTP/1.1" 200 None
2026-03-29 18:42:53 [auto1.de] INFO: Saving data for YB62347: {'auction_closing_time': 1774884276.0, 'created_time': 1773131812.575725, 'last_price_update_time': 1774809773.968636}
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB62347') HTTP/1.1" 204 0
2026-03-29 18:42:53 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS70073%27 HTTP/1.1" 200 None
2026-03-29 18:42:54 [auto1.de] INFO: Scrape type for VS70073: 0
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: MF48816
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW92068%27 HTTP/1.1" 200 None
2026-03-29 18:42:54 [auto1.de] INFO: Scrape type for AW92068: 2
2026-03-29 18:42:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8db83e5-266d-5101-9391-5958f831b209 with identifier: AW92068
2026-03-29 18:42:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8db83e5-266d-5101-9391-5958f831b209 with scrape type 2
2026-03-29 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8db83e5-266d-5101-9391-5958f831b209 with scrape type 2
2026-03-29 18:42:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8db83e5-266d-5101-9391-5958f831b209, identifier: AW92068
2026-03-29 18:42:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8db83e5-266d-5101-9391-5958f831b209 with identifier: AW92068
2026-03-29 18:42:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8db83e5-266d-5101-9391-5958f831b209 with identifier: AW92068
2026-03-29 18:42:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8db83e5-266d-5101-9391-5958f831b209 with identifier: AW92068 to the API
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 275,
'expiration_date': '2026-03-30T15:11:38Z',
'fuel_type': 'petrol',
'id': 'e8db83e5-266d-5101-9391-5958f831b209',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW92068',
'listing': 'auction',
'make': 'Cadillac',
'model': 'CTS',
'odometer': 25323,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-28',
'seller_name': None,
'title': 'Cadillac CTS 2.0 Performance AWD',
'transmission': 'automatic',
'trim': 'Performance AWD',
'year': 2016}
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW92068%27 HTTP/1.1" 200 None
2026-03-29 18:42:54 [auto1.de] INFO: Saving data for AW92068: {'auction_closing_time': 1774883498.0, 'created_time': 1773399740.768632, 'last_price_update_time': 1774809774.387854}
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW92068') HTTP/1.1" 204 0
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP04220%27 HTTP/1.1" 200 None
2026-03-29 18:42:54 [auto1.de] INFO: Scrape type for WP04220: 2
2026-03-29 18:42:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9703eaa8-b882-5107-a900-21f7a1b3a10b with identifier: WP04220
2026-03-29 18:42:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9703eaa8-b882-5107-a900-21f7a1b3a10b with scrape type 2
2026-03-29 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9703eaa8-b882-5107-a900-21f7a1b3a10b with scrape type 2
2026-03-29 18:42:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9703eaa8-b882-5107-a900-21f7a1b3a10b, identifier: WP04220
2026-03-29 18:42:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9703eaa8-b882-5107-a900-21f7a1b3a10b with identifier: WP04220
2026-03-29 18:42:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9703eaa8-b882-5107-a900-21f7a1b3a10b with identifier: WP04220
2026-03-29 18:42:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9703eaa8-b882-5107-a900-21f7a1b3a10b with identifier: WP04220 to the API
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:08:12Z',
'fuel_type': 'diesel',
'id': '9703eaa8-b882-5107-a900-21f7a1b3a10b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP04220',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 132820,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-15',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'automatic',
'trim': 'RS',
'year': 2018}
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP04220%27 HTTP/1.1" 200 None
2026-03-29 18:42:54 [auto1.de] INFO: Saving data for WP04220: {'auction_closing_time': 1774883292.0, 'created_time': 1773305422.350433, 'last_price_update_time': 1774809774.835167}
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP04220') HTTP/1.1" 204 0
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02715%27 HTTP/1.1" 200 None
2026-03-29 18:42:54 [auto1.de] INFO: Scrape type for FZ02715: 0
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30716%27 HTTP/1.1" 200 None
2026-03-29 18:42:54 [auto1.de] INFO: Scrape type for UX30716: 2
2026-03-29 18:42:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1e9fcfe-67df-57e9-8230-d565870f1a92 with identifier: UX30716
2026-03-29 18:42:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1e9fcfe-67df-57e9-8230-d565870f1a92 with scrape type 2
2026-03-29 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1e9fcfe-67df-57e9-8230-d565870f1a92 with scrape type 2
2026-03-29 18:42:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1e9fcfe-67df-57e9-8230-d565870f1a92, identifier: UX30716
2026-03-29 18:42:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1e9fcfe-67df-57e9-8230-d565870f1a92 with identifier: UX30716
2026-03-29 18:42:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1e9fcfe-67df-57e9-8230-d565870f1a92 with identifier: UX30716
2026-03-29 18:42:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1e9fcfe-67df-57e9-8230-d565870f1a92 with identifier: UX30716 to the API
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:22:48Z',
'fuel_type': 'petrol',
'id': 'f1e9fcfe-67df-57e9-8230-d565870f1a92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX30716',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 162477,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-15',
'seller_name': None,
'title': 'Skoda Fabia 1.4 TSI RS',
'transmission': 'automatic',
'trim': 'RS',
'year': 2013}
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30716%27 HTTP/1.1" 200 None
2026-03-29 18:42:55 [auto1.de] INFO: Saving data for UX30716: {'auction_closing_time': 1774884168.0, 'created_time': 1773400616.322835, 'last_price_update_time': 1774809775.283812}
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX30716') HTTP/1.1" 204 0
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY02769%27 HTTP/1.1" 200 None
2026-03-29 18:42:55 [auto1.de] INFO: Scrape type for KY02769: 0
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20078%27 HTTP/1.1" 200 None
2026-03-29 18:42:55 [auto1.de] INFO: Scrape type for ZJ20078: 0
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-29 18:42:55 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB37074%27 HTTP/1.1" 200 None
2026-03-29 18:42:55 [auto1.de] INFO: Scrape type for WB37074: 0
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF95451%27 HTTP/1.1" 200 None
2026-03-29 18:42:55 [auto1.de] INFO: Scrape type for JF95451: 2
2026-03-29 18:42:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e48a98-fb1d-5000-be9e-d2b634b38df0 with identifier: JF95451
2026-03-29 18:42:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e48a98-fb1d-5000-be9e-d2b634b38df0 with scrape type 2
2026-03-29 18:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33e48a98-fb1d-5000-be9e-d2b634b38df0 with scrape type 2
2026-03-29 18:42:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33e48a98-fb1d-5000-be9e-d2b634b38df0, identifier: JF95451
2026-03-29 18:42:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33e48a98-fb1d-5000-be9e-d2b634b38df0 with identifier: JF95451
2026-03-29 18:42:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33e48a98-fb1d-5000-be9e-d2b634b38df0 with identifier: JF95451
2026-03-29 18:42:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33e48a98-fb1d-5000-be9e-d2b634b38df0 with identifier: JF95451 to the API
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:28:58Z',
'fuel_type': 'petrol',
'id': '33e48a98-fb1d-5000-be9e-d2b634b38df0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF95451',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 135234,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-18',
'seller_name': None,
'title': 'Opel Corsa 1.2 Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2012}
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF95451%27 HTTP/1.1" 200 None
2026-03-29 18:42:55 [auto1.de] INFO: Saving data for JF95451: {'auction_closing_time': 1774884538.0, 'created_time': 1773661903.507089, 'last_price_update_time': 1774809775.887652}
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF95451') HTTP/1.1" 204 0
2026-03-29 18:42:56 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-29 18:42:56 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-29 18:42:56 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-29 18:42:56 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-29 18:42:56 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB26331%27 HTTP/1.1" 200 None
2026-03-29 18:42:56 [auto1.de] INFO: Scrape type for DB26331: 0
2026-03-29 18:42:56 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK66468%27 HTTP/1.1" 200 None
2026-03-29 18:42:56 [auto1.de] INFO: Scrape type for LK66468: 2
2026-03-29 18:42:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7e03575-d261-531d-ace6-e2bffe3ab45b with identifier: LK66468
2026-03-29 18:42:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e03575-d261-531d-ace6-e2bffe3ab45b with scrape type 2
2026-03-29 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7e03575-d261-531d-ace6-e2bffe3ab45b with scrape type 2
2026-03-29 18:42:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7e03575-d261-531d-ace6-e2bffe3ab45b, identifier: LK66468
2026-03-29 18:42:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7e03575-d261-531d-ace6-e2bffe3ab45b with identifier: LK66468
2026-03-29 18:42:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7e03575-d261-531d-ace6-e2bffe3ab45b with identifier: LK66468
2026-03-29 18:42:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7e03575-d261-531d-ace6-e2bffe3ab45b with identifier: LK66468 to the API
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 600,
'expiration_date': '2026-03-30T15:01:11Z',
'fuel_type': 'petrol',
'id': 'e7e03575-d261-531d-ace6-e2bffe3ab45b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK66468',
'listing': 'auction',
'make': 'Audi',
'model': 'RS Q8',
'odometer': 189488,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-04',
'seller_name': None,
'title': 'Audi RS Q8 4.0 TFSI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2020}
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK66468%27 HTTP/1.1" 200 None
2026-03-29 18:42:56 [auto1.de] INFO: Saving data for LK66468: {'auction_closing_time': 1774882871.0, 'created_time': 1774510243.737592, 'last_price_update_time': 1774809776.480977}
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK66468') HTTP/1.1" 204 0
2026-03-29 18:42:56 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK27520%27 HTTP/1.1" 200 None
2026-03-29 18:42:56 [auto1.de] INFO: Scrape type for TK27520: 2
2026-03-29 18:42:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d22d232-cd4e-5e2c-9fe5-6eab564230bc with identifier: TK27520
2026-03-29 18:42:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d22d232-cd4e-5e2c-9fe5-6eab564230bc with scrape type 2
2026-03-29 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d22d232-cd4e-5e2c-9fe5-6eab564230bc with scrape type 2
2026-03-29 18:42:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d22d232-cd4e-5e2c-9fe5-6eab564230bc, identifier: TK27520
2026-03-29 18:42:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d22d232-cd4e-5e2c-9fe5-6eab564230bc with identifier: TK27520
2026-03-29 18:42:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d22d232-cd4e-5e2c-9fe5-6eab564230bc with identifier: TK27520
2026-03-29 18:42:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d22d232-cd4e-5e2c-9fe5-6eab564230bc with identifier: TK27520 to the API
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:45:21Z',
'fuel_type': 'diesel',
'id': '8d22d232-cd4e-5e2c-9fe5-6eab564230bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK27520',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 256458,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-12',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI 120 Jahre Start/Stop',
'transmission': 'automatic',
'trim': '120 Jahre Start/Stop',
'year': 2018}
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK27520%27 HTTP/1.1" 200 None
2026-03-29 18:42:56 [auto1.de] INFO: Saving data for TK27520: {'auction_closing_time': 1774885521.0, 'created_time': 1774521253.046305, 'last_price_update_time': 1774809776.893784}
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK27520') HTTP/1.1" 204 0
2026-03-29 18:42:56 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS04919%27 HTTP/1.1" 200 None
2026-03-29 18:42:56 [auto1.de] INFO: Scrape type for ZS04919: 2
2026-03-29 18:42:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2a5b396-8d7a-5214-9a29-2b008151704c with identifier: ZS04919
2026-03-29 18:42:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2a5b396-8d7a-5214-9a29-2b008151704c with scrape type 2
2026-03-29 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2a5b396-8d7a-5214-9a29-2b008151704c with scrape type 2
2026-03-29 18:42:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2a5b396-8d7a-5214-9a29-2b008151704c, identifier: ZS04919
2026-03-29 18:42:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2a5b396-8d7a-5214-9a29-2b008151704c with identifier: ZS04919
2026-03-29 18:42:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2a5b396-8d7a-5214-9a29-2b008151704c with identifier: ZS04919
2026-03-29 18:42:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2a5b396-8d7a-5214-9a29-2b008151704c with identifier: ZS04919 to the API
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:02:39Z',
'fuel_type': 'hybrid',
'id': 'e2a5b396-8d7a-5214-9a29-2b008151704c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS04919',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 135599,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-03',
'seller_name': None,
'title': 'Toyota Yaris 1.5 Hybrid Comfort',
'transmission': 'automatic',
'trim': 'Comfort',
'year': 2015}
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS04919%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Saving data for ZS04919: {'auction_closing_time': 1774882959.0, 'created_time': 1774608281.583698, 'last_price_update_time': 1774809777.370379}
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS04919') HTTP/1.1" 204 0
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW20064%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Scrape type for VW20064: 0
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR60766%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Scrape type for JR60766: 2
2026-03-29 18:42:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b603c23-5c31-5308-b575-782f1fdea21f with identifier: JR60766
2026-03-29 18:42:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b603c23-5c31-5308-b575-782f1fdea21f with scrape type 2
2026-03-29 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b603c23-5c31-5308-b575-782f1fdea21f with scrape type 2
2026-03-29 18:42:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b603c23-5c31-5308-b575-782f1fdea21f, identifier: JR60766
2026-03-29 18:42:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b603c23-5c31-5308-b575-782f1fdea21f with identifier: JR60766
2026-03-29 18:42:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b603c23-5c31-5308-b575-782f1fdea21f with identifier: JR60766
2026-03-29 18:42:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b603c23-5c31-5308-b575-782f1fdea21f with identifier: JR60766 to the API
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:28:10Z',
'fuel_type': 'petrol',
'id': '4b603c23-5c31-5308-b575-782f1fdea21f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR60766',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 115661,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-06',
'seller_name': None,
'title': 'Audi Q3 2.0 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2013}
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR60766%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Saving data for JR60766: {'auction_closing_time': 1774884490.0, 'created_time': 1773400661.702349, 'last_price_update_time': 1774809777.84247}
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR60766') HTTP/1.1" 204 0
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV09971%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Scrape type for YV09971: 2
2026-03-29 18:42:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with identifier: YV09971
2026-03-29 18:42:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with scrape type 2
2026-03-29 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with scrape type 2
2026-03-29 18:42:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0ca242c-b1ce-5eb1-b043-e3b0405fc282, identifier: YV09971
2026-03-29 18:42:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with identifier: YV09971
2026-03-29 18:42:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with identifier: YV09971
2026-03-29 18:42:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with identifier: YV09971 to the API
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:06:03Z',
'fuel_type': 'petrol',
'id': 'd0ca242c-b1ce-5eb1-b043-e3b0405fc282',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV09971',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 89766,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-29',
'seller_name': None,
'title': 'Seat Ibiza 1.0 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2016}
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV09971%27 HTTP/1.1" 200 None
2026-03-29 18:42:58 [auto1.de] INFO: Saving data for YV09971: {'auction_closing_time': 1774883163.0, 'created_time': 1773304612.746314, 'last_price_update_time': 1774809778.428801}
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV09971') HTTP/1.1" 204 0
2026-03-29 18:42:58 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW95662%27 HTTP/1.1" 200 None
2026-03-29 18:42:58 [auto1.de] INFO: Scrape type for PW95662: 2
2026-03-29 18:42:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with identifier: PW95662
2026-03-29 18:42:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with scrape type 2
2026-03-29 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with scrape type 2
2026-03-29 18:42:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bf2417c-0cff-5bb8-a916-0e6349fdea4d, identifier: PW95662
2026-03-29 18:42:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with identifier: PW95662
2026-03-29 18:42:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with identifier: PW95662
2026-03-29 18:42:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with identifier: PW95662 to the API
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-30T15:27:49Z',
'fuel_type': 'petrol',
'id': '5bf2417c-0cff-5bb8-a916-0e6349fdea4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW95662',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 103250,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-20',
'seller_name': None,
'title': 'Renault Megane 1.2 TCe Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2016}
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW95662%27 HTTP/1.1" 200 None
2026-03-29 18:42:58 [auto1.de] INFO: Saving data for PW95662: {'auction_closing_time': 1774884469.0, 'created_time': 1773138237.223613, 'last_price_update_time': 1774809778.858024}
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW95662') HTTP/1.1" 204 0
2026-03-29 18:42:58 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-29 18:42:58 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-29 18:42:58 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-29 18:42:58 [auto1.de] INFO: Found listing with ID: KF40481
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF40481%27 HTTP/1.1" 200 None
2026-03-29 18:42:58 [auto1.de] INFO: Scrape type for KF40481: 2
2026-03-29 18:42:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dd620a7-335f-5177-8603-ca8588b393b6 with identifier: KF40481
2026-03-29 18:42:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dd620a7-335f-5177-8603-ca8588b393b6 with scrape type 2
2026-03-29 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dd620a7-335f-5177-8603-ca8588b393b6 with scrape type 2
2026-03-29 18:42:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dd620a7-335f-5177-8603-ca8588b393b6, identifier: KF40481
2026-03-29 18:42:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dd620a7-335f-5177-8603-ca8588b393b6 with identifier: KF40481
2026-03-29 18:42:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dd620a7-335f-5177-8603-ca8588b393b6 with identifier: KF40481
2026-03-29 18:42:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dd620a7-335f-5177-8603-ca8588b393b6 with identifier: KF40481 to the API
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:10:53Z',
'fuel_type': 'diesel',
'id': '4dd620a7-335f-5177-8603-ca8588b393b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF40481',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 245958,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-15',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC Exclusive',
'transmission': 'automatic',
'trim': 'T BlueTEC Exclusive',
'year': 2015}
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF40481%27 HTTP/1.1" 200 None
2026-03-29 18:42:59 [auto1.de] INFO: Saving data for KF40481: {'auction_closing_time': 1774883453.0, 'created_time': 1773467738.69708, 'last_price_update_time': 1774809779.294798}
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF40481') HTTP/1.1" 204 0
2026-03-29 18:42:59 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-29 18:42:59 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-29 18:42:59 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG14085%27 HTTP/1.1" 200 None
2026-03-29 18:42:59 [auto1.de] INFO: Scrape type for EG14085: 2
2026-03-29 18:42:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a78b96b-cc9a-54ce-8a88-7191c542d9ae with identifier: EG14085
2026-03-29 18:42:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a78b96b-cc9a-54ce-8a88-7191c542d9ae with scrape type 2
2026-03-29 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a78b96b-cc9a-54ce-8a88-7191c542d9ae with scrape type 2
2026-03-29 18:42:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a78b96b-cc9a-54ce-8a88-7191c542d9ae, identifier: EG14085
2026-03-29 18:42:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a78b96b-cc9a-54ce-8a88-7191c542d9ae with identifier: EG14085
2026-03-29 18:42:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a78b96b-cc9a-54ce-8a88-7191c542d9ae with identifier: EG14085
2026-03-29 18:42:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a78b96b-cc9a-54ce-8a88-7191c542d9ae with identifier: EG14085 to the API
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:45:30Z',
'fuel_type': 'petrol',
'id': '3a78b96b-cc9a-54ce-8a88-7191c542d9ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG14085',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 294416,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-04',
'seller_name': None,
'title': 'BMW X1 xDrive 28i',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG14085%27 HTTP/1.1" 200 None
2026-03-29 18:42:59 [auto1.de] INFO: Saving data for EG14085: {'auction_closing_time': 1774885530.0, 'created_time': 1774636312.404874, 'last_price_update_time': 1774809779.731462}
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG14085') HTTP/1.1" 204 0
2026-03-29 18:42:59 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH53408%27 HTTP/1.1" 200 None
2026-03-29 18:42:59 [auto1.de] INFO: Scrape type for GH53408: 0
2026-03-29 18:42:59 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ08644%27 HTTP/1.1" 200 None
2026-03-29 18:42:59 [auto1.de] INFO: Scrape type for NJ08644: 0
2026-03-29 18:42:59 [auto1.de] INFO: Found listing with ID: XP52765
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP52765%27 HTTP/1.1" 200 None
2026-03-29 18:42:59 [auto1.de] INFO: Scrape type for XP52765: 2
2026-03-29 18:42:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 267c74ff-4f29-5431-bd4f-66ab368066b2 with identifier: XP52765
2026-03-29 18:42:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 267c74ff-4f29-5431-bd4f-66ab368066b2 with scrape type 2
2026-03-29 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 267c74ff-4f29-5431-bd4f-66ab368066b2 with scrape type 2
2026-03-29 18:42:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 267c74ff-4f29-5431-bd4f-66ab368066b2, identifier: XP52765
2026-03-29 18:42:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 267c74ff-4f29-5431-bd4f-66ab368066b2 with identifier: XP52765
2026-03-29 18:42:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 267c74ff-4f29-5431-bd4f-66ab368066b2 with identifier: XP52765
2026-03-29 18:42:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 267c74ff-4f29-5431-bd4f-66ab368066b2 with identifier: XP52765 to the API
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:49:19Z',
'fuel_type': 'petrol',
'id': '267c74ff-4f29-5431-bd4f-66ab368066b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP52765',
'listing': 'auction',
'make': 'Peugeot',
'model': '107',
'odometer': 103385,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-15',
'seller_name': None,
'title': 'Peugeot 107 1.0 Filou',
'transmission': 'manual',
'trim': 'Filou',
'year': 2009}
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP52765%27 HTTP/1.1" 200 None
2026-03-29 18:43:00 [auto1.de] INFO: Saving data for XP52765: {'auction_closing_time': 1774885759.0, 'created_time': 1773427523.810322, 'last_price_update_time': 1774809780.192387}
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP52765') HTTP/1.1" 204 0
2026-03-29 18:43:00 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM78498%27 HTTP/1.1" 200 None
2026-03-29 18:43:00 [auto1.de] INFO: Scrape type for UM78498: 0
2026-03-29 18:43:00 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM97258%27 HTTP/1.1" 200 None
2026-03-29 18:43:00 [auto1.de] INFO: Scrape type for WM97258: 2
2026-03-29 18:43:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63904e79-c2a1-5dc7-b6fa-b4f71509d070 with identifier: WM97258
2026-03-29 18:43:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63904e79-c2a1-5dc7-b6fa-b4f71509d070 with scrape type 2
2026-03-29 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63904e79-c2a1-5dc7-b6fa-b4f71509d070 with scrape type 2
2026-03-29 18:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63904e79-c2a1-5dc7-b6fa-b4f71509d070, identifier: WM97258
2026-03-29 18:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63904e79-c2a1-5dc7-b6fa-b4f71509d070 with identifier: WM97258
2026-03-29 18:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63904e79-c2a1-5dc7-b6fa-b4f71509d070 with identifier: WM97258
2026-03-29 18:43:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63904e79-c2a1-5dc7-b6fa-b4f71509d070 with identifier: WM97258 to the API
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:26:41Z',
'fuel_type': 'petrol',
'id': '63904e79-c2a1-5dc7-b6fa-b4f71509d070',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM97258',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 125283,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-23',
'seller_name': None,
'title': 'Ford S-Max 2.0 EcoBoost ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2018}
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM97258%27 HTTP/1.1" 200 None
2026-03-29 18:43:00 [auto1.de] INFO: Saving data for WM97258: {'auction_closing_time': 1774884401.0, 'created_time': 1773428367.319937, 'last_price_update_time': 1774809780.703637}
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM97258') HTTP/1.1" 204 0
2026-03-29 18:43:00 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-29 18:43:00 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-29 18:43:00 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-29 18:43:00 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-29 18:43:00 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM40362%27 HTTP/1.1" 200 None
2026-03-29 18:43:00 [auto1.de] INFO: Scrape type for CM40362: 0
2026-03-29 18:43:00 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR95104%27 HTTP/1.1" 200 None
2026-03-29 18:43:00 [auto1.de] INFO: Scrape type for RR95104: 2
2026-03-29 18:43:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3ca586b-0878-5598-b264-ef661f73908e with identifier: RR95104
2026-03-29 18:43:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3ca586b-0878-5598-b264-ef661f73908e with scrape type 2
2026-03-29 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3ca586b-0878-5598-b264-ef661f73908e with scrape type 2
2026-03-29 18:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3ca586b-0878-5598-b264-ef661f73908e, identifier: RR95104
2026-03-29 18:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3ca586b-0878-5598-b264-ef661f73908e with identifier: RR95104
2026-03-29 18:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3ca586b-0878-5598-b264-ef661f73908e with identifier: RR95104
2026-03-29 18:43:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3ca586b-0878-5598-b264-ef661f73908e with identifier: RR95104 to the API
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:18:03Z',
'fuel_type': 'diesel',
'id': 'd3ca586b-0878-5598-b264-ef661f73908e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR95104',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 213283,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-27',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Ambition 4x4',
'transmission': 'automatic',
'trim': 'Ambition 4x4',
'year': 2017}
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR95104%27 HTTP/1.1" 200 None
2026-03-29 18:43:01 [auto1.de] INFO: Saving data for RR95104: {'auction_closing_time': 1774883883.0, 'created_time': 1773132415.151988, 'last_price_update_time': 1774809781.14139}
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR95104') HTTP/1.1" 204 0
2026-03-29 18:43:01 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM34350%27 HTTP/1.1" 200 None
2026-03-29 18:43:01 [auto1.de] INFO: Scrape type for NM34350: 2
2026-03-29 18:43:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 469b614c-03f3-5918-9632-ebdc8c3a0485 with identifier: NM34350
2026-03-29 18:43:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 469b614c-03f3-5918-9632-ebdc8c3a0485 with scrape type 2
2026-03-29 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 469b614c-03f3-5918-9632-ebdc8c3a0485 with scrape type 2
2026-03-29 18:43:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 469b614c-03f3-5918-9632-ebdc8c3a0485, identifier: NM34350
2026-03-29 18:43:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 469b614c-03f3-5918-9632-ebdc8c3a0485 with identifier: NM34350
2026-03-29 18:43:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 469b614c-03f3-5918-9632-ebdc8c3a0485 with identifier: NM34350
2026-03-29 18:43:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 469b614c-03f3-5918-9632-ebdc8c3a0485 with identifier: NM34350 to the API
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:46:19Z',
'fuel_type': 'diesel',
'id': '469b614c-03f3-5918-9632-ebdc8c3a0485',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM34350',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Viano',
'odometer': 121559,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-13',
'seller_name': None,
'title': 'Mercedes-Benz Viano 2.1 CDI kompakt Trend Edition',
'transmission': 'automatic',
'trim': 'kompakt Trend Edition',
'year': 2012}
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM34350%27 HTTP/1.1" 200 None
2026-03-29 18:43:01 [auto1.de] INFO: Saving data for NM34350: {'auction_closing_time': 1774885579.0, 'created_time': 1773399879.682511, 'last_price_update_time': 1774809781.598463}
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM34350') HTTP/1.1" 204 0
2026-03-29 18:43:01 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52783%27 HTTP/1.1" 200 None
2026-03-29 18:43:01 [auto1.de] INFO: Scrape type for CJ52783: 2
2026-03-29 18:43:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with identifier: CJ52783
2026-03-29 18:43:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with scrape type 2
2026-03-29 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with scrape type 2
2026-03-29 18:43:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd51997c-a2b2-546a-a07c-8c0a10a46ef2, identifier: CJ52783
2026-03-29 18:43:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with identifier: CJ52783
2026-03-29 18:43:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with identifier: CJ52783
2026-03-29 18:43:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with identifier: CJ52783 to the API
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:02:39Z',
'fuel_type': 'petrol',
'id': 'cd51997c-a2b2-546a-a07c-8c0a10a46ef2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ52783',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 41419,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-08-31',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 Goal',
'transmission': 'manual',
'trim': 'Goal',
'year': 2006}
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52783%27 HTTP/1.1" 200 None
2026-03-29 18:43:02 [auto1.de] INFO: Saving data for CJ52783: {'auction_closing_time': 1774882959.0, 'created_time': 1773304833.969446, 'last_price_update_time': 1774809782.101305}
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ52783') HTTP/1.1" 204 0
2026-03-29 18:43:02 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG36075%27 HTTP/1.1" 200 None
2026-03-29 18:43:02 [auto1.de] INFO: Scrape type for XG36075: 0
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT60499%27 HTTP/1.1" 200 None
2026-03-29 18:43:02 [auto1.de] INFO: Scrape type for YT60499: 2
2026-03-29 18:43:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 314e6253-8b60-580d-b2a3-cb05e09fffff with identifier: YT60499
2026-03-29 18:43:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 314e6253-8b60-580d-b2a3-cb05e09fffff with scrape type 2
2026-03-29 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 314e6253-8b60-580d-b2a3-cb05e09fffff with scrape type 2
2026-03-29 18:43:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 314e6253-8b60-580d-b2a3-cb05e09fffff, identifier: YT60499
2026-03-29 18:43:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 314e6253-8b60-580d-b2a3-cb05e09fffff with identifier: YT60499
2026-03-29 18:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 314e6253-8b60-580d-b2a3-cb05e09fffff with identifier: YT60499
2026-03-29 18:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 314e6253-8b60-580d-b2a3-cb05e09fffff with identifier: YT60499 to the API
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:30:52Z',
'fuel_type': 'petrol',
'id': '314e6253-8b60-580d-b2a3-cb05e09fffff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT60499',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Jimny',
'odometer': 86340,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-04',
'seller_name': None,
'title': 'Suzuki Jimny 1.3 Ranger Comfort',
'transmission': 'manual',
'trim': 'Ranger Comfort',
'year': 2015}
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT60499%27 HTTP/1.1" 200 None
2026-03-29 18:43:02 [auto1.de] INFO: Saving data for YT60499: {'auction_closing_time': 1774884652.0, 'created_time': 1773858693.232277, 'last_price_update_time': 1774809782.611589}
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT60499') HTTP/1.1" 204 0
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU85888%27 HTTP/1.1" 200 None
2026-03-29 18:43:02 [auto1.de] INFO: Scrape type for ZU85888: 2
2026-03-29 18:43:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with identifier: ZU85888
2026-03-29 18:43:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with scrape type 2
2026-03-29 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with scrape type 2
2026-03-29 18:43:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0f1b08f-2561-5fb0-886a-0e49d3d43b97, identifier: ZU85888
2026-03-29 18:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with identifier: ZU85888
2026-03-29 18:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with identifier: ZU85888
2026-03-29 18:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with identifier: ZU85888 to the API
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:41:00Z',
'fuel_type': 'petrol',
'id': 'd0f1b08f-2561-5fb0-886a-0e49d3d43b97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU85888',
'listing': 'auction',
'make': 'Honda',
'model': 'Jazz',
'odometer': 101609,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-23',
'seller_name': None,
'title': 'Honda Jazz 1.4 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2013}
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU85888%27 HTTP/1.1" 200 None
2026-03-29 18:43:03 [auto1.de] INFO: Saving data for ZU85888: {'auction_closing_time': 1774885260.0, 'created_time': 1774607703.654761, 'last_price_update_time': 1774809783.198489}
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU85888') HTTP/1.1" 204 0
2026-03-29 18:43:03 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81412%27 HTTP/1.1" 200 None
2026-03-29 18:43:03 [auto1.de] INFO: Scrape type for DK81412: 0
2026-03-29 18:43:03 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-29 18:43:03 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS74184%27 HTTP/1.1" 200 None
2026-03-29 18:43:03 [auto1.de] INFO: Scrape type for YS74184: 0
2026-03-29 18:43:03 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32752%27 HTTP/1.1" 200 None
2026-03-29 18:43:03 [auto1.de] INFO: Scrape type for MK32752: 0
2026-03-29 18:43:03 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK08799%27 HTTP/1.1" 200 None
2026-03-29 18:43:03 [auto1.de] INFO: Scrape type for SK08799: 2
2026-03-29 18:43:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28aa186b-4279-5dd4-9837-779fbae1060d with identifier: SK08799
2026-03-29 18:43:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28aa186b-4279-5dd4-9837-779fbae1060d with scrape type 2
2026-03-29 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28aa186b-4279-5dd4-9837-779fbae1060d with scrape type 2
2026-03-29 18:43:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28aa186b-4279-5dd4-9837-779fbae1060d, identifier: SK08799
2026-03-29 18:43:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28aa186b-4279-5dd4-9837-779fbae1060d with identifier: SK08799
2026-03-29 18:43:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28aa186b-4279-5dd4-9837-779fbae1060d with identifier: SK08799
2026-03-29 18:43:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28aa186b-4279-5dd4-9837-779fbae1060d with identifier: SK08799 to the API
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:17:10Z',
'fuel_type': 'petrol',
'id': '28aa186b-4279-5dd4-9837-779fbae1060d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK08799',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 82435,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-03',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.5 TSI ACT Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2018}
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK08799%27 HTTP/1.1" 200 None
2026-03-29 18:43:03 [auto1.de] INFO: Saving data for SK08799: {'auction_closing_time': 1774883830.0, 'created_time': 1774521726.715897, 'last_price_update_time': 1774809783.671809}
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK08799') HTTP/1.1" 204 0
2026-03-29 18:43:03 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT57416%27 HTTP/1.1" 200 None
2026-03-29 18:43:03 [auto1.de] INFO: Scrape type for GT57416: 2
2026-03-29 18:43:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 586c1eaf-1f2e-59cf-8176-275edac29733 with identifier: GT57416
2026-03-29 18:43:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 586c1eaf-1f2e-59cf-8176-275edac29733 with scrape type 2
2026-03-29 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 586c1eaf-1f2e-59cf-8176-275edac29733 with scrape type 2
2026-03-29 18:43:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 586c1eaf-1f2e-59cf-8176-275edac29733, identifier: GT57416
2026-03-29 18:43:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 586c1eaf-1f2e-59cf-8176-275edac29733 with identifier: GT57416
2026-03-29 18:43:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 586c1eaf-1f2e-59cf-8176-275edac29733 with identifier: GT57416
2026-03-29 18:43:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 586c1eaf-1f2e-59cf-8176-275edac29733 with identifier: GT57416 to the API
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:31:24Z',
'fuel_type': 'diesel',
'id': '586c1eaf-1f2e-59cf-8176-275edac29733',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT57416',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 170364,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-03',
'seller_name': None,
'title': 'Hyundai i30 1.6 CRDi YES!',
'transmission': 'manual',
'trim': 'YES!',
'year': 2015}
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT57416%27 HTTP/1.1" 200 None
2026-03-29 18:43:04 [auto1.de] INFO: Saving data for GT57416: {'auction_closing_time': 1774884684.0, 'created_time': 1774607758.615614, 'last_price_update_time': 1774809784.120154}
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT57416') HTTP/1.1" 204 0
2026-03-29 18:43:04 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-29 18:43:04 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97502%27 HTTP/1.1" 200 None
2026-03-29 18:43:04 [auto1.de] INFO: Scrape type for PA97502: 2
2026-03-29 18:43:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with identifier: PA97502
2026-03-29 18:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with scrape type 2
2026-03-29 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with scrape type 2
2026-03-29 18:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa, identifier: PA97502
2026-03-29 18:43:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with identifier: PA97502
2026-03-29 18:43:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with identifier: PA97502
2026-03-29 18:43:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with identifier: PA97502 to the API
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:42:20Z',
'fuel_type': 'petrol',
'id': '9d559c7c-361b-5c58-a8ca-c2bc92fd41aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA97502',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4',
'odometer': 21785,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-27',
'seller_name': None,
'title': 'Suzuki SX4 1.0 BoosterJet Comfort',
'transmission': 'automatic',
'trim': 'Comfort',
'year': 2018}
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97502%27 HTTP/1.1" 200 None
2026-03-29 18:43:04 [auto1.de] INFO: Saving data for PA97502: {'auction_closing_time': 1774885340.0, 'created_time': 1773513855.997175, 'last_price_update_time': 1774809784.744791}
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA97502') HTTP/1.1" 204 0
2026-03-29 18:43:04 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS20151%27 HTTP/1.1" 200 None
2026-03-29 18:43:04 [auto1.de] INFO: Scrape type for VS20151: 2
2026-03-29 18:43:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ac86c52-4369-5daf-b646-00187e7a692b with identifier: VS20151
2026-03-29 18:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ac86c52-4369-5daf-b646-00187e7a692b with scrape type 2
2026-03-29 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ac86c52-4369-5daf-b646-00187e7a692b with scrape type 2
2026-03-29 18:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ac86c52-4369-5daf-b646-00187e7a692b, identifier: VS20151
2026-03-29 18:43:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ac86c52-4369-5daf-b646-00187e7a692b with identifier: VS20151
2026-03-29 18:43:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ac86c52-4369-5daf-b646-00187e7a692b with identifier: VS20151
2026-03-29 18:43:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ac86c52-4369-5daf-b646-00187e7a692b with identifier: VS20151 to the API
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:45:28Z',
'fuel_type': 'diesel',
'id': '1ac86c52-4369-5daf-b646-00187e7a692b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS20151',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 155928,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-14',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2019}
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS20151%27 HTTP/1.1" 200 None
2026-03-29 18:43:05 [auto1.de] INFO: Saving data for VS20151: {'auction_closing_time': 1774885528.0, 'created_time': 1773400082.501929, 'last_price_update_time': 1774809785.154867}
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS20151') HTTP/1.1" 204 0
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST89847%27 HTTP/1.1" 200 None
2026-03-29 18:43:05 [auto1.de] INFO: Scrape type for ST89847: 0
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR87294%27 HTTP/1.1" 200 None
2026-03-29 18:43:05 [auto1.de] INFO: Scrape type for JR87294: 2
2026-03-29 18:43:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4 with identifier: JR87294
2026-03-29 18:43:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4 with scrape type 2
2026-03-29 18:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4 with scrape type 2
2026-03-29 18:43:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4, identifier: JR87294
2026-03-29 18:43:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4 with identifier: JR87294
2026-03-29 18:43:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4 with identifier: JR87294
2026-03-29 18:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4 with identifier: JR87294 to the API
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:30:15Z',
'fuel_type': 'petrol',
'id': 'cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR87294',
'listing': 'auction',
'make': 'Smart',
'model': 'forfour',
'odometer': 47682,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-05',
'seller_name': None,
'title': 'Smart forfour 1.0 Basis passion',
'transmission': 'manual',
'trim': 'Basis passion',
'year': 2015}
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR87294%27 HTTP/1.1" 200 None
2026-03-29 18:43:05 [auto1.de] INFO: Saving data for JR87294: {'auction_closing_time': 1774884615.0, 'created_time': 1774521133.030765, 'last_price_update_time': 1774809785.58486}
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR87294') HTTP/1.1" 204 0
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV15906%27 HTTP/1.1" 200 None
2026-03-29 18:43:05 [auto1.de] INFO: Scrape type for XV15906: 2
2026-03-29 18:43:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 666faad5-4cf8-56c3-b8b5-ffec1c29c1a4 with identifier: XV15906
2026-03-29 18:43:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 666faad5-4cf8-56c3-b8b5-ffec1c29c1a4 with scrape type 2
2026-03-29 18:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 666faad5-4cf8-56c3-b8b5-ffec1c29c1a4 with scrape type 2
2026-03-29 18:43:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 666faad5-4cf8-56c3-b8b5-ffec1c29c1a4, identifier: XV15906
2026-03-29 18:43:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 666faad5-4cf8-56c3-b8b5-ffec1c29c1a4 with identifier: XV15906
2026-03-29 18:43:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 666faad5-4cf8-56c3-b8b5-ffec1c29c1a4 with identifier: XV15906
2026-03-29 18:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 666faad5-4cf8-56c3-b8b5-ffec1c29c1a4 with identifier: XV15906 to the API
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:55:16Z',
'fuel_type': 'petrol',
'id': '666faad5-4cf8-56c3-b8b5-ffec1c29c1a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV15906',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 239299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-10-08',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.4 TSI United',
'transmission': 'manual',
'trim': 'United',
'year': 2008}
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV15906%27 HTTP/1.1" 200 None
2026-03-29 18:43:06 [auto1.de] INFO: Saving data for XV15906: {'auction_closing_time': 1774886116.0, 'created_time': 1774522010.27279, 'last_price_update_time': 1774809786.15784}
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV15906') HTTP/1.1" 204 0
2026-03-29 18:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:06 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV46397%27 HTTP/1.1" 200 None
2026-03-29 18:43:06 [auto1.de] INFO: Scrape type for FV46397: 0
2026-03-29 18:43:06 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB77182%27 HTTP/1.1" 200 None
2026-03-29 18:43:06 [auto1.de] INFO: Scrape type for RB77182: 2
2026-03-29 18:43:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6203c47-d9c1-55ca-9f5c-077d71936cc6 with identifier: RB77182
2026-03-29 18:43:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6203c47-d9c1-55ca-9f5c-077d71936cc6 with scrape type 2
2026-03-29 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6203c47-d9c1-55ca-9f5c-077d71936cc6 with scrape type 2
2026-03-29 18:43:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6203c47-d9c1-55ca-9f5c-077d71936cc6, identifier: RB77182
2026-03-29 18:43:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6203c47-d9c1-55ca-9f5c-077d71936cc6 with identifier: RB77182
2026-03-29 18:43:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6203c47-d9c1-55ca-9f5c-077d71936cc6 with identifier: RB77182
2026-03-29 18:43:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6203c47-d9c1-55ca-9f5c-077d71936cc6 with identifier: RB77182 to the API
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:43:50Z',
'fuel_type': 'petrol',
'id': 'd6203c47-d9c1-55ca-9f5c-077d71936cc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB77182',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 57286,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-10',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 TGDI N-Line 2WD',
'transmission': 'automatic',
'trim': 'N-Line 2WD',
'year': 2020}
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB77182%27 HTTP/1.1" 200 None
2026-03-29 18:43:06 [auto1.de] INFO: Saving data for RB77182: {'auction_closing_time': 1774885430.0, 'created_time': 1773657801.925021, 'last_price_update_time': 1774809786.62818}
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB77182') HTTP/1.1" 204 0
2026-03-29 18:43:06 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-29 18:43:06 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-29 18:43:06 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-29 18:43:06 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL60682%27 HTTP/1.1" 200 None
2026-03-29 18:43:06 [auto1.de] INFO: Scrape type for LL60682: 0
2026-03-29 18:43:06 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA44433%27 HTTP/1.1" 200 None
2026-03-29 18:43:06 [auto1.de] INFO: Scrape type for HA44433: 2
2026-03-29 18:43:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7c970f9-065a-51fb-aa8f-aae41c1e8396 with identifier: HA44433
2026-03-29 18:43:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7c970f9-065a-51fb-aa8f-aae41c1e8396 with scrape type 2
2026-03-29 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7c970f9-065a-51fb-aa8f-aae41c1e8396 with scrape type 2
2026-03-29 18:43:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7c970f9-065a-51fb-aa8f-aae41c1e8396, identifier: HA44433
2026-03-29 18:43:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7c970f9-065a-51fb-aa8f-aae41c1e8396 with identifier: HA44433
2026-03-29 18:43:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7c970f9-065a-51fb-aa8f-aae41c1e8396 with identifier: HA44433
2026-03-29 18:43:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7c970f9-065a-51fb-aa8f-aae41c1e8396 with identifier: HA44433 to the API
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:37:57Z',
'fuel_type': 'petrol',
'id': 'a7c970f9-065a-51fb-aa8f-aae41c1e8396',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA44433',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 212675,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-12-31',
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'manual',
'trim': '',
'year': 2006}
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA44433%27 HTTP/1.1" 200 None
2026-03-29 18:43:07 [auto1.de] INFO: Saving data for HA44433: {'auction_closing_time': 1774885077.0, 'created_time': 1774636551.55244, 'last_price_update_time': 1774809787.032523}
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA44433') HTTP/1.1" 204 0
2026-03-29 18:43:07 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:07 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-29 18:43:07 [scrapy.extensions.logstats] INFO: Crawled 140 pages (at 11 pages/min), scraped 1144 items (at 103 items/min)
2026-03-29 18:43:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:43:07 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-29 18:43:07 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-29 18:43:07 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89371%27 HTTP/1.1" 200 None
2026-03-29 18:43:07 [auto1.de] INFO: Scrape type for CC89371: 2
2026-03-29 18:43:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 890ec45a-502a-5db8-9b63-0c20285237bf with identifier: CC89371
2026-03-29 18:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 890ec45a-502a-5db8-9b63-0c20285237bf with scrape type 2
2026-03-29 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 890ec45a-502a-5db8-9b63-0c20285237bf with scrape type 2
2026-03-29 18:43:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 890ec45a-502a-5db8-9b63-0c20285237bf, identifier: CC89371
2026-03-29 18:43:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 890ec45a-502a-5db8-9b63-0c20285237bf with identifier: CC89371
2026-03-29 18:43:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 890ec45a-502a-5db8-9b63-0c20285237bf with identifier: CC89371
2026-03-29 18:43:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 890ec45a-502a-5db8-9b63-0c20285237bf with identifier: CC89371 to the API
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:46:51Z',
'fuel_type': 'petrol',
'id': '890ec45a-502a-5db8-9b63-0c20285237bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC89371',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 84446,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-25',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
'transmission': 'manual',
'trim': 'BlueEfficiency Urban',
'year': 2013}
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89371%27 HTTP/1.1" 200 None
2026-03-29 18:43:07 [auto1.de] INFO: Saving data for CC89371: {'auction_closing_time': 1774885611.0, 'created_time': 1773301802.505674, 'last_price_update_time': 1774809787.535742}
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC89371') HTTP/1.1" 204 0
2026-03-29 18:43:07 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01003%27 HTTP/1.1" 200 None
2026-03-29 18:43:07 [auto1.de] INFO: Scrape type for BX01003: 2
2026-03-29 18:43:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with identifier: BX01003
2026-03-29 18:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with scrape type 2
2026-03-29 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with scrape type 2
2026-03-29 18:43:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98c38b85-ceba-5d4b-956a-6b2d4cb9925a, identifier: BX01003
2026-03-29 18:43:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with identifier: BX01003
2026-03-29 18:43:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with identifier: BX01003
2026-03-29 18:43:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with identifier: BX01003 to the API
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:00:19Z',
'fuel_type': 'petrol',
'id': '98c38b85-ceba-5d4b-956a-6b2d4cb9925a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX01003',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 55721,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-17',
'seller_name': None,
'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2023}
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01003%27 HTTP/1.1" 200 None
2026-03-29 18:43:08 [auto1.de] INFO: Saving data for BX01003: {'auction_closing_time': 1774882819.0, 'created_time': 1774033517.222013, 'last_price_update_time': 1774809788.139799}
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX01003') HTTP/1.1" 204 0
2026-03-29 18:43:08 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-29 18:43:08 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-29 18:43:08 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-29 18:43:08 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK17231%27 HTTP/1.1" 200 None
2026-03-29 18:43:08 [auto1.de] INFO: Scrape type for LK17231: 2
2026-03-29 18:43:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 726745aa-17cc-59d9-8902-f42288787c70 with identifier: LK17231
2026-03-29 18:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 726745aa-17cc-59d9-8902-f42288787c70 with scrape type 2
2026-03-29 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 726745aa-17cc-59d9-8902-f42288787c70 with scrape type 2
2026-03-29 18:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 726745aa-17cc-59d9-8902-f42288787c70, identifier: LK17231
2026-03-29 18:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 726745aa-17cc-59d9-8902-f42288787c70 with identifier: LK17231
2026-03-29 18:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 726745aa-17cc-59d9-8902-f42288787c70 with identifier: LK17231
2026-03-29 18:43:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 726745aa-17cc-59d9-8902-f42288787c70 with identifier: LK17231 to the API
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-30T15:26:40Z',
'fuel_type': 'petrol',
'id': '726745aa-17cc-59d9-8902-f42288787c70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK17231',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 57672,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-07-31',
'seller_name': None,
'title': 'Citroen C3 1.4 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2007}
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK17231%27 HTTP/1.1" 200 None
2026-03-29 18:43:08 [auto1.de] INFO: Saving data for LK17231: {'auction_closing_time': 1774884400.0, 'created_time': 1773138506.134942, 'last_price_update_time': 1774809788.648884}
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK17231') HTTP/1.1" 204 0
2026-03-29 18:43:08 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00515%27 HTTP/1.1" 200 None
2026-03-29 18:43:08 [auto1.de] INFO: Scrape type for PB00515: 2
2026-03-29 18:43:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6e1402e-8925-52ef-934e-c21e55e60c66 with identifier: PB00515
2026-03-29 18:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6e1402e-8925-52ef-934e-c21e55e60c66 with scrape type 2
2026-03-29 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6e1402e-8925-52ef-934e-c21e55e60c66 with scrape type 2
2026-03-29 18:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6e1402e-8925-52ef-934e-c21e55e60c66, identifier: PB00515
2026-03-29 18:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6e1402e-8925-52ef-934e-c21e55e60c66 with identifier: PB00515
2026-03-29 18:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6e1402e-8925-52ef-934e-c21e55e60c66 with identifier: PB00515
2026-03-29 18:43:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6e1402e-8925-52ef-934e-c21e55e60c66 with identifier: PB00515 to the API
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:13:12Z',
'fuel_type': 'gas',
'id': 'c6e1402e-8925-52ef-934e-c21e55e60c66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB00515',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 26127,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-28',
'seller_name': None,
'title': 'Dacia Duster 1.0 TCe LPG Journey',
'transmission': 'manual',
'trim': 'Journey',
'year': 2023}
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00515%27 HTTP/1.1" 200 None
2026-03-29 18:43:09 [auto1.de] INFO: Saving data for PB00515: {'auction_closing_time': 1774883592.0, 'created_time': 1773429143.181395, 'last_price_update_time': 1774809789.101777}
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB00515') HTTP/1.1" 204 0
2026-03-29 18:43:09 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-29 18:43:09 [auto1.de] INFO: Found listing with ID: EX67189
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX67189%27 HTTP/1.1" 200 None
2026-03-29 18:43:09 [auto1.de] INFO: Scrape type for EX67189: 2
2026-03-29 18:43:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9520c1f3-c685-53e4-87dd-0450025efb61 with identifier: EX67189
2026-03-29 18:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9520c1f3-c685-53e4-87dd-0450025efb61 with scrape type 2
2026-03-29 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9520c1f3-c685-53e4-87dd-0450025efb61 with scrape type 2
2026-03-29 18:43:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9520c1f3-c685-53e4-87dd-0450025efb61, identifier: EX67189
2026-03-29 18:43:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9520c1f3-c685-53e4-87dd-0450025efb61 with identifier: EX67189
2026-03-29 18:43:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9520c1f3-c685-53e4-87dd-0450025efb61 with identifier: EX67189
2026-03-29 18:43:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9520c1f3-c685-53e4-87dd-0450025efb61 with identifier: EX67189 to the API
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:18:39Z',
'fuel_type': 'petrol',
'id': '9520c1f3-c685-53e4-87dd-0450025efb61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX67189',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 65196,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-06',
'seller_name': None,
'title': 'Renault Kadjar 1.3 TCe Zen',
'transmission': 'automatic',
'trim': 'Zen',
'year': 2022}
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX67189%27 HTTP/1.1" 200 None
2026-03-29 18:43:09 [auto1.de] INFO: Saving data for EX67189: {'auction_closing_time': 1774883919.0, 'created_time': 1774118453.993817, 'last_price_update_time': 1774809789.513762}
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX67189') HTTP/1.1" 204 0
2026-03-29 18:43:09 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09257%27 HTTP/1.1" 200 None
2026-03-29 18:43:09 [auto1.de] INFO: Scrape type for LL09257: 2
2026-03-29 18:43:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with identifier: LL09257
2026-03-29 18:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with scrape type 2
2026-03-29 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with scrape type 2
2026-03-29 18:43:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e, identifier: LL09257
2026-03-29 18:43:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with identifier: LL09257
2026-03-29 18:43:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with identifier: LL09257
2026-03-29 18:43:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with identifier: LL09257 to the API
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:41:40Z',
'fuel_type': 'petrol',
'id': 'c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL09257',
'listing': 'auction',
'make': 'Cupra',
'model': 'Ateca',
'odometer': 44520,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-01',
'seller_name': None,
'title': 'Cupra Ateca 2.0 TSI 4Drive',
'transmission': 'automatic',
'trim': '4Drive',
'year': 2020}
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09257%27 HTTP/1.1" 200 None
2026-03-29 18:43:09 [auto1.de] INFO: Saving data for LL09257: {'auction_closing_time': 1774885300.0, 'created_time': 1773427808.751477, 'last_price_update_time': 1774809789.968906}
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL09257') HTTP/1.1" 204 0
2026-03-29 18:43:09 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92751%27 HTTP/1.1" 200 None
2026-03-29 18:43:10 [auto1.de] INFO: Scrape type for SC92751: 0
2026-03-29 18:43:10 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS94316%27 HTTP/1.1" 200 None
2026-03-29 18:43:10 [auto1.de] INFO: Scrape type for KS94316: 2
2026-03-29 18:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbf4f19c-9a14-54c3-8293-93f7d40e4257 with identifier: KS94316
2026-03-29 18:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf4f19c-9a14-54c3-8293-93f7d40e4257 with scrape type 2
2026-03-29 18:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbf4f19c-9a14-54c3-8293-93f7d40e4257 with scrape type 2
2026-03-29 18:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbf4f19c-9a14-54c3-8293-93f7d40e4257, identifier: KS94316
2026-03-29 18:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbf4f19c-9a14-54c3-8293-93f7d40e4257 with identifier: KS94316
2026-03-29 18:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbf4f19c-9a14-54c3-8293-93f7d40e4257 with identifier: KS94316
2026-03-29 18:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbf4f19c-9a14-54c3-8293-93f7d40e4257 with identifier: KS94316 to the API
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:13:40Z',
'fuel_type': 'gas',
'id': 'bbf4f19c-9a14-54c3-8293-93f7d40e4257',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS94316',
'listing': 'auction',
'make': 'Opel',
'model': 'Combo',
'odometer': 77698,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-25',
'seller_name': None,
'title': 'Opel Combo 1.4 Turbo Kasten L1H1 2,4t',
'transmission': 'manual',
'trim': 'Kasten L1H1 2,4t',
'year': 2014}
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS94316%27 HTTP/1.1" 200 None
2026-03-29 18:43:10 [auto1.de] INFO: Saving data for KS94316: {'auction_closing_time': 1774883620.0, 'created_time': 1772725963.182595, 'last_price_update_time': 1774809790.471578}
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS94316') HTTP/1.1" 204 0
2026-03-29 18:43:10 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML83071%27 HTTP/1.1" 200 None
2026-03-29 18:43:10 [auto1.de] INFO: Scrape type for ML83071: 2
2026-03-29 18:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf1464de-ec0f-5df8-9637-527ced3807d1 with identifier: ML83071
2026-03-29 18:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf1464de-ec0f-5df8-9637-527ced3807d1 with scrape type 2
2026-03-29 18:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf1464de-ec0f-5df8-9637-527ced3807d1 with scrape type 2
2026-03-29 18:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf1464de-ec0f-5df8-9637-527ced3807d1, identifier: ML83071
2026-03-29 18:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf1464de-ec0f-5df8-9637-527ced3807d1 with identifier: ML83071
2026-03-29 18:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf1464de-ec0f-5df8-9637-527ced3807d1 with identifier: ML83071
2026-03-29 18:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf1464de-ec0f-5df8-9637-527ced3807d1 with identifier: ML83071 to the API
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:23:38Z',
'fuel_type': 'diesel',
'id': 'bf1464de-ec0f-5df8-9637-527ced3807d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML83071',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 240215,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-29',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi Spirit 4WD',
'transmission': 'automatic',
'trim': 'Spirit 4WD',
'year': 2010}
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML83071%27 HTTP/1.1" 200 None
2026-03-29 18:43:11 [auto1.de] INFO: Saving data for ML83071: {'auction_closing_time': 1774884218.0, 'created_time': 1773811836.820344, 'last_price_update_time': 1774809791.014818}
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML83071') HTTP/1.1" 204 0
2026-03-29 18:43:11 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP96640%27 HTTP/1.1" 200 None
2026-03-29 18:43:11 [auto1.de] INFO: Scrape type for TP96640: 0
2026-03-29 18:43:11 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-29 18:43:11 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX44757%27 HTTP/1.1" 200 None
2026-03-29 18:43:11 [auto1.de] INFO: Scrape type for EX44757: 2
2026-03-29 18:43:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 066ffbf9-6508-598f-af05-dcba518c9392 with identifier: EX44757
2026-03-29 18:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 066ffbf9-6508-598f-af05-dcba518c9392 with scrape type 2
2026-03-29 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 066ffbf9-6508-598f-af05-dcba518c9392 with scrape type 2
2026-03-29 18:43:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 066ffbf9-6508-598f-af05-dcba518c9392, identifier: EX44757
2026-03-29 18:43:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 066ffbf9-6508-598f-af05-dcba518c9392 with identifier: EX44757
2026-03-29 18:43:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 066ffbf9-6508-598f-af05-dcba518c9392 with identifier: EX44757
2026-03-29 18:43:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 066ffbf9-6508-598f-af05-dcba518c9392 with identifier: EX44757 to the API
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:30:35Z',
'fuel_type': 'diesel',
'id': '066ffbf9-6508-598f-af05-dcba518c9392',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX44757',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 144259,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-16',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi ST',
'transmission': 'automatic',
'trim': 'ST',
'year': 2016}
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX44757%27 HTTP/1.1" 200 None
2026-03-29 18:43:11 [auto1.de] INFO: Saving data for EX44757: {'auction_closing_time': 1774884635.0, 'created_time': 1774293911.519362, 'last_price_update_time': 1774809791.509662}
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX44757') HTTP/1.1" 204 0
2026-03-29 18:43:11 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-29 18:43:11 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL63918%27 HTTP/1.1" 200 None
2026-03-29 18:43:11 [auto1.de] INFO: Scrape type for YL63918: 2
2026-03-29 18:43:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ada1d1f-9b7e-5032-b57f-04208056cf3a with identifier: YL63918
2026-03-29 18:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ada1d1f-9b7e-5032-b57f-04208056cf3a with scrape type 2
2026-03-29 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ada1d1f-9b7e-5032-b57f-04208056cf3a with scrape type 2
2026-03-29 18:43:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ada1d1f-9b7e-5032-b57f-04208056cf3a, identifier: YL63918
2026-03-29 18:43:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ada1d1f-9b7e-5032-b57f-04208056cf3a with identifier: YL63918
2026-03-29 18:43:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ada1d1f-9b7e-5032-b57f-04208056cf3a with identifier: YL63918
2026-03-29 18:43:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ada1d1f-9b7e-5032-b57f-04208056cf3a with identifier: YL63918 to the API
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:05:24Z',
'fuel_type': 'diesel',
'id': '8ada1d1f-9b7e-5032-b57f-04208056cf3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL63918',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 141156,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-23',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2015}
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL63918%27 HTTP/1.1" 200 None
2026-03-29 18:43:11 [auto1.de] INFO: Saving data for YL63918: {'auction_closing_time': 1774883124.0, 'created_time': 1773772242.996943, 'last_price_update_time': 1774809791.988101}
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL63918') HTTP/1.1" 204 0
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR15758%27 HTTP/1.1" 200 None
2026-03-29 18:43:12 [auto1.de] INFO: Scrape type for XR15758: 0
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: US86443
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US86443%27 HTTP/1.1" 200 None
2026-03-29 18:43:12 [auto1.de] INFO: Scrape type for US86443: 0
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG07330%27 HTTP/1.1" 200 None
2026-03-29 18:43:12 [auto1.de] INFO: Scrape type for CG07330: 0
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV40211%27 HTTP/1.1" 200 None
2026-03-29 18:43:12 [auto1.de] INFO: Scrape type for HV40211: 0
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG52180%27 HTTP/1.1" 200 None
2026-03-29 18:43:12 [auto1.de] INFO: Scrape type for ZG52180: 0
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV65946%27 HTTP/1.1" 200 None
2026-03-29 18:43:12 [auto1.de] INFO: Scrape type for DV65946: 0
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY24308%27 HTTP/1.1" 200 None
2026-03-29 18:43:12 [auto1.de] INFO: Scrape type for JY24308: 2
2026-03-29 18:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23207390-4db0-57f8-8667-f0ad96e45247 with identifier: JY24308
2026-03-29 18:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23207390-4db0-57f8-8667-f0ad96e45247 with scrape type 2
2026-03-29 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23207390-4db0-57f8-8667-f0ad96e45247 with scrape type 2
2026-03-29 18:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23207390-4db0-57f8-8667-f0ad96e45247, identifier: JY24308
2026-03-29 18:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23207390-4db0-57f8-8667-f0ad96e45247 with identifier: JY24308
2026-03-29 18:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23207390-4db0-57f8-8667-f0ad96e45247 with identifier: JY24308
2026-03-29 18:43:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23207390-4db0-57f8-8667-f0ad96e45247 with identifier: JY24308 to the API
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:30:45Z',
'fuel_type': 'petrol',
'id': '23207390-4db0-57f8-8667-f0ad96e45247',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY24308',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 76181,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-07',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI R-Line 4Motion',
'transmission': 'automatic',
'trim': 'R-Line 4Motion',
'year': 2022}
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY24308%27 HTTP/1.1" 200 None
2026-03-29 18:43:12 [auto1.de] INFO: Saving data for JY24308: {'auction_closing_time': 1774884645.0, 'created_time': 1773945641.40919, 'last_price_update_time': 1774809792.491291}
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY24308') HTTP/1.1" 204 0
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ15430%27 HTTP/1.1" 200 None
2026-03-29 18:43:12 [auto1.de] INFO: Scrape type for RJ15430: 2
2026-03-29 18:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with identifier: RJ15430
2026-03-29 18:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with scrape type 2
2026-03-29 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with scrape type 2
2026-03-29 18:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0, identifier: RJ15430
2026-03-29 18:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with identifier: RJ15430
2026-03-29 18:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with identifier: RJ15430
2026-03-29 18:43:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with identifier: RJ15430 to the API
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:39:53Z',
'fuel_type': 'diesel',
'id': '7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ15430',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 243645,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-26',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 CDI T BlueEfficiency',
'transmission': 'manual',
'trim': 'T BlueEfficiency',
'year': 2012}
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ15430%27 HTTP/1.1" 200 None
2026-03-29 18:43:13 [auto1.de] INFO: Saving data for RJ15430: {'auction_closing_time': 1774885193.0, 'created_time': 1773858706.705225, 'last_price_update_time': 1774809793.083168}
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ15430') HTTP/1.1" 204 0
2026-03-29 18:43:13 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ26450%27 HTTP/1.1" 200 None
2026-03-29 18:43:13 [auto1.de] INFO: Scrape type for VJ26450: 0
2026-03-29 18:43:13 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD91634%27 HTTP/1.1" 200 None
2026-03-29 18:43:13 [auto1.de] INFO: Scrape type for UD91634: 0
2026-03-29 18:43:13 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-29 18:43:13 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:13 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN11419%27 HTTP/1.1" 200 None
2026-03-29 18:43:13 [auto1.de] INFO: Scrape type for DN11419: 2
2026-03-29 18:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with identifier: DN11419
2026-03-29 18:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with scrape type 2
2026-03-29 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with scrape type 2
2026-03-29 18:43:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de7ec40f-8acf-56d7-8ab5-3f2b2ff20614, identifier: DN11419
2026-03-29 18:43:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with identifier: DN11419
2026-03-29 18:43:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with identifier: DN11419
2026-03-29 18:43:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with identifier: DN11419 to the API
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:31:57Z',
'fuel_type': 'petrol',
'id': 'de7ec40f-8acf-56d7-8ab5-3f2b2ff20614',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN11419',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 15758,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-15',
'seller_name': None,
'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid Nightline Edition',
'transmission': 'automatic',
'trim': 'Nightline Edition',
'year': 2024}
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN11419%27 HTTP/1.1" 200 None
2026-03-29 18:43:13 [auto1.de] INFO: Saving data for DN11419: {'auction_closing_time': 1774884717.0, 'created_time': 1774291795.529176, 'last_price_update_time': 1774809793.560704}
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN11419') HTTP/1.1" 204 0
2026-03-29 18:43:13 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC38783%27 HTTP/1.1" 200 None
2026-03-29 18:43:13 [auto1.de] INFO: Scrape type for WC38783: 0
2026-03-29 18:43:13 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11229%27 HTTP/1.1" 200 None
2026-03-29 18:43:13 [auto1.de] INFO: Scrape type for UL11229: 2
2026-03-29 18:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72e48121-a728-5107-a088-97b380c6d5c1 with identifier: UL11229
2026-03-29 18:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72e48121-a728-5107-a088-97b380c6d5c1 with scrape type 2
2026-03-29 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72e48121-a728-5107-a088-97b380c6d5c1 with scrape type 2
2026-03-29 18:43:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72e48121-a728-5107-a088-97b380c6d5c1, identifier: UL11229
2026-03-29 18:43:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72e48121-a728-5107-a088-97b380c6d5c1 with identifier: UL11229
2026-03-29 18:43:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72e48121-a728-5107-a088-97b380c6d5c1 with identifier: UL11229
2026-03-29 18:43:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72e48121-a728-5107-a088-97b380c6d5c1 with identifier: UL11229 to the API
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:38:59Z',
'fuel_type': 'hybrid',
'id': '72e48121-a728-5107-a088-97b380c6d5c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL11229',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 75637,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-11',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2020}
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11229%27 HTTP/1.1" 200 None
2026-03-29 18:43:14 [auto1.de] INFO: Saving data for UL11229: {'auction_closing_time': 1774885139.0, 'created_time': 1774118443.35216, 'last_price_update_time': 1774809794.000054}
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL11229') HTTP/1.1" 204 0
2026-03-29 18:43:14 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA89904%27 HTTP/1.1" 200 None
2026-03-29 18:43:14 [auto1.de] INFO: Scrape type for NA89904: 2
2026-03-29 18:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f with identifier: NA89904
2026-03-29 18:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f with scrape type 2
2026-03-29 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f with scrape type 2
2026-03-29 18:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f, identifier: NA89904
2026-03-29 18:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f with identifier: NA89904
2026-03-29 18:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f with identifier: NA89904
2026-03-29 18:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f with identifier: NA89904 to the API
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:16:46Z',
'fuel_type': 'petrol',
'id': '0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA89904',
'listing': 'auction',
'make': 'Citroen',
'model': 'DS3',
'odometer': 145208,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-10',
'seller_name': None,
'title': 'Citroen DS3 1.6 THP SportChic',
'transmission': 'manual',
'trim': 'SportChic',
'year': 2013}
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA89904%27 HTTP/1.1" 200 None
2026-03-29 18:43:14 [auto1.de] INFO: Saving data for NA89904: {'auction_closing_time': 1774883806.0, 'created_time': 1774636340.838668, 'last_price_update_time': 1774809794.43732}
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA89904') HTTP/1.1" 204 0
2026-03-29 18:43:14 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-29 18:43:14 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-29 18:43:14 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF93741%27 HTTP/1.1" 200 None
2026-03-29 18:43:14 [auto1.de] INFO: Scrape type for HF93741: 0
2026-03-29 18:43:14 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62018%27 HTTP/1.1" 200 None
2026-03-29 18:43:14 [auto1.de] INFO: Scrape type for KB62018: 2
2026-03-29 18:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a8946c4-b99a-539b-844f-81a6e922f860 with identifier: KB62018
2026-03-29 18:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a8946c4-b99a-539b-844f-81a6e922f860 with scrape type 2
2026-03-29 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a8946c4-b99a-539b-844f-81a6e922f860 with scrape type 2
2026-03-29 18:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a8946c4-b99a-539b-844f-81a6e922f860, identifier: KB62018
2026-03-29 18:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a8946c4-b99a-539b-844f-81a6e922f860 with identifier: KB62018
2026-03-29 18:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a8946c4-b99a-539b-844f-81a6e922f860 with identifier: KB62018
2026-03-29 18:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a8946c4-b99a-539b-844f-81a6e922f860 with identifier: KB62018 to the API
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-30T15:36:11Z',
'fuel_type': 'petrol',
'id': '3a8946c4-b99a-539b-844f-81a6e922f860',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB62018',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 87971,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-20',
'seller_name': None,
'title': 'Dacia Sandero 1.0 Essentiel',
'transmission': 'manual',
'trim': 'Essentiel',
'year': 2016}
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62018%27 HTTP/1.1" 200 None
2026-03-29 18:43:14 [auto1.de] INFO: Saving data for KB62018: {'auction_closing_time': 1774884971.0, 'created_time': 1773687140.572818, 'last_price_update_time': 1774809794.919682}
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB62018') HTTP/1.1" 204 0
2026-03-29 18:43:15 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN00313%27 HTTP/1.1" 200 None
2026-03-29 18:43:15 [auto1.de] INFO: Scrape type for VN00313: 0
2026-03-29 18:43:15 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-29 18:43:15 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC48235%27 HTTP/1.1" 200 None
2026-03-29 18:43:15 [auto1.de] INFO: Scrape type for UC48235: 2
2026-03-29 18:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f844a996-7748-5fb5-834a-0e0b804d35ea with identifier: UC48235
2026-03-29 18:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f844a996-7748-5fb5-834a-0e0b804d35ea with scrape type 2
2026-03-29 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f844a996-7748-5fb5-834a-0e0b804d35ea with scrape type 2
2026-03-29 18:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f844a996-7748-5fb5-834a-0e0b804d35ea, identifier: UC48235
2026-03-29 18:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f844a996-7748-5fb5-834a-0e0b804d35ea with identifier: UC48235
2026-03-29 18:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f844a996-7748-5fb5-834a-0e0b804d35ea with identifier: UC48235
2026-03-29 18:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f844a996-7748-5fb5-834a-0e0b804d35ea with identifier: UC48235 to the API
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 341,
'expiration_date': '2026-03-30T15:24:07Z',
'fuel_type': 'hybrid',
'id': 'f844a996-7748-5fb5-834a-0e0b804d35ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC48235',
'listing': 'auction',
'make': 'Volvo',
'model': 'V90',
'odometer': 78881,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-07',
'seller_name': None,
'title': 'Volvo V90 2.0 T6 Plug-in Hybrid Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2021}
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC48235%27 HTTP/1.1" 200 None
2026-03-29 18:43:15 [auto1.de] INFO: Saving data for UC48235: {'auction_closing_time': 1774884247.0, 'created_time': 1773741152.924581, 'last_price_update_time': 1774809795.49359}
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC48235') HTTP/1.1" 204 0
2026-03-29 18:43:15 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV24790%27 HTTP/1.1" 200 None
2026-03-29 18:43:15 [auto1.de] INFO: Scrape type for GV24790: 2
2026-03-29 18:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e646652c-9b01-55dd-b97c-99c0ed9f989f with identifier: GV24790
2026-03-29 18:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e646652c-9b01-55dd-b97c-99c0ed9f989f with scrape type 2
2026-03-29 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e646652c-9b01-55dd-b97c-99c0ed9f989f with scrape type 2
2026-03-29 18:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e646652c-9b01-55dd-b97c-99c0ed9f989f, identifier: GV24790
2026-03-29 18:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e646652c-9b01-55dd-b97c-99c0ed9f989f with identifier: GV24790
2026-03-29 18:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e646652c-9b01-55dd-b97c-99c0ed9f989f with identifier: GV24790
2026-03-29 18:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e646652c-9b01-55dd-b97c-99c0ed9f989f with identifier: GV24790 to the API
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:48:37Z',
'fuel_type': 'petrol',
'id': 'e646652c-9b01-55dd-b97c-99c0ed9f989f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV24790',
'listing': 'auction',
'make': 'Audi',
'model': 'TT',
'odometer': 80845,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-01',
'seller_name': None,
'title': 'Audi TT 2.0 TFSI Coupe',
'transmission': 'automatic',
'trim': 'Coupe',
'year': 2010}
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV24790%27 HTTP/1.1" 200 None
2026-03-29 18:43:15 [auto1.de] INFO: Saving data for GV24790: {'auction_closing_time': 1774885717.0, 'created_time': 1773224202.294027, 'last_price_update_time': 1774809795.922238}
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV24790') HTTP/1.1" 204 0
2026-03-29 18:43:15 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68555%27 HTTP/1.1" 200 None
2026-03-29 18:43:15 [auto1.de] INFO: Scrape type for AG68555: 0
2026-03-29 18:43:15 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-29 18:43:15 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28952%27 HTTP/1.1" 200 None
2026-03-29 18:43:15 [auto1.de] INFO: Scrape type for UE28952: 2
2026-03-29 18:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with identifier: UE28952
2026-03-29 18:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with scrape type 2
2026-03-29 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with scrape type 2
2026-03-29 18:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed2cc29a-6784-59ea-a8d3-2e2ef23b8597, identifier: UE28952
2026-03-29 18:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with identifier: UE28952
2026-03-29 18:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with identifier: UE28952
2026-03-29 18:43:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with identifier: UE28952 to the API
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:34:58Z',
'fuel_type': 'diesel',
'id': 'ed2cc29a-6784-59ea-a8d3-2e2ef23b8597',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE28952',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40',
'odometer': 102150,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-17',
'seller_name': None,
'title': 'Volvo V40 2.0 D2 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2019}
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28952%27 HTTP/1.1" 200 None
2026-03-29 18:43:16 [auto1.de] INFO: Saving data for UE28952: {'auction_closing_time': 1774884898.0, 'created_time': 1773687295.060854, 'last_price_update_time': 1774809796.421447}
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE28952') HTTP/1.1" 204 0
2026-03-29 18:43:16 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN13946%27 HTTP/1.1" 200 None
2026-03-29 18:43:16 [auto1.de] INFO: Scrape type for JN13946: 2
2026-03-29 18:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with identifier: JN13946
2026-03-29 18:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with scrape type 2
2026-03-29 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with scrape type 2
2026-03-29 18:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8, identifier: JN13946
2026-03-29 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with identifier: JN13946
2026-03-29 18:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with identifier: JN13946
2026-03-29 18:43:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with identifier: JN13946 to the API
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:26:09Z',
'fuel_type': 'petrol',
'id': '9dd1b142-46ab-5d6d-83d1-f944a52c4dc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN13946',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 144763,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-10-14',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Kompressor T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2004}
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN13946%27 HTTP/1.1" 200 None
2026-03-29 18:43:16 [auto1.de] INFO: Saving data for JN13946: {'auction_closing_time': 1774884369.0, 'created_time': 1774002840.940945, 'last_price_update_time': 1774809796.913077}
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN13946') HTTP/1.1" 204 0
2026-03-29 18:43:16 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-29 18:43:16 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-29 18:43:16 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-29 18:43:16 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE12757%27 HTTP/1.1" 200 None
2026-03-29 18:43:16 [auto1.de] INFO: Scrape type for AE12757: 2
2026-03-29 18:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with identifier: AE12757
2026-03-29 18:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with scrape type 2
2026-03-29 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with scrape type 2
2026-03-29 18:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a5afcd7-84b7-5df2-b91b-d574dc56f074, identifier: AE12757
2026-03-29 18:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with identifier: AE12757
2026-03-29 18:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with identifier: AE12757
2026-03-29 18:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with identifier: AE12757 to the API
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:47:39Z',
'fuel_type': 'diesel',
'id': '4a5afcd7-84b7-5df2-b91b-d574dc56f074',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE12757',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 228944,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-09',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Highline BlueMotion Tech',
'year': 2014}
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE12757%27 HTTP/1.1" 200 None
2026-03-29 18:43:17 [auto1.de] INFO: Saving data for AE12757: {'auction_closing_time': 1774885659.0, 'created_time': 1774607677.331957, 'last_price_update_time': 1774809797.374349}
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE12757') HTTP/1.1" 204 0
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58010%27 HTTP/1.1" 200 None
2026-03-29 18:43:17 [auto1.de] INFO: Scrape type for GA58010: 2
2026-03-29 18:43:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3407ec16-f216-53cf-8596-04c9d08efdab with identifier: GA58010
2026-03-29 18:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3407ec16-f216-53cf-8596-04c9d08efdab with scrape type 2
2026-03-29 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3407ec16-f216-53cf-8596-04c9d08efdab with scrape type 2
2026-03-29 18:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3407ec16-f216-53cf-8596-04c9d08efdab, identifier: GA58010
2026-03-29 18:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3407ec16-f216-53cf-8596-04c9d08efdab with identifier: GA58010
2026-03-29 18:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3407ec16-f216-53cf-8596-04c9d08efdab with identifier: GA58010
2026-03-29 18:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3407ec16-f216-53cf-8596-04c9d08efdab with identifier: GA58010 to the API
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:50:07Z',
'fuel_type': 'petrol',
'id': '3407ec16-f216-53cf-8596-04c9d08efdab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA58010',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 87839,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-15',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2023}
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58010%27 HTTP/1.1" 200 None
2026-03-29 18:43:17 [auto1.de] INFO: Saving data for GA58010: {'auction_closing_time': 1774885807.0, 'created_time': 1774032456.724292, 'last_price_update_time': 1774809797.966596}
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA58010') HTTP/1.1" 204 0
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ27483%27 HTTP/1.1" 200 None
2026-03-29 18:43:18 [auto1.de] INFO: Scrape type for PZ27483: 2
2026-03-29 18:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db87229-e7e8-562d-adfc-6d731d6ae341 with identifier: PZ27483
2026-03-29 18:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db87229-e7e8-562d-adfc-6d731d6ae341 with scrape type 2
2026-03-29 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db87229-e7e8-562d-adfc-6d731d6ae341 with scrape type 2
2026-03-29 18:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3db87229-e7e8-562d-adfc-6d731d6ae341, identifier: PZ27483
2026-03-29 18:43:18 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3db87229-e7e8-562d-adfc-6d731d6ae341 with identifier: PZ27483
2026-03-29 18:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3db87229-e7e8-562d-adfc-6d731d6ae341 with identifier: PZ27483
2026-03-29 18:43:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3db87229-e7e8-562d-adfc-6d731d6ae341 with identifier: PZ27483 to the API
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:20:47Z',
'fuel_type': 'petrol',
'id': '3db87229-e7e8-562d-adfc-6d731d6ae341',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ27483',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 130949,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-27',
'seller_name': None,
'title': 'Opel Zafira 1.6 Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2011}
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ27483%27 HTTP/1.1" 200 None
2026-03-29 18:43:18 [auto1.de] INFO: Saving data for PZ27483: {'auction_closing_time': 1774884047.0, 'created_time': 1774262269.053473, 'last_price_update_time': 1774809798.421405}
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ27483') HTTP/1.1" 204 0
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ97721%27 HTTP/1.1" 200 None
2026-03-29 18:43:18 [auto1.de] INFO: Scrape type for DJ97721: 0
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: XD68871
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD68871%27 HTTP/1.1" 200 None
2026-03-29 18:43:18 [auto1.de] INFO: Scrape type for XD68871: 2
2026-03-29 18:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebbb1595-01f9-52a3-9a30-cfe2c9dc3719 with identifier: XD68871
2026-03-29 18:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebbb1595-01f9-52a3-9a30-cfe2c9dc3719 with scrape type 2
2026-03-29 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebbb1595-01f9-52a3-9a30-cfe2c9dc3719 with scrape type 2
2026-03-29 18:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebbb1595-01f9-52a3-9a30-cfe2c9dc3719, identifier: XD68871
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69616%27 HTTP/1.1" 200 None
2026-03-29 18:43:18 [auto1.de] INFO: Scrape type for SV69616: 2
2026-03-29 18:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59508b96-73c2-5cd2-9114-4b2a79eea019 with identifier: SV69616
2026-03-29 18:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59508b96-73c2-5cd2-9114-4b2a79eea019 with scrape type 2
2026-03-29 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59508b96-73c2-5cd2-9114-4b2a79eea019 with scrape type 2
2026-03-29 18:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59508b96-73c2-5cd2-9114-4b2a79eea019, identifier: SV69616
2026-03-29 18:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebbb1595-01f9-52a3-9a30-cfe2c9dc3719 with identifier: XD68871
2026-03-29 18:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebbb1595-01f9-52a3-9a30-cfe2c9dc3719 with identifier: XD68871
2026-03-29 18:43:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebbb1595-01f9-52a3-9a30-cfe2c9dc3719 with identifier: XD68871 to the API
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:55:05Z',
'fuel_type': 'diesel',
'id': 'ebbb1595-01f9-52a3-9a30-cfe2c9dc3719',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD68871',
'listing': 'auction',
'make': 'Jaguar',
'model': 'F-Pace',
'odometer': 106694,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-04',
'seller_name': None,
'title': 'Jaguar F-Pace 20d Portfolio AWD',
'transmission': 'automatic',
'trim': 'Portfolio AWD',
'year': 2018}
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD68871%27 HTTP/1.1" 200 None
2026-03-29 18:43:18 [auto1.de] INFO: Saving data for XD68871: {'auction_closing_time': 1774886105.0, 'created_time': 1774349697.403532, 'last_price_update_time': 1774809798.957075}
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD68871') HTTP/1.1" 204 0
2026-03-29 18:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59508b96-73c2-5cd2-9114-4b2a79eea019 with identifier: SV69616
2026-03-29 18:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59508b96-73c2-5cd2-9114-4b2a79eea019 with identifier: SV69616
2026-03-29 18:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59508b96-73c2-5cd2-9114-4b2a79eea019 with identifier: SV69616 to the API
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:41:01Z',
'fuel_type': 'petrol',
'id': '59508b96-73c2-5cd2-9114-4b2a79eea019',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV69616',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 164705,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-24',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69616%27 HTTP/1.1" 200 None
2026-03-29 18:43:19 [auto1.de] INFO: Saving data for SV69616: {'auction_closing_time': 1774885261.0, 'created_time': 1773688144.745135, 'last_price_update_time': 1774809799.381182}
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV69616') HTTP/1.1" 204 0
2026-03-29 18:43:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:19 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE72511%27 HTTP/1.1" 200 None
2026-03-29 18:43:19 [auto1.de] INFO: Scrape type for ZE72511: 0
2026-03-29 18:43:19 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-29 18:43:19 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-29 18:43:19 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41412%27 HTTP/1.1" 200 None
2026-03-29 18:43:19 [auto1.de] INFO: Scrape type for VE41412: 2
2026-03-29 18:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d825d06b-b474-5bb7-b5ab-33cee45e9e0a with identifier: VE41412
2026-03-29 18:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d825d06b-b474-5bb7-b5ab-33cee45e9e0a with scrape type 2
2026-03-29 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d825d06b-b474-5bb7-b5ab-33cee45e9e0a with scrape type 2
2026-03-29 18:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d825d06b-b474-5bb7-b5ab-33cee45e9e0a, identifier: VE41412
2026-03-29 18:43:19 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-29 18:43:19 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-29 18:43:19 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-29 18:43:19 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-29 18:43:19 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB56822%27 HTTP/1.1" 200 None
2026-03-29 18:43:19 [auto1.de] INFO: Scrape type for VB56822: 2
2026-03-29 18:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99e83a1c-ba38-5055-8174-76c1d9e249b7 with identifier: VB56822
2026-03-29 18:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99e83a1c-ba38-5055-8174-76c1d9e249b7 with scrape type 2
2026-03-29 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99e83a1c-ba38-5055-8174-76c1d9e249b7 with scrape type 2
2026-03-29 18:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99e83a1c-ba38-5055-8174-76c1d9e249b7, identifier: VB56822
2026-03-29 18:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d825d06b-b474-5bb7-b5ab-33cee45e9e0a with identifier: VE41412
2026-03-29 18:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d825d06b-b474-5bb7-b5ab-33cee45e9e0a with identifier: VE41412
2026-03-29 18:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d825d06b-b474-5bb7-b5ab-33cee45e9e0a with identifier: VE41412 to the API
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:01:49Z',
'fuel_type': 'petrol',
'id': 'd825d06b-b474-5bb7-b5ab-33cee45e9e0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE41412',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 133740,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-31',
'seller_name': None,
'title': 'Renault Megane 1.6 TomTom Edition',
'transmission': 'manual',
'trim': 'TomTom Edition',
'year': 2011}
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41412%27 HTTP/1.1" 200 None
2026-03-29 18:43:19 [auto1.de] INFO: Saving data for VE41412: {'auction_closing_time': 1774882909.0, 'created_time': 1774607791.994961, 'last_price_update_time': 1774809799.967588}
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE41412') HTTP/1.1" 204 0
2026-03-29 18:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99e83a1c-ba38-5055-8174-76c1d9e249b7 with identifier: VB56822
2026-03-29 18:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99e83a1c-ba38-5055-8174-76c1d9e249b7 with identifier: VB56822
2026-03-29 18:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99e83a1c-ba38-5055-8174-76c1d9e249b7 with identifier: VB56822 to the API
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:56:27Z',
'fuel_type': 'petrol',
'id': '99e83a1c-ba38-5055-8174-76c1d9e249b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB56822',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 79851,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-31',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2009}
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB56822%27 HTTP/1.1" 200 None
2026-03-29 18:43:20 [auto1.de] INFO: Saving data for VB56822: {'auction_closing_time': 1774886187.0, 'created_time': 1774636320.238812, 'last_price_update_time': 1774809800.265825}
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB56822') HTTP/1.1" 204 0
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH31570%27 HTTP/1.1" 200 None
2026-03-29 18:43:20 [auto1.de] INFO: Scrape type for FH31570: 0
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP71410%27 HTTP/1.1" 200 None
2026-03-29 18:43:20 [auto1.de] INFO: Scrape type for MP71410: 0
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB81332%27 HTTP/1.1" 200 None
2026-03-29 18:43:20 [auto1.de] INFO: Scrape type for EB81332: 0
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD20559%27 HTTP/1.1" 200 None
2026-03-29 18:43:20 [auto1.de] INFO: Scrape type for DD20559: 0
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM11779%27 HTTP/1.1" 200 None
2026-03-29 18:43:20 [auto1.de] INFO: Scrape type for HM11779: 0
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU93791%27 HTTP/1.1" 200 None
2026-03-29 18:43:20 [auto1.de] INFO: Scrape type for CU93791: 2
2026-03-29 18:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with identifier: CU93791
2026-03-29 18:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with scrape type 2
2026-03-29 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with scrape type 2
2026-03-29 18:43:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88a0781d-9fb6-5681-a8d9-72f4f6bad567, identifier: CU93791
2026-03-29 18:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with identifier: CU93791
2026-03-29 18:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with identifier: CU93791
2026-03-29 18:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with identifier: CU93791 to the API
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:22:19Z',
'fuel_type': 'diesel',
'id': '88a0781d-9fb6-5681-a8d9-72f4f6bad567',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU93791',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 191121,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-21',
'seller_name': None,
'title': 'Mercedes-Benz Vito 115 CDI lang',
'transmission': 'manual',
'trim': 'lang',
'year': 2010}
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU93791%27 HTTP/1.1" 200 None
2026-03-29 18:43:20 [auto1.de] INFO: Saving data for CU93791: {'auction_closing_time': 1774884139.0, 'created_time': 1773135415.80223, 'last_price_update_time': 1774809800.802035}
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU93791') HTTP/1.1" 204 0
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG31546%27 HTTP/1.1" 200 None
2026-03-29 18:43:20 [auto1.de] INFO: Scrape type for SG31546: 2
2026-03-29 18:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97721150-39b3-508d-bcd7-3425d0af4042 with identifier: SG31546
2026-03-29 18:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97721150-39b3-508d-bcd7-3425d0af4042 with scrape type 2
2026-03-29 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97721150-39b3-508d-bcd7-3425d0af4042 with scrape type 2
2026-03-29 18:43:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97721150-39b3-508d-bcd7-3425d0af4042, identifier: SG31546
2026-03-29 18:43:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97721150-39b3-508d-bcd7-3425d0af4042 with identifier: SG31546
2026-03-29 18:43:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97721150-39b3-508d-bcd7-3425d0af4042 with identifier: SG31546
2026-03-29 18:43:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97721150-39b3-508d-bcd7-3425d0af4042 with identifier: SG31546 to the API
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:16:30Z',
'fuel_type': 'petrol',
'id': '97721150-39b3-508d-bcd7-3425d0af4042',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG31546',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 215543,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-26',
'seller_name': None,
'title': 'Opel Corsa 1.4 Satellite',
'transmission': 'manual',
'trim': 'Satellite',
'year': 2011}
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG31546%27 HTTP/1.1" 200 None
2026-03-29 18:43:21 [auto1.de] INFO: Saving data for SG31546: {'auction_closing_time': 1774883790.0, 'created_time': 1774089225.127555, 'last_price_update_time': 1774809801.360619}
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG31546') HTTP/1.1" 204 0
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ68458%27 HTTP/1.1" 200 None
2026-03-29 18:43:21 [auto1.de] INFO: Scrape type for NZ68458: 0
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU11315%27 HTTP/1.1" 200 None
2026-03-29 18:43:21 [auto1.de] INFO: Scrape type for CU11315: 2
2026-03-29 18:43:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 408cb80f-33cb-59ab-a1bf-8adcec779395 with identifier: CU11315
2026-03-29 18:43:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 408cb80f-33cb-59ab-a1bf-8adcec779395 with scrape type 2
2026-03-29 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 408cb80f-33cb-59ab-a1bf-8adcec779395 with scrape type 2
2026-03-29 18:43:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 408cb80f-33cb-59ab-a1bf-8adcec779395, identifier: CU11315
2026-03-29 18:43:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 408cb80f-33cb-59ab-a1bf-8adcec779395 with identifier: CU11315
2026-03-29 18:43:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 408cb80f-33cb-59ab-a1bf-8adcec779395 with identifier: CU11315
2026-03-29 18:43:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 408cb80f-33cb-59ab-a1bf-8adcec779395 with identifier: CU11315 to the API
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:23:37Z',
'fuel_type': 'diesel',
'id': '408cb80f-33cb-59ab-a1bf-8adcec779395',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU11315',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 308833,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-30',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2010}
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU11315%27 HTTP/1.1" 200 None
2026-03-29 18:43:21 [auto1.de] INFO: Saving data for CU11315: {'auction_closing_time': 1774884217.0, 'created_time': 1774636286.576798, 'last_price_update_time': 1774809801.811935}
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU11315') HTTP/1.1" 204 0
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13649%27 HTTP/1.1" 200 None
2026-03-29 18:43:21 [auto1.de] INFO: Scrape type for CD13649: 2
2026-03-29 18:43:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8878daf-9971-5dc8-a305-139ef2024c2d with identifier: CD13649
2026-03-29 18:43:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8878daf-9971-5dc8-a305-139ef2024c2d with scrape type 2
2026-03-29 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8878daf-9971-5dc8-a305-139ef2024c2d with scrape type 2
2026-03-29 18:43:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8878daf-9971-5dc8-a305-139ef2024c2d, identifier: CD13649
2026-03-29 18:43:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8878daf-9971-5dc8-a305-139ef2024c2d with identifier: CD13649
2026-03-29 18:43:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8878daf-9971-5dc8-a305-139ef2024c2d with identifier: CD13649
2026-03-29 18:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8878daf-9971-5dc8-a305-139ef2024c2d with identifier: CD13649 to the API
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:57:31Z',
'fuel_type': 'petrol',
'id': 'b8878daf-9971-5dc8-a305-139ef2024c2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD13649',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 140277,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-13',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2012}
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13649%27 HTTP/1.1" 200 None
2026-03-29 18:43:22 [auto1.de] INFO: Saving data for CD13649: {'auction_closing_time': 1774886251.0, 'created_time': 1774608302.293486, 'last_price_update_time': 1774809802.237079}
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD13649') HTTP/1.1" 204 0
2026-03-29 18:43:22 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-29 18:43:22 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68536%27 HTTP/1.1" 200 None
2026-03-29 18:43:22 [auto1.de] INFO: Scrape type for KW68536: 0
2026-03-29 18:43:22 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-29 18:43:22 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP82527%27 HTTP/1.1" 200 None
2026-03-29 18:43:22 [auto1.de] INFO: Scrape type for BP82527: 2
2026-03-29 18:43:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with identifier: BP82527
2026-03-29 18:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with scrape type 2
2026-03-29 18:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with scrape type 2
2026-03-29 18:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2971d5f5-254c-5ec8-88df-8f77b49a5bb6, identifier: BP82527
2026-03-29 18:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with identifier: BP82527
2026-03-29 18:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with identifier: BP82527
2026-03-29 18:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with identifier: BP82527 to the API
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:19:27Z',
'fuel_type': 'petrol',
'id': '2971d5f5-254c-5ec8-88df-8f77b49a5bb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP82527',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 127416,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-08-31',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 CrossPolo',
'transmission': 'manual',
'trim': 'Cross',
'year': 2006}
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP82527%27 HTTP/1.1" 200 None
2026-03-29 18:43:22 [auto1.de] INFO: Saving data for BP82527: {'auction_closing_time': 1774883967.0, 'created_time': 1773860369.694964, 'last_price_update_time': 1774809802.86564}
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP82527') HTTP/1.1" 204 0
2026-03-29 18:43:22 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32627%27 HTTP/1.1" 200 None
2026-03-29 18:43:22 [auto1.de] INFO: Scrape type for FX32627: 0
2026-03-29 18:43:22 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-29 18:43:22 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-29 18:43:22 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-29 18:43:22 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER89217%27 HTTP/1.1" 200 None
2026-03-29 18:43:22 [auto1.de] INFO: Scrape type for ER89217: 0
2026-03-29 18:43:22 [auto1.de] INFO: Found listing with ID: FN51585
2026-03-29 18:43:22 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM89515%27 HTTP/1.1" 200 None
2026-03-29 18:43:22 [auto1.de] INFO: Scrape type for XM89515: 2
2026-03-29 18:43:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with identifier: XM89515
2026-03-29 18:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with scrape type 2
2026-03-29 18:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with scrape type 2
2026-03-29 18:43:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445, identifier: XM89515
2026-03-29 18:43:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with identifier: XM89515
2026-03-29 18:43:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with identifier: XM89515
2026-03-29 18:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with identifier: XM89515 to the API
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:15:41Z',
'fuel_type': 'petrol',
'id': '671bb7d8-37ac-5a8b-ada1-dd7db8bf6445',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM89515',
'listing': 'auction',
'make': 'Skoda',
'model': 'Roomster',
'odometer': 109059,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-15',
'seller_name': None,
'title': 'Skoda Roomster 1.2 Praktik',
'transmission': 'manual',
'trim': 'Praktik',
'year': 2012}
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM89515%27 HTTP/1.1" 200 None
2026-03-29 18:43:23 [auto1.de] INFO: Saving data for XM89515: {'auction_closing_time': 1774883741.0, 'created_time': 1774293880.955878, 'last_price_update_time': 1774809803.383467}
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM89515') HTTP/1.1" 204 0
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX10295%27 HTTP/1.1" 200 None
2026-03-29 18:43:23 [auto1.de] INFO: Scrape type for BX10295: 2
2026-03-29 18:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 218e7776-a342-5542-9077-b0be9c8ccbf7 with identifier: BX10295
2026-03-29 18:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 218e7776-a342-5542-9077-b0be9c8ccbf7 with scrape type 2
2026-03-29 18:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 218e7776-a342-5542-9077-b0be9c8ccbf7 with scrape type 2
2026-03-29 18:43:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 218e7776-a342-5542-9077-b0be9c8ccbf7, identifier: BX10295
2026-03-29 18:43:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 218e7776-a342-5542-9077-b0be9c8ccbf7 with identifier: BX10295
2026-03-29 18:43:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 218e7776-a342-5542-9077-b0be9c8ccbf7 with identifier: BX10295
2026-03-29 18:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 218e7776-a342-5542-9077-b0be9c8ccbf7 with identifier: BX10295 to the API
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:22:03Z',
'fuel_type': 'petrol',
'id': '218e7776-a342-5542-9077-b0be9c8ccbf7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX10295',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 174695,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-26',
'seller_name': None,
'title': 'Hyundai i20 1.2 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2012}
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX10295%27 HTTP/1.1" 200 None
2026-03-29 18:43:23 [auto1.de] INFO: Saving data for BX10295: {'auction_closing_time': 1774884123.0, 'created_time': 1773773776.410559, 'last_price_update_time': 1774809803.901856}
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX10295') HTTP/1.1" 204 0
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-29 18:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:24 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:24 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56224%27 HTTP/1.1" 200 None
2026-03-29 18:43:24 [auto1.de] INFO: Scrape type for KV56224: 0
2026-03-29 18:43:24 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-29 18:43:24 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM11561%27 HTTP/1.1" 200 None
2026-03-29 18:43:24 [auto1.de] INFO: Scrape type for YM11561: 0
2026-03-29 18:43:24 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR41525%27 HTTP/1.1" 200 None
2026-03-29 18:43:24 [auto1.de] INFO: Scrape type for RR41525: 2
2026-03-29 18:43:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65642d36-689c-5634-88d0-5a907136b411 with identifier: RR41525
2026-03-29 18:43:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65642d36-689c-5634-88d0-5a907136b411 with scrape type 2
2026-03-29 18:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65642d36-689c-5634-88d0-5a907136b411 with scrape type 2
2026-03-29 18:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65642d36-689c-5634-88d0-5a907136b411, identifier: RR41525
2026-03-29 18:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65642d36-689c-5634-88d0-5a907136b411 with identifier: RR41525
2026-03-29 18:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65642d36-689c-5634-88d0-5a907136b411 with identifier: RR41525
2026-03-29 18:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65642d36-689c-5634-88d0-5a907136b411 with identifier: RR41525 to the API
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:35:32Z',
'fuel_type': 'diesel',
'id': '65642d36-689c-5634-88d0-5a907136b411',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR41525',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 112985,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-24',
'seller_name': None,
'title': 'Mercedes-Benz Vito 114 CDI lang',
'transmission': 'manual',
'trim': 'lang',
'year': 2019}
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR41525%27 HTTP/1.1" 200 None
2026-03-29 18:43:24 [auto1.de] INFO: Saving data for RR41525: {'auction_closing_time': 1774884932.0, 'created_time': 1774608096.689139, 'last_price_update_time': 1774809804.522235}
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR41525') HTTP/1.1" 204 0
2026-03-29 18:43:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:24 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-29 18:43:24 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63753%27 HTTP/1.1" 200 None
2026-03-29 18:43:24 [auto1.de] INFO: Scrape type for XB63753: 2
2026-03-29 18:43:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with identifier: XB63753
2026-03-29 18:43:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with scrape type 2
2026-03-29 18:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with scrape type 2
2026-03-29 18:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4debdf0a-380f-50b9-a8e0-ca94ac8f9218, identifier: XB63753
2026-03-29 18:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with identifier: XB63753
2026-03-29 18:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with identifier: XB63753
2026-03-29 18:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with identifier: XB63753 to the API
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:07:57Z',
'fuel_type': 'diesel',
'id': '4debdf0a-380f-50b9-a8e0-ca94ac8f9218',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB63753',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 219080,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-26',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2011}
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63753%27 HTTP/1.1" 200 None
2026-03-29 18:43:24 [auto1.de] INFO: Saving data for XB63753: {'auction_closing_time': 1774883277.0, 'created_time': 1773858641.025574, 'last_price_update_time': 1774809804.956786}
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB63753') HTTP/1.1" 204 0
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-29 18:43:25 [auto1.de] INFO: Scrape type for VY78817: 2
2026-03-29 18:43:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a777c48e-71f4-55d1-934e-9c5a1a61975d with identifier: VY78817
2026-03-29 18:43:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a777c48e-71f4-55d1-934e-9c5a1a61975d with scrape type 2
2026-03-29 18:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a777c48e-71f4-55d1-934e-9c5a1a61975d with scrape type 2
2026-03-29 18:43:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a777c48e-71f4-55d1-934e-9c5a1a61975d, identifier: VY78817
2026-03-29 18:43:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a777c48e-71f4-55d1-934e-9c5a1a61975d with identifier: VY78817
2026-03-29 18:43:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a777c48e-71f4-55d1-934e-9c5a1a61975d with identifier: VY78817
2026-03-29 18:43:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a777c48e-71f4-55d1-934e-9c5a1a61975d with identifier: VY78817 to the API
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:06:12Z',
'fuel_type': 'petrol',
'id': 'a777c48e-71f4-55d1-934e-9c5a1a61975d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY78817',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 190290,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-15',
'seller_name': None,
'title': 'Volkswagen Touran 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2017}
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-29 18:43:25 [auto1.de] INFO: Saving data for VY78817: {'auction_closing_time': 1774883172.0, 'created_time': 1773916878.083809, 'last_price_update_time': 1774809805.519129}
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY78817') HTTP/1.1" 204 0
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS86907%27 HTTP/1.1" 200 None
2026-03-29 18:43:25 [auto1.de] INFO: Scrape type for GS86907: 0
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK83365%27 HTTP/1.1" 200 None
2026-03-29 18:43:25 [auto1.de] INFO: Scrape type for LK83365: 0
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS84502%27 HTTP/1.1" 200 None
2026-03-29 18:43:25 [auto1.de] INFO: Scrape type for YS84502: 2
2026-03-29 18:43:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb997bed-8db8-585d-9ca4-2febcee1f0b0 with identifier: YS84502
2026-03-29 18:43:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb997bed-8db8-585d-9ca4-2febcee1f0b0 with scrape type 2
2026-03-29 18:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb997bed-8db8-585d-9ca4-2febcee1f0b0 with scrape type 2
2026-03-29 18:43:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb997bed-8db8-585d-9ca4-2febcee1f0b0, identifier: YS84502
2026-03-29 18:43:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb997bed-8db8-585d-9ca4-2febcee1f0b0 with identifier: YS84502
2026-03-29 18:43:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb997bed-8db8-585d-9ca4-2febcee1f0b0 with identifier: YS84502
2026-03-29 18:43:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb997bed-8db8-585d-9ca4-2febcee1f0b0 with identifier: YS84502 to the API
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:28:57Z',
'fuel_type': 'diesel',
'id': 'cb997bed-8db8-585d-9ca4-2febcee1f0b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS84502',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 369064,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-09-26',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2007}
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS84502%27 HTTP/1.1" 200 None
2026-03-29 18:43:25 [auto1.de] INFO: Saving data for YS84502: {'auction_closing_time': 1774884537.0, 'created_time': 1774034348.056446, 'last_price_update_time': 1774809805.967326}
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS84502') HTTP/1.1" 204 0
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90216%27 HTTP/1.1" 200 None
2026-03-29 18:43:26 [auto1.de] INFO: Scrape type for XB90216: 2
2026-03-29 18:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with identifier: XB90216
2026-03-29 18:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with scrape type 2
2026-03-29 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with scrape type 2
2026-03-29 18:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c44d5c4b-2c47-59f9-86f8-c1b4a6278683, identifier: XB90216
2026-03-29 18:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with identifier: XB90216
2026-03-29 18:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with identifier: XB90216
2026-03-29 18:43:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with identifier: XB90216 to the API
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:34:20Z',
'fuel_type': 'diesel',
'id': 'c44d5c4b-2c47-59f9-86f8-c1b4a6278683',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB90216',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 110426,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-25',
'seller_name': None,
'title': 'Opel Mokka 1.7 CDTI Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2015}
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90216%27 HTTP/1.1" 200 None
2026-03-29 18:43:26 [auto1.de] INFO: Saving data for XB90216: {'auction_closing_time': 1774884860.0, 'created_time': 1774291339.257916, 'last_price_update_time': 1774809806.517631}
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB90216') HTTP/1.1" 204 0
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM33145%27 HTTP/1.1" 200 None
2026-03-29 18:43:26 [auto1.de] INFO: Scrape type for CM33145: 2
2026-03-29 18:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0db03aed-3932-5b8c-9129-44c0083c47f9 with identifier: CM33145
2026-03-29 18:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0db03aed-3932-5b8c-9129-44c0083c47f9 with scrape type 2
2026-03-29 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0db03aed-3932-5b8c-9129-44c0083c47f9 with scrape type 2
2026-03-29 18:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0db03aed-3932-5b8c-9129-44c0083c47f9, identifier: CM33145
2026-03-29 18:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0db03aed-3932-5b8c-9129-44c0083c47f9 with identifier: CM33145
2026-03-29 18:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0db03aed-3932-5b8c-9129-44c0083c47f9 with identifier: CM33145
2026-03-29 18:43:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0db03aed-3932-5b8c-9129-44c0083c47f9 with identifier: CM33145 to the API
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:18:00Z',
'fuel_type': 'petrol',
'id': '0db03aed-3932-5b8c-9129-44c0083c47f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM33145',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 124763,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-30',
'seller_name': None,
'title': 'BMW 1er 118i',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM33145%27 HTTP/1.1" 200 None
2026-03-29 18:43:26 [auto1.de] INFO: Saving data for CM33145: {'auction_closing_time': 1774883880.0, 'created_time': 1773859966.916989, 'last_price_update_time': 1774809806.994356}
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM33145') HTTP/1.1" 204 0
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ44674%27 HTTP/1.1" 200 None
2026-03-29 18:43:27 [auto1.de] INFO: Scrape type for CZ44674: 2
2026-03-29 18:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d596886-b685-5b08-b93a-a0a5853436a6 with identifier: CZ44674
2026-03-29 18:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d596886-b685-5b08-b93a-a0a5853436a6 with scrape type 2
2026-03-29 18:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d596886-b685-5b08-b93a-a0a5853436a6 with scrape type 2
2026-03-29 18:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d596886-b685-5b08-b93a-a0a5853436a6, identifier: CZ44674
2026-03-29 18:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d596886-b685-5b08-b93a-a0a5853436a6 with identifier: CZ44674
2026-03-29 18:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d596886-b685-5b08-b93a-a0a5853436a6 with identifier: CZ44674
2026-03-29 18:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d596886-b685-5b08-b93a-a0a5853436a6 with identifier: CZ44674 to the API
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:55:29Z',
'fuel_type': 'diesel',
'id': '4d596886-b685-5b08-b93a-a0a5853436a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ44674',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 206292,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-05',
'seller_name': None,
'title': 'Audi Q3 2.0 TDI quattro Design',
'transmission': 'automatic',
'trim': 'quattro Design',
'year': 2015}
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ44674%27 HTTP/1.1" 200 None
2026-03-29 18:43:27 [auto1.de] INFO: Saving data for CZ44674: {'auction_closing_time': 1774886129.0, 'created_time': 1774636497.953446, 'last_price_update_time': 1774809807.389039}
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ44674') HTTP/1.1" 204 0
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP53076%27 HTTP/1.1" 200 None
2026-03-29 18:43:27 [auto1.de] INFO: Scrape type for HP53076: 0
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-29 18:43:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:27 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV99123%27 HTTP/1.1" 200 None
2026-03-29 18:43:27 [auto1.de] INFO: Scrape type for HV99123: 0
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV40301%27 HTTP/1.1" 200 None
2026-03-29 18:43:27 [auto1.de] INFO: Scrape type for NV40301: 0
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE10872%27 HTTP/1.1" 200 None
2026-03-29 18:43:27 [auto1.de] INFO: Scrape type for ZE10872: 2
2026-03-29 18:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with identifier: ZE10872
2026-03-29 18:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with scrape type 2
2026-03-29 18:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with scrape type 2
2026-03-29 18:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452, identifier: ZE10872
2026-03-29 18:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with identifier: ZE10872
2026-03-29 18:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with identifier: ZE10872
2026-03-29 18:43:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with identifier: ZE10872 to the API
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:59:44Z',
'fuel_type': 'diesel',
'id': '8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE10872',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 237976,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-13',
'seller_name': None,
'title': 'BMW 5er 520d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2016}
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE10872%27 HTTP/1.1" 200 None
2026-03-29 18:43:28 [auto1.de] INFO: Saving data for ZE10872: {'auction_closing_time': 1774886384.0, 'created_time': 1774031832.62569, 'last_price_update_time': 1774809808.239708}
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE10872') HTTP/1.1" 204 0
2026-03-29 18:43:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN09859%27 HTTP/1.1" 200 None
2026-03-29 18:43:28 [auto1.de] INFO: Scrape type for TN09859: 2
2026-03-29 18:43:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f with identifier: TN09859
2026-03-29 18:43:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f with scrape type 2
2026-03-29 18:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f with scrape type 2
2026-03-29 18:43:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f, identifier: TN09859
2026-03-29 18:43:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f with identifier: TN09859
2026-03-29 18:43:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f with identifier: TN09859
2026-03-29 18:43:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f with identifier: TN09859 to the API
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:17:53Z',
'fuel_type': 'petrol',
'id': 'c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN09859',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 117424,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-16',
'seller_name': None,
'title': 'Hyundai i10 1.2 FIFA World Cup Edition',
'transmission': 'manual',
'trim': 'FIFA World Cup Edition',
'year': 2014}
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN09859%27 HTTP/1.1" 200 None
2026-03-29 18:43:28 [auto1.de] INFO: Saving data for TN09859: {'auction_closing_time': 1774883873.0, 'created_time': 1774522061.308603, 'last_price_update_time': 1774809808.657687}
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN09859') HTTP/1.1" 204 0
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY38359%27 HTTP/1.1" 200 None
2026-03-29 18:43:28 [auto1.de] INFO: Scrape type for AY38359: 0
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF02079%27 HTTP/1.1" 200 None
2026-03-29 18:43:28 [auto1.de] INFO: Scrape type for ZF02079: 2
2026-03-29 18:43:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac5beb0d-723e-59ce-aa7a-6623ac059b46 with identifier: ZF02079
2026-03-29 18:43:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac5beb0d-723e-59ce-aa7a-6623ac059b46 with scrape type 2
2026-03-29 18:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac5beb0d-723e-59ce-aa7a-6623ac059b46 with scrape type 2
2026-03-29 18:43:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac5beb0d-723e-59ce-aa7a-6623ac059b46, identifier: ZF02079
2026-03-29 18:43:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac5beb0d-723e-59ce-aa7a-6623ac059b46 with identifier: ZF02079
2026-03-29 18:43:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac5beb0d-723e-59ce-aa7a-6623ac059b46 with identifier: ZF02079
2026-03-29 18:43:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac5beb0d-723e-59ce-aa7a-6623ac059b46 with identifier: ZF02079 to the API
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:17:55Z',
'fuel_type': 'diesel',
'id': 'ac5beb0d-723e-59ce-aa7a-6623ac059b46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF02079',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 166733,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-03',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi SYNC Edition',
'transmission': 'manual',
'trim': 'SYNC Edition',
'year': 2014}
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF02079%27 HTTP/1.1" 200 None
2026-03-29 18:43:29 [auto1.de] INFO: Saving data for ZF02079: {'auction_closing_time': 1774883875.0, 'created_time': 1773402027.432263, 'last_price_update_time': 1774809809.184055}
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF02079') HTTP/1.1" 204 0
2026-03-29 18:43:29 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-29 18:43:29 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-29 18:43:29 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-29 18:43:29 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-29 18:43:29 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-29 18:43:29 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-29 18:43:29 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ40219%27 HTTP/1.1" 200 None
2026-03-29 18:43:29 [auto1.de] INFO: Scrape type for FZ40219: 2
2026-03-29 18:43:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with identifier: FZ40219
2026-03-29 18:43:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with scrape type 2
2026-03-29 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with scrape type 2
2026-03-29 18:43:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46584ce2-db7a-5b7a-95ef-b2c69c5df76d, identifier: FZ40219
2026-03-29 18:43:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with identifier: FZ40219
2026-03-29 18:43:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with identifier: FZ40219
2026-03-29 18:43:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with identifier: FZ40219 to the API
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:21:47Z',
'fuel_type': 'petrol',
'id': '46584ce2-db7a-5b7a-95ef-b2c69c5df76d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ40219',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 63120,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-21',
'seller_name': None,
'title': 'MINI One Metropolitan',
'transmission': 'manual',
'trim': 'Metropolitan',
'year': 2015}
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ40219%27 HTTP/1.1" 200 None
2026-03-29 18:43:29 [auto1.de] INFO: Saving data for FZ40219: {'auction_closing_time': 1774884107.0, 'created_time': 1773860421.919325, 'last_price_update_time': 1774809809.674888}
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ40219') HTTP/1.1" 204 0
2026-03-29 18:43:29 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-29 18:43:29 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS15071%27 HTTP/1.1" 200 None
2026-03-29 18:43:29 [auto1.de] INFO: Scrape type for JS15071: 2
2026-03-29 18:43:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b83dec2-b487-594e-97d3-b14e6d0ff478 with identifier: JS15071
2026-03-29 18:43:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b83dec2-b487-594e-97d3-b14e6d0ff478 with scrape type 2
2026-03-29 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b83dec2-b487-594e-97d3-b14e6d0ff478 with scrape type 2
2026-03-29 18:43:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b83dec2-b487-594e-97d3-b14e6d0ff478, identifier: JS15071
2026-03-29 18:43:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b83dec2-b487-594e-97d3-b14e6d0ff478 with identifier: JS15071
2026-03-29 18:43:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b83dec2-b487-594e-97d3-b14e6d0ff478 with identifier: JS15071
2026-03-29 18:43:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b83dec2-b487-594e-97d3-b14e6d0ff478 with identifier: JS15071 to the API
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:35:08Z',
'fuel_type': 'diesel',
'id': '5b83dec2-b487-594e-97d3-b14e6d0ff478',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS15071',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 319345,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-28',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Laurin & Klement',
'transmission': 'manual',
'trim': 'Laurin & Klement',
'year': 2009}
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS15071%27 HTTP/1.1" 200 None
2026-03-29 18:43:30 [auto1.de] INFO: Saving data for JS15071: {'auction_closing_time': 1774884908.0, 'created_time': 1774608300.700682, 'last_price_update_time': 1774809810.219243}
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS15071') HTTP/1.1" 204 0
2026-03-29 18:43:30 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-29 18:43:30 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY73359%27 HTTP/1.1" 200 None
2026-03-29 18:43:30 [auto1.de] INFO: Scrape type for AY73359: 0
2026-03-29 18:43:30 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-29 18:43:30 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-29 18:43:30 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW41048%27 HTTP/1.1" 200 None
2026-03-29 18:43:30 [auto1.de] INFO: Scrape type for FW41048: 0
2026-03-29 18:43:30 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ58938%27 HTTP/1.1" 200 None
2026-03-29 18:43:30 [auto1.de] INFO: Scrape type for CZ58938: 0
2026-03-29 18:43:30 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN98432%27 HTTP/1.1" 200 None
2026-03-29 18:43:30 [auto1.de] INFO: Scrape type for SN98432: 0
2026-03-29 18:43:30 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-29 18:43:30 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-29 18:43:30 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08525%27 HTTP/1.1" 200 None
2026-03-29 18:43:30 [auto1.de] INFO: Scrape type for XT08525: 2
2026-03-29 18:43:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with identifier: XT08525
2026-03-29 18:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with scrape type 2
2026-03-29 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with scrape type 2
2026-03-29 18:43:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7, identifier: XT08525
2026-03-29 18:43:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with identifier: XT08525
2026-03-29 18:43:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with identifier: XT08525
2026-03-29 18:43:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with identifier: XT08525 to the API
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:04:05Z',
'fuel_type': 'diesel',
'id': 'c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT08525',
'listing': 'auction',
'make': 'Ford',
'model': 'Ranger',
'odometer': 108800,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-13',
'seller_name': None,
'title': 'Ford Ranger 3.2 TDCi Doppelkabine 4x4 Wildtrak',
'transmission': 'automatic',
'trim': 'Doppelkabine 4x4 Wildtrak',
'year': 2019}
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08525%27 HTTP/1.1" 200 None
2026-03-29 18:43:30 [auto1.de] INFO: Saving data for XT08525: {'auction_closing_time': 1774883045.0, 'created_time': 1774607767.534763, 'last_price_update_time': 1774809810.731264}
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT08525') HTTP/1.1" 204 0
2026-03-29 18:43:30 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59385%27 HTTP/1.1" 200 None
2026-03-29 18:43:30 [auto1.de] INFO: Scrape type for GL59385: 2
2026-03-29 18:43:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e074518-5d14-54b4-b821-d65b44f668a9 with identifier: GL59385
2026-03-29 18:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e074518-5d14-54b4-b821-d65b44f668a9 with scrape type 2
2026-03-29 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e074518-5d14-54b4-b821-d65b44f668a9 with scrape type 2
2026-03-29 18:43:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e074518-5d14-54b4-b821-d65b44f668a9, identifier: GL59385
2026-03-29 18:43:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e074518-5d14-54b4-b821-d65b44f668a9 with identifier: GL59385
2026-03-29 18:43:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e074518-5d14-54b4-b821-d65b44f668a9 with identifier: GL59385
2026-03-29 18:43:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e074518-5d14-54b4-b821-d65b44f668a9 with identifier: GL59385 to the API
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:30:14Z',
'fuel_type': 'petrol',
'id': '8e074518-5d14-54b4-b821-d65b44f668a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL59385',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 106564,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-21',
'seller_name': None,
'title': 'Peugeot 207 1.4 VTi Urban Move',
'transmission': 'manual',
'trim': 'Urban Move',
'year': 2009}
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59385%27 HTTP/1.1" 200 None
2026-03-29 18:43:31 [auto1.de] INFO: Saving data for GL59385: {'auction_closing_time': 1774884614.0, 'created_time': 1773340756.345513, 'last_price_update_time': 1774809811.757479}
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL59385') HTTP/1.1" 204 0
2026-03-29 18:43:31 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL14438%27 HTTP/1.1" 200 None
2026-03-29 18:43:31 [auto1.de] INFO: Scrape type for FL14438: 2
2026-03-29 18:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with identifier: FL14438
2026-03-29 18:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with scrape type 2
2026-03-29 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with scrape type 2
2026-03-29 18:43:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d34bb06-5c77-5c64-be75-da7c4f38efa5, identifier: FL14438
2026-03-29 18:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with identifier: FL14438
2026-03-29 18:43:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with identifier: FL14438
2026-03-29 18:43:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with identifier: FL14438 to the API
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:35:03Z',
'fuel_type': 'diesel',
'id': '9d34bb06-5c77-5c64-be75-da7c4f38efa5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL14438',
'listing': 'auction',
'make': 'Renault',
'model': 'Fluence',
'odometer': 329503,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-02',
'seller_name': None,
'title': 'Renault Fluence 1.5 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2011}
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL14438%27 HTTP/1.1" 200 None
2026-03-29 18:43:32 [auto1.de] INFO: Saving data for FL14438: {'auction_closing_time': 1774884903.0, 'created_time': 1774330255.221785, 'last_price_update_time': 1774809812.219209}
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL14438') HTTP/1.1" 204 0
2026-03-29 18:43:32 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA47632%27 HTTP/1.1" 200 None
2026-03-29 18:43:32 [auto1.de] INFO: Scrape type for MA47632: 0
2026-03-29 18:43:32 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-29 18:43:32 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:32 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-29 18:43:32 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP13896%27 HTTP/1.1" 200 None
2026-03-29 18:43:32 [auto1.de] INFO: Scrape type for AP13896: 0
2026-03-29 18:43:32 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX75388%27 HTTP/1.1" 200 None
2026-03-29 18:43:32 [auto1.de] INFO: Scrape type for HX75388: 2
2026-03-29 18:43:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with identifier: HX75388
2026-03-29 18:43:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with scrape type 2
2026-03-29 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with scrape type 2
2026-03-29 18:43:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9, identifier: HX75388
2026-03-29 18:43:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with identifier: HX75388
2026-03-29 18:43:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with identifier: HX75388
2026-03-29 18:43:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with identifier: HX75388 to the API
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:55:37Z',
'fuel_type': 'petrol',
'id': '9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX75388',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 50443,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-15',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2020}
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX75388%27 HTTP/1.1" 200 None
2026-03-29 18:43:32 [auto1.de] INFO: Saving data for HX75388: {'auction_closing_time': 1774886137.0, 'created_time': 1773305150.079249, 'last_price_update_time': 1774809812.750154}
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX75388') HTTP/1.1" 204 0
2026-03-29 18:43:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:32 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05570%27 HTTP/1.1" 200 None
2026-03-29 18:43:32 [auto1.de] INFO: Scrape type for AB05570: 0
2026-03-29 18:43:32 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-29 18:43:32 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP92874%27 HTTP/1.1" 200 None
2026-03-29 18:43:32 [auto1.de] INFO: Scrape type for AP92874: 0
2026-03-29 18:43:32 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU16486%27 HTTP/1.1" 200 None
2026-03-29 18:43:32 [auto1.de] INFO: Scrape type for LU16486: 2
2026-03-29 18:43:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with identifier: LU16486
2026-03-29 18:43:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with scrape type 2
2026-03-29 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with scrape type 2
2026-03-29 18:43:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6174ccb-9071-50cd-92b6-53c1d9c50ad5, identifier: LU16486
2026-03-29 18:43:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with identifier: LU16486
2026-03-29 18:43:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with identifier: LU16486
2026-03-29 18:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with identifier: LU16486 to the API
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:46:29Z',
'fuel_type': 'petrol',
'id': 'd6174ccb-9071-50cd-92b6-53c1d9c50ad5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU16486',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 48528,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-29',
'seller_name': None,
'title': 'Fiat 500X 1.4 Turbo Mirror',
'transmission': 'manual',
'trim': 'Mirror',
'year': 2017}
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU16486%27 HTTP/1.1" 200 None
2026-03-29 18:43:33 [auto1.de] INFO: Saving data for LU16486: {'auction_closing_time': 1774885589.0, 'created_time': 1773741734.08073, 'last_price_update_time': 1774809813.228073}
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU16486') HTTP/1.1" 204 0
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: CL18387
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV60687%27 HTTP/1.1" 200 None
2026-03-29 18:43:33 [auto1.de] INFO: Scrape type for TV60687: 2
2026-03-29 18:43:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc3edd7c-0625-5490-8f7a-e716059083dd with identifier: TV60687
2026-03-29 18:43:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc3edd7c-0625-5490-8f7a-e716059083dd with scrape type 2
2026-03-29 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc3edd7c-0625-5490-8f7a-e716059083dd with scrape type 2
2026-03-29 18:43:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc3edd7c-0625-5490-8f7a-e716059083dd, identifier: TV60687
2026-03-29 18:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc3edd7c-0625-5490-8f7a-e716059083dd with identifier: TV60687
2026-03-29 18:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc3edd7c-0625-5490-8f7a-e716059083dd with identifier: TV60687
2026-03-29 18:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc3edd7c-0625-5490-8f7a-e716059083dd with identifier: TV60687 to the API
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:16:16Z',
'fuel_type': 'petrol',
'id': 'cc3edd7c-0625-5490-8f7a-e716059083dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV60687',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 149218,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-29',
'seller_name': None,
'title': 'Opel Meriva 1.6 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2008}
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV60687%27 HTTP/1.1" 200 None
2026-03-29 18:43:33 [auto1.de] INFO: Saving data for TV60687: {'auction_closing_time': 1774883776.0, 'created_time': 1773685840.45106, 'last_price_update_time': 1774809813.760787}
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV60687') HTTP/1.1" 204 0
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ75418%27 HTTP/1.1" 200 None
2026-03-29 18:43:33 [auto1.de] INFO: Scrape type for KJ75418: 0
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA50565%27 HTTP/1.1" 200 None
2026-03-29 18:43:33 [auto1.de] INFO: Scrape type for CA50565: 2
2026-03-29 18:43:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with identifier: CA50565
2026-03-29 18:43:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with scrape type 2
2026-03-29 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with scrape type 2
2026-03-29 18:43:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8d0d78c-15a0-5605-ba10-d3a8eccac6c3, identifier: CA50565
2026-03-29 18:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with identifier: CA50565
2026-03-29 18:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with identifier: CA50565
2026-03-29 18:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with identifier: CA50565 to the API
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:14:39Z',
'fuel_type': 'diesel',
'id': 'f8d0d78c-15a0-5605-ba10-d3a8eccac6c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA50565',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 135252,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-27',
'seller_name': None,
'title': 'Hyundai Tucson 1.7 CRDi Style blue 2WD',
'transmission': 'automatic',
'trim': 'Style blue 2WD',
'year': 2018}
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA50565%27 HTTP/1.1" 200 None
2026-03-29 18:43:34 [auto1.de] INFO: Saving data for CA50565: {'auction_closing_time': 1774883679.0, 'created_time': 1773774481.528063, 'last_price_update_time': 1774809814.212504}
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA50565') HTTP/1.1" 204 0
2026-03-29 18:43:34 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23658%27 HTTP/1.1" 200 None
2026-03-29 18:43:34 [auto1.de] INFO: Scrape type for PR23658: 0
2026-03-29 18:43:34 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-29 18:43:34 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-29 18:43:34 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN42361%27 HTTP/1.1" 200 None
2026-03-29 18:43:34 [auto1.de] INFO: Scrape type for XN42361: 0
2026-03-29 18:43:34 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE73392%27 HTTP/1.1" 200 None
2026-03-29 18:43:34 [auto1.de] INFO: Scrape type for GE73392: 2
2026-03-29 18:43:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2211956b-d640-524c-aa47-e3c27fd05087 with identifier: GE73392
2026-03-29 18:43:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2211956b-d640-524c-aa47-e3c27fd05087 with scrape type 2
2026-03-29 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2211956b-d640-524c-aa47-e3c27fd05087 with scrape type 2
2026-03-29 18:43:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2211956b-d640-524c-aa47-e3c27fd05087, identifier: GE73392
2026-03-29 18:43:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2211956b-d640-524c-aa47-e3c27fd05087 with identifier: GE73392
2026-03-29 18:43:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2211956b-d640-524c-aa47-e3c27fd05087 with identifier: GE73392
2026-03-29 18:43:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2211956b-d640-524c-aa47-e3c27fd05087 with identifier: GE73392 to the API
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:22:10Z',
'fuel_type': 'petrol',
'id': '2211956b-d640-524c-aa47-e3c27fd05087',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE73392',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 169383,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-11',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.0 TSI Sound',
'transmission': 'manual',
'trim': 'Sound',
'year': 2017}
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE73392%27 HTTP/1.1" 200 None
2026-03-29 18:43:34 [auto1.de] INFO: Saving data for GE73392: {'auction_closing_time': 1774884130.0, 'created_time': 1773401026.680172, 'last_price_update_time': 1774809814.8707}
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE73392') HTTP/1.1" 204 0
2026-03-29 18:43:34 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF90530%27 HTTP/1.1" 200 None
2026-03-29 18:43:34 [auto1.de] INFO: Scrape type for PF90530: 0
2026-03-29 18:43:34 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX68947%27 HTTP/1.1" 200 None
2026-03-29 18:43:34 [auto1.de] INFO: Scrape type for LX68947: 2
2026-03-29 18:43:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a660f3fb-e8b1-52c5-804a-a2b34b53e60e with identifier: LX68947
2026-03-29 18:43:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a660f3fb-e8b1-52c5-804a-a2b34b53e60e with scrape type 2
2026-03-29 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a660f3fb-e8b1-52c5-804a-a2b34b53e60e with scrape type 2
2026-03-29 18:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a660f3fb-e8b1-52c5-804a-a2b34b53e60e, identifier: LX68947
2026-03-29 18:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a660f3fb-e8b1-52c5-804a-a2b34b53e60e with identifier: LX68947
2026-03-29 18:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a660f3fb-e8b1-52c5-804a-a2b34b53e60e with identifier: LX68947
2026-03-29 18:43:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a660f3fb-e8b1-52c5-804a-a2b34b53e60e with identifier: LX68947 to the API
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:00:46Z',
'fuel_type': 'diesel',
'id': 'a660f3fb-e8b1-52c5-804a-a2b34b53e60e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX68947',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 116520,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-09-27',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Ghia X',
'transmission': 'manual',
'trim': 'Ghia X',
'year': 2004}
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX68947%27 HTTP/1.1" 200 None
2026-03-29 18:43:35 [auto1.de] INFO: Saving data for LX68947: {'auction_closing_time': 1774882846.0, 'created_time': 1773302864.901384, 'last_price_update_time': 1774809815.40604}
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX68947') HTTP/1.1" 204 0
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW26780%27 HTTP/1.1" 200 None
2026-03-29 18:43:35 [auto1.de] INFO: Scrape type for ZW26780: 2
2026-03-29 18:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3285384a-2312-5ad7-a02e-5f2753b85caf with identifier: ZW26780
2026-03-29 18:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3285384a-2312-5ad7-a02e-5f2753b85caf with scrape type 2
2026-03-29 18:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3285384a-2312-5ad7-a02e-5f2753b85caf with scrape type 2
2026-03-29 18:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3285384a-2312-5ad7-a02e-5f2753b85caf, identifier: ZW26780
2026-03-29 18:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3285384a-2312-5ad7-a02e-5f2753b85caf with identifier: ZW26780
2026-03-29 18:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3285384a-2312-5ad7-a02e-5f2753b85caf with identifier: ZW26780
2026-03-29 18:43:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3285384a-2312-5ad7-a02e-5f2753b85caf with identifier: ZW26780 to the API
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:33:40Z',
'fuel_type': 'diesel',
'id': '3285384a-2312-5ad7-a02e-5f2753b85caf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW26780',
'listing': 'auction',
'make': 'Volvo',
'model': 'V70',
'odometer': 466645,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-01',
'seller_name': None,
'title': 'Volvo V70 2.0 D3 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2008}
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW26780%27 HTTP/1.1" 200 None
2026-03-29 18:43:35 [auto1.de] INFO: Saving data for ZW26780: {'auction_closing_time': 1774884820.0, 'created_time': 1774607722.436272, 'last_price_update_time': 1774809815.835591}
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW26780') HTTP/1.1" 204 0
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06464%27 HTTP/1.1" 200 None
2026-03-29 18:43:35 [auto1.de] INFO: Scrape type for VX06464: 2
2026-03-29 18:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with identifier: VX06464
2026-03-29 18:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with scrape type 2
2026-03-29 18:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with scrape type 2
2026-03-29 18:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fbad728-be3a-5d7e-9e5c-c557b0dae75d, identifier: VX06464
2026-03-29 18:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with identifier: VX06464
2026-03-29 18:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with identifier: VX06464
2026-03-29 18:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with identifier: VX06464 to the API
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:13:08Z',
'fuel_type': 'diesel',
'id': '0fbad728-be3a-5d7e-9e5c-c557b0dae75d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX06464',
'listing': 'auction',
'make': 'Audi',
'model': 'A4 Allroad',
'odometer': 207928,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-30',
'seller_name': None,
'title': 'Audi A4 Allroad 3.0 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06464%27 HTTP/1.1" 200 None
2026-03-29 18:43:36 [auto1.de] INFO: Saving data for VX06464: {'auction_closing_time': 1774883588.0, 'created_time': 1773469108.653736, 'last_price_update_time': 1774809816.299617}
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX06464') HTTP/1.1" 204 0
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-29 18:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:36 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA93486%27 HTTP/1.1" 200 None
2026-03-29 18:43:36 [auto1.de] INFO: Scrape type for JA93486: 0
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC09176%27 HTTP/1.1" 200 None
2026-03-29 18:43:36 [auto1.de] INFO: Scrape type for UC09176: 2
2026-03-29 18:43:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1037979a-f613-5923-bc9a-9d1497ed05ef with identifier: UC09176
2026-03-29 18:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1037979a-f613-5923-bc9a-9d1497ed05ef with scrape type 2
2026-03-29 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1037979a-f613-5923-bc9a-9d1497ed05ef with scrape type 2
2026-03-29 18:43:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1037979a-f613-5923-bc9a-9d1497ed05ef, identifier: UC09176
2026-03-29 18:43:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1037979a-f613-5923-bc9a-9d1497ed05ef with identifier: UC09176
2026-03-29 18:43:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1037979a-f613-5923-bc9a-9d1497ed05ef with identifier: UC09176
2026-03-29 18:43:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1037979a-f613-5923-bc9a-9d1497ed05ef with identifier: UC09176 to the API
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:31:25Z',
'fuel_type': 'petrol',
'id': '1037979a-f613-5923-bc9a-9d1497ed05ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC09176',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLK-Klasse',
'odometer': 202452,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-12-16',
'seller_name': None,
'title': 'Mercedes-Benz CLK-Klasse CLK 320 Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 1998}
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC09176%27 HTTP/1.1" 200 None
2026-03-29 18:43:37 [auto1.de] INFO: Saving data for UC09176: {'auction_closing_time': 1774884685.0, 'created_time': 1774522624.584151, 'last_price_update_time': 1774809817.316969}
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC09176') HTTP/1.1" 204 0
2026-03-29 18:43:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY02082%27 HTTP/1.1" 200 None
2026-03-29 18:43:37 [auto1.de] INFO: Scrape type for VY02082: 0
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE09566%27 HTTP/1.1" 200 None
2026-03-29 18:43:37 [auto1.de] INFO: Scrape type for DE09566: 2
2026-03-29 18:43:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46f2104-2545-581e-b8f2-ebd402e80dbd with identifier: DE09566
2026-03-29 18:43:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46f2104-2545-581e-b8f2-ebd402e80dbd with scrape type 2
2026-03-29 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c46f2104-2545-581e-b8f2-ebd402e80dbd with scrape type 2
2026-03-29 18:43:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c46f2104-2545-581e-b8f2-ebd402e80dbd, identifier: DE09566
2026-03-29 18:43:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c46f2104-2545-581e-b8f2-ebd402e80dbd with identifier: DE09566
2026-03-29 18:43:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c46f2104-2545-581e-b8f2-ebd402e80dbd with identifier: DE09566
2026-03-29 18:43:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c46f2104-2545-581e-b8f2-ebd402e80dbd with identifier: DE09566 to the API
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:09:50Z',
'fuel_type': 'diesel',
'id': 'c46f2104-2545-581e-b8f2-ebd402e80dbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE09566',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 76671,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-22',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
'transmission': 'automatic',
'trim': 'Highline 4Motion',
'year': 2021}
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE09566%27 HTTP/1.1" 200 None
2026-03-29 18:43:37 [auto1.de] INFO: Saving data for DE09566: {'auction_closing_time': 1774883390.0, 'created_time': 1773830261.466794, 'last_price_update_time': 1774809817.799002}
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE09566') HTTP/1.1" 204 0
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD78649%27 HTTP/1.1" 200 None
2026-03-29 18:43:37 [auto1.de] INFO: Scrape type for HD78649: 0
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69017%27 HTTP/1.1" 200 None
2026-03-29 18:43:37 [auto1.de] INFO: Scrape type for KA69017: 0
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG82717%27 HTTP/1.1" 200 None
2026-03-29 18:43:37 [auto1.de] INFO: Scrape type for UG82717: 0
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR60146%27 HTTP/1.1" 200 None
2026-03-29 18:43:37 [auto1.de] INFO: Scrape type for KR60146: 2
2026-03-29 18:43:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfbee945-89c8-53eb-8fb7-57c7da1b062e with identifier: KR60146
2026-03-29 18:43:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfbee945-89c8-53eb-8fb7-57c7da1b062e with scrape type 2
2026-03-29 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfbee945-89c8-53eb-8fb7-57c7da1b062e with scrape type 2
2026-03-29 18:43:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfbee945-89c8-53eb-8fb7-57c7da1b062e, identifier: KR60146
2026-03-29 18:43:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfbee945-89c8-53eb-8fb7-57c7da1b062e with identifier: KR60146
2026-03-29 18:43:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfbee945-89c8-53eb-8fb7-57c7da1b062e with identifier: KR60146
2026-03-29 18:43:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfbee945-89c8-53eb-8fb7-57c7da1b062e with identifier: KR60146 to the API
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:26:24Z',
'fuel_type': 'petrol',
'id': 'cfbee945-89c8-53eb-8fb7-57c7da1b062e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR60146',
'listing': 'auction',
'make': 'Ford',
'model': 'Puma',
'odometer': 26620,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-04',
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Titanium X',
'transmission': 'manual',
'trim': 'Titanium X',
'year': 2020}
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR60146%27 HTTP/1.1" 200 None
2026-03-29 18:43:38 [auto1.de] INFO: Saving data for KR60146: {'auction_closing_time': 1774884384.0, 'created_time': 1773341652.793142, 'last_price_update_time': 1774809818.46754}
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR60146') HTTP/1.1" 204 0
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH22526%27 HTTP/1.1" 200 None
2026-03-29 18:43:38 [auto1.de] INFO: Scrape type for JH22526: 2
2026-03-29 18:43:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d38e7110-80dd-53d8-99f6-4f6a798559b0 with identifier: JH22526
2026-03-29 18:43:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d38e7110-80dd-53d8-99f6-4f6a798559b0 with scrape type 2
2026-03-29 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d38e7110-80dd-53d8-99f6-4f6a798559b0 with scrape type 2
2026-03-29 18:43:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d38e7110-80dd-53d8-99f6-4f6a798559b0, identifier: JH22526
2026-03-29 18:43:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d38e7110-80dd-53d8-99f6-4f6a798559b0 with identifier: JH22526
2026-03-29 18:43:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d38e7110-80dd-53d8-99f6-4f6a798559b0 with identifier: JH22526
2026-03-29 18:43:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d38e7110-80dd-53d8-99f6-4f6a798559b0 with identifier: JH22526 to the API
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:30:14Z',
'fuel_type': 'petrol',
'id': 'd38e7110-80dd-53d8-99f6-4f6a798559b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH22526',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 190329,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-14',
'seller_name': None,
'title': 'Audi A6 2.0 TFSI',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH22526%27 HTTP/1.1" 200 None
2026-03-29 18:43:38 [auto1.de] INFO: Saving data for JH22526: {'auction_closing_time': 1774884614.0, 'created_time': 1774521744.473578, 'last_price_update_time': 1774809818.876967}
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH22526') HTTP/1.1" 204 0
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG36008%27 HTTP/1.1" 200 None
2026-03-29 18:43:38 [auto1.de] INFO: Scrape type for UG36008: 0
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT56964%27 HTTP/1.1" 200 None
2026-03-29 18:43:38 [auto1.de] INFO: Scrape type for AT56964: 2
2026-03-29 18:43:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c175e3b6-6fce-521b-92b1-c5b5392ae91e with identifier: AT56964
2026-03-29 18:43:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c175e3b6-6fce-521b-92b1-c5b5392ae91e with scrape type 2
2026-03-29 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c175e3b6-6fce-521b-92b1-c5b5392ae91e with scrape type 2
2026-03-29 18:43:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c175e3b6-6fce-521b-92b1-c5b5392ae91e, identifier: AT56964
2026-03-29 18:43:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c175e3b6-6fce-521b-92b1-c5b5392ae91e with identifier: AT56964
2026-03-29 18:43:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c175e3b6-6fce-521b-92b1-c5b5392ae91e with identifier: AT56964
2026-03-29 18:43:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c175e3b6-6fce-521b-92b1-c5b5392ae91e with identifier: AT56964 to the API
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:58:40Z',
'fuel_type': 'diesel',
'id': 'c175e3b6-6fce-521b-92b1-c5b5392ae91e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT56964',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 185497,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-22',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2017}
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT56964%27 HTTP/1.1" 200 None
2026-03-29 18:43:39 [auto1.de] INFO: Saving data for AT56964: {'auction_closing_time': 1774886320.0, 'created_time': 1774031622.858241, 'last_price_update_time': 1774809819.344632}
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT56964') HTTP/1.1" 204 0
2026-03-29 18:43:39 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-29 18:43:39 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM50766%27 HTTP/1.1" 200 None
2026-03-29 18:43:39 [auto1.de] INFO: Scrape type for TM50766: 0
2026-03-29 18:43:39 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-29 18:43:39 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-29 18:43:39 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG62730%27 HTTP/1.1" 200 None
2026-03-29 18:43:39 [auto1.de] INFO: Scrape type for LG62730: 2
2026-03-29 18:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730
2026-03-29 18:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with scrape type 2
2026-03-29 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with scrape type 2
2026-03-29 18:43:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73, identifier: LG62730
2026-03-29 18:43:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730
2026-03-29 18:43:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730
2026-03-29 18:43:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730 to the API
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:51:36Z',
'fuel_type': 'diesel',
'id': '7c51b62c-b60d-5b31-ab3f-a150e7de0a73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG62730',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 146872,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-29',
'seller_name': None,
'title': 'Mazda CX-3 1.5 Diesel Sports-Line AWD',
'transmission': 'manual',
'trim': 'Sports-Line AWD',
'year': 2018}
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG62730%27 HTTP/1.1" 200 None
2026-03-29 18:43:39 [auto1.de] INFO: Saving data for LG62730: {'auction_closing_time': 1774885896.0, 'created_time': 1774608294.151967, 'last_price_update_time': 1774809819.931406}
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG62730') HTTP/1.1" 204 0
2026-03-29 18:43:39 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN67479%27 HTTP/1.1" 200 None
2026-03-29 18:43:39 [auto1.de] INFO: Scrape type for CN67479: 2
2026-03-29 18:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with identifier: CN67479
2026-03-29 18:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with scrape type 2
2026-03-29 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with scrape type 2
2026-03-29 18:43:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f, identifier: CN67479
2026-03-29 18:43:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with identifier: CN67479
2026-03-29 18:43:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with identifier: CN67479
2026-03-29 18:43:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with identifier: CN67479 to the API
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:15:01Z',
'fuel_type': 'diesel',
'id': '6221f91d-1ff6-5448-a6b5-d62a28f0ca8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN67479',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 204532,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-08',
'seller_name': None,
'title': 'Peugeot Expert 2.0 HDi L1H1 Tendance',
'transmission': 'manual',
'trim': 'L1H1 Tendance',
'year': 2011}
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN67479%27 HTTP/1.1" 200 None
2026-03-29 18:43:40 [auto1.de] INFO: Saving data for CN67479: {'auction_closing_time': 1774883701.0, 'created_time': 1773662274.904959, 'last_price_update_time': 1774809820.385912}
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN67479') HTTP/1.1" 204 0
2026-03-29 18:43:40 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-29 18:43:40 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG50792%27 HTTP/1.1" 200 None
2026-03-29 18:43:40 [auto1.de] INFO: Scrape type for TG50792: 0
2026-03-29 18:43:40 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV45181%27 HTTP/1.1" 200 None
2026-03-29 18:43:40 [auto1.de] INFO: Scrape type for KV45181: 0
2026-03-29 18:43:40 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50717%27 HTTP/1.1" 200 None
2026-03-29 18:43:40 [auto1.de] INFO: Scrape type for XS50717: 2
2026-03-29 18:43:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with identifier: XS50717
2026-03-29 18:43:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with scrape type 2
2026-03-29 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with scrape type 2
2026-03-29 18:43:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ce99cba-2e69-5b5f-9d47-a22d9de18873, identifier: XS50717
2026-03-29 18:43:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with identifier: XS50717
2026-03-29 18:43:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with identifier: XS50717
2026-03-29 18:43:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with identifier: XS50717 to the API
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:27:21Z',
'fuel_type': 'diesel',
'id': '1ce99cba-2e69-5b5f-9d47-a22d9de18873',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS50717',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 186763,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-10',
'seller_name': None,
'title': 'BMW 3er 316d Sport Line',
'transmission': 'manual',
'trim': 'Sport Line',
'year': 2016}
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50717%27 HTTP/1.1" 200 None
2026-03-29 18:43:40 [auto1.de] INFO: Saving data for XS50717: {'auction_closing_time': 1774884441.0, 'created_time': 1774349102.194211, 'last_price_update_time': 1774809820.930371}
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS50717') HTTP/1.1" 204 0
2026-03-29 18:43:40 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK47054%27 HTTP/1.1" 200 None
2026-03-29 18:43:40 [auto1.de] INFO: Scrape type for TK47054: 2
2026-03-29 18:43:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85f890be-beaa-5096-8c2e-ed046630c7f4 with identifier: TK47054
2026-03-29 18:43:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85f890be-beaa-5096-8c2e-ed046630c7f4 with scrape type 2
2026-03-29 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85f890be-beaa-5096-8c2e-ed046630c7f4 with scrape type 2
2026-03-29 18:43:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85f890be-beaa-5096-8c2e-ed046630c7f4, identifier: TK47054
2026-03-29 18:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85f890be-beaa-5096-8c2e-ed046630c7f4 with identifier: TK47054
2026-03-29 18:43:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85f890be-beaa-5096-8c2e-ed046630c7f4 with identifier: TK47054
2026-03-29 18:43:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85f890be-beaa-5096-8c2e-ed046630c7f4 with identifier: TK47054 to the API
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 557,
'expiration_date': '2026-03-30T15:17:50Z',
'fuel_type': 'petrol',
'id': '85f890be-beaa-5096-8c2e-ed046630c7f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK47054',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 186704,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-04',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 63 AMG 4Matic Avantgarde',
'transmission': 'automatic',
'trim': '4Matic Avantgarde',
'year': 2015}
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK47054%27 HTTP/1.1" 200 None
2026-03-29 18:43:41 [auto1.de] INFO: Saving data for TK47054: {'auction_closing_time': 1774883870.0, 'created_time': 1773776264.054683, 'last_price_update_time': 1774809821.419826}
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK47054') HTTP/1.1" 204 0
2026-03-29 18:43:41 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM30127%27 HTTP/1.1" 200 None
2026-03-29 18:43:41 [auto1.de] INFO: Scrape type for LM30127: 0
2026-03-29 18:43:41 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE74408%27 HTTP/1.1" 200 None
2026-03-29 18:43:41 [auto1.de] INFO: Scrape type for PE74408: 2
2026-03-29 18:43:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 159e9741-1e31-5964-8229-43882a37d005 with identifier: PE74408
2026-03-29 18:43:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 159e9741-1e31-5964-8229-43882a37d005 with scrape type 2
2026-03-29 18:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 159e9741-1e31-5964-8229-43882a37d005 with scrape type 2
2026-03-29 18:43:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 159e9741-1e31-5964-8229-43882a37d005, identifier: PE74408
2026-03-29 18:43:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 159e9741-1e31-5964-8229-43882a37d005 with identifier: PE74408
2026-03-29 18:43:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 159e9741-1e31-5964-8229-43882a37d005 with identifier: PE74408
2026-03-29 18:43:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 159e9741-1e31-5964-8229-43882a37d005 with identifier: PE74408 to the API
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:19:43Z',
'fuel_type': 'petrol',
'id': '159e9741-1e31-5964-8229-43882a37d005',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE74408',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 112645,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-26',
'seller_name': None,
'title': 'Skoda Fabia 1.2 Special',
'transmission': 'manual',
'trim': 'Special',
'year': 2011}
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE74408%27 HTTP/1.1" 200 None
2026-03-29 18:43:42 [auto1.de] INFO: Saving data for PE74408: {'auction_closing_time': 1774883983.0, 'created_time': 1773686803.45991, 'last_price_update_time': 1774809822.076312}
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE74408') HTTP/1.1" 204 0
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-29 18:43:42 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW09760%27 HTTP/1.1" 200 None
2026-03-29 18:43:42 [auto1.de] INFO: Scrape type for RW09760: 0
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15000%27 HTTP/1.1" 200 None
2026-03-29 18:43:42 [auto1.de] INFO: Scrape type for VX15000: 2
2026-03-29 18:43:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f6e1b34-90a9-598e-8c77-d610d273f4b4 with identifier: VX15000
2026-03-29 18:43:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f6e1b34-90a9-598e-8c77-d610d273f4b4 with scrape type 2
2026-03-29 18:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f6e1b34-90a9-598e-8c77-d610d273f4b4 with scrape type 2
2026-03-29 18:43:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f6e1b34-90a9-598e-8c77-d610d273f4b4, identifier: VX15000
2026-03-29 18:43:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f6e1b34-90a9-598e-8c77-d610d273f4b4 with identifier: VX15000
2026-03-29 18:43:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f6e1b34-90a9-598e-8c77-d610d273f4b4 with identifier: VX15000
2026-03-29 18:43:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f6e1b34-90a9-598e-8c77-d610d273f4b4 with identifier: VX15000 to the API
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:20:21Z',
'fuel_type': 'diesel',
'id': '9f6e1b34-90a9-598e-8c77-d610d273f4b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX15000',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 105992,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-11',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TDI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2017}
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15000%27 HTTP/1.1" 200 None
2026-03-29 18:43:42 [auto1.de] INFO: Saving data for VX15000: {'auction_closing_time': 1774884021.0, 'created_time': 1774636604.334317, 'last_price_update_time': 1774809822.522417}
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX15000') HTTP/1.1" 204 0
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC75051%27 HTTP/1.1" 200 None
2026-03-29 18:43:42 [auto1.de] INFO: Scrape type for CC75051: 2
2026-03-29 18:43:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2460f77-95c6-5715-bbc6-95a00bb6111b with identifier: CC75051
2026-03-29 18:43:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2460f77-95c6-5715-bbc6-95a00bb6111b with scrape type 2
2026-03-29 18:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2460f77-95c6-5715-bbc6-95a00bb6111b with scrape type 2
2026-03-29 18:43:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2460f77-95c6-5715-bbc6-95a00bb6111b, identifier: CC75051
2026-03-29 18:43:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2460f77-95c6-5715-bbc6-95a00bb6111b with identifier: CC75051
2026-03-29 18:43:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2460f77-95c6-5715-bbc6-95a00bb6111b with identifier: CC75051
2026-03-29 18:43:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2460f77-95c6-5715-bbc6-95a00bb6111b with identifier: CC75051 to the API
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:06:56Z',
'fuel_type': 'diesel',
'id': 'c2460f77-95c6-5715-bbc6-95a00bb6111b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC75051',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 253612,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-18',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Style 4x4',
'transmission': 'automatic',
'trim': 'Style 4x4',
'year': 2016}
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC75051%27 HTTP/1.1" 200 None
2026-03-29 18:43:42 [auto1.de] INFO: Saving data for CC75051: {'auction_closing_time': 1774883216.0, 'created_time': 1773732634.766448, 'last_price_update_time': 1774809822.98448}
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC75051') HTTP/1.1" 204 0
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73067%27 HTTP/1.1" 200 None
2026-03-29 18:43:43 [auto1.de] INFO: Scrape type for WK73067: 0
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR29242%27 HTTP/1.1" 200 None
2026-03-29 18:43:43 [auto1.de] INFO: Scrape type for TR29242: 0
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH74831%27 HTTP/1.1" 200 None
2026-03-29 18:43:43 [auto1.de] INFO: Scrape type for EH74831: 2
2026-03-29 18:43:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b14289ac-35be-5e00-b887-be57d524cb89 with identifier: EH74831
2026-03-29 18:43:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b14289ac-35be-5e00-b887-be57d524cb89 with scrape type 2
2026-03-29 18:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b14289ac-35be-5e00-b887-be57d524cb89 with scrape type 2
2026-03-29 18:43:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b14289ac-35be-5e00-b887-be57d524cb89, identifier: EH74831
2026-03-29 18:43:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b14289ac-35be-5e00-b887-be57d524cb89 with identifier: EH74831
2026-03-29 18:43:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b14289ac-35be-5e00-b887-be57d524cb89 with identifier: EH74831
2026-03-29 18:43:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b14289ac-35be-5e00-b887-be57d524cb89 with identifier: EH74831 to the API
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:58:18Z',
'fuel_type': 'petrol',
'id': 'b14289ac-35be-5e00-b887-be57d524cb89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH74831',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 79141,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-07',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH74831%27 HTTP/1.1" 200 None
2026-03-29 18:43:43 [auto1.de] INFO: Saving data for EH74831: {'auction_closing_time': 1774886298.0, 'created_time': 1773775402.534964, 'last_price_update_time': 1774809823.570502}
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH74831') HTTP/1.1" 204 0
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99160%27 HTTP/1.1" 200 None
2026-03-29 18:43:43 [auto1.de] INFO: Scrape type for BN99160: 2
2026-03-29 18:43:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5712236d-f2e5-5810-88c4-2658be36ae46 with identifier: BN99160
2026-03-29 18:43:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5712236d-f2e5-5810-88c4-2658be36ae46 with scrape type 2
2026-03-29 18:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5712236d-f2e5-5810-88c4-2658be36ae46 with scrape type 2
2026-03-29 18:43:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5712236d-f2e5-5810-88c4-2658be36ae46, identifier: BN99160
2026-03-29 18:43:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5712236d-f2e5-5810-88c4-2658be36ae46 with identifier: BN99160
2026-03-29 18:43:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5712236d-f2e5-5810-88c4-2658be36ae46 with identifier: BN99160
2026-03-29 18:43:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5712236d-f2e5-5810-88c4-2658be36ae46 with identifier: BN99160 to the API
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:22:03Z',
'fuel_type': 'petrol',
'id': '5712236d-f2e5-5810-88c4-2658be36ae46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN99160',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 120520,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-03',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.0 TSI Join',
'transmission': 'manual',
'trim': 'Join',
'year': 2019}
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99160%27 HTTP/1.1" 200 None
2026-03-29 18:43:44 [auto1.de] INFO: Saving data for BN99160: {'auction_closing_time': 1774884123.0, 'created_time': 1773302919.288023, 'last_price_update_time': 1774809824.099347}
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN99160') HTTP/1.1" 204 0
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK28238%27 HTTP/1.1" 200 None
2026-03-29 18:43:44 [auto1.de] INFO: Scrape type for ZK28238: 2
2026-03-29 18:43:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da4eeb5d-6e91-5755-b416-1a790dfd96ac with identifier: ZK28238
2026-03-29 18:43:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da4eeb5d-6e91-5755-b416-1a790dfd96ac with scrape type 2
2026-03-29 18:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da4eeb5d-6e91-5755-b416-1a790dfd96ac with scrape type 2
2026-03-29 18:43:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da4eeb5d-6e91-5755-b416-1a790dfd96ac, identifier: ZK28238
2026-03-29 18:43:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da4eeb5d-6e91-5755-b416-1a790dfd96ac with identifier: ZK28238
2026-03-29 18:43:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da4eeb5d-6e91-5755-b416-1a790dfd96ac with identifier: ZK28238
2026-03-29 18:43:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da4eeb5d-6e91-5755-b416-1a790dfd96ac with identifier: ZK28238 to the API
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:57:31Z',
'fuel_type': 'diesel',
'id': 'da4eeb5d-6e91-5755-b416-1a790dfd96ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK28238',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 290983,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-26',
'seller_name': None,
'title': 'BMW 3er 318d',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK28238%27 HTTP/1.1" 200 None
2026-03-29 18:43:44 [auto1.de] INFO: Saving data for ZK28238: {'auction_closing_time': 1774886251.0, 'created_time': 1774607542.101111, 'last_price_update_time': 1774809824.532819}
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK28238') HTTP/1.1" 204 0
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05980%27 HTTP/1.1" 200 None
2026-03-29 18:43:44 [auto1.de] INFO: Scrape type for XE05980: 0
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB05774%27 HTTP/1.1" 200 None
2026-03-29 18:43:44 [auto1.de] INFO: Scrape type for NB05774: 2
2026-03-29 18:43:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efd943df-a583-5214-85c6-7f9588fb9e2d with identifier: NB05774
2026-03-29 18:43:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efd943df-a583-5214-85c6-7f9588fb9e2d with scrape type 2
2026-03-29 18:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efd943df-a583-5214-85c6-7f9588fb9e2d with scrape type 2
2026-03-29 18:43:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efd943df-a583-5214-85c6-7f9588fb9e2d, identifier: NB05774
2026-03-29 18:43:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efd943df-a583-5214-85c6-7f9588fb9e2d with identifier: NB05774
2026-03-29 18:43:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efd943df-a583-5214-85c6-7f9588fb9e2d with identifier: NB05774
2026-03-29 18:43:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efd943df-a583-5214-85c6-7f9588fb9e2d with identifier: NB05774 to the API
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:35:04Z',
'fuel_type': 'diesel',
'id': 'efd943df-a583-5214-85c6-7f9588fb9e2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB05774',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 90166,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-07',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TDI GTD',
'transmission': 'automatic',
'trim': 'GTD',
'year': 2022}
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB05774%27 HTTP/1.1" 200 None
2026-03-29 18:43:44 [auto1.de] INFO: Saving data for NB05774: {'auction_closing_time': 1774884904.0, 'created_time': 1773387069.761915, 'last_price_update_time': 1774809824.979044}
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB05774') HTTP/1.1" 204 0
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM28513%27 HTTP/1.1" 200 None
2026-03-29 18:43:45 [auto1.de] INFO: Scrape type for NM28513: 2
2026-03-29 18:43:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e480f60-9e0a-54e9-9f8c-1187b63333da with identifier: NM28513
2026-03-29 18:43:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e480f60-9e0a-54e9-9f8c-1187b63333da with scrape type 2
2026-03-29 18:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e480f60-9e0a-54e9-9f8c-1187b63333da with scrape type 2
2026-03-29 18:43:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e480f60-9e0a-54e9-9f8c-1187b63333da, identifier: NM28513
2026-03-29 18:43:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e480f60-9e0a-54e9-9f8c-1187b63333da with identifier: NM28513
2026-03-29 18:43:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e480f60-9e0a-54e9-9f8c-1187b63333da with identifier: NM28513
2026-03-29 18:43:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e480f60-9e0a-54e9-9f8c-1187b63333da with identifier: NM28513 to the API
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:29:22Z',
'fuel_type': 'petrol',
'id': '1e480f60-9e0a-54e9-9f8c-1187b63333da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM28513',
'listing': 'auction',
'make': 'Ford',
'model': 'B-Max',
'odometer': 70700,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-05',
'seller_name': None,
'title': 'Ford B-Max 1.6 Ti-VCT Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2015}
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM28513%27 HTTP/1.1" 200 None
2026-03-29 18:43:45 [auto1.de] INFO: Saving data for NM28513: {'auction_closing_time': 1774884562.0, 'created_time': 1773830816.714578, 'last_price_update_time': 1774809825.453479}
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM28513') HTTP/1.1" 204 0
2026-03-29 18:43:45 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-29 18:43:45 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND58698%27 HTTP/1.1" 200 None
2026-03-29 18:43:45 [auto1.de] INFO: Scrape type for ND58698: 0
2026-03-29 18:43:45 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-29 18:43:45 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-29 18:43:45 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-29 18:43:45 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-29 18:43:45 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-29 18:43:45 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60509%27 HTTP/1.1" 200 None
2026-03-29 18:43:45 [auto1.de] INFO: Scrape type for YM60509: 2
2026-03-29 18:43:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d1372f1-daf7-5393-84d2-6558cf8347e5 with identifier: YM60509
2026-03-29 18:43:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d1372f1-daf7-5393-84d2-6558cf8347e5 with scrape type 2
2026-03-29 18:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d1372f1-daf7-5393-84d2-6558cf8347e5 with scrape type 2
2026-03-29 18:43:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d1372f1-daf7-5393-84d2-6558cf8347e5, identifier: YM60509
2026-03-29 18:43:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d1372f1-daf7-5393-84d2-6558cf8347e5 with identifier: YM60509
2026-03-29 18:43:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d1372f1-daf7-5393-84d2-6558cf8347e5 with identifier: YM60509
2026-03-29 18:43:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d1372f1-daf7-5393-84d2-6558cf8347e5 with identifier: YM60509 to the API
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:00:07Z',
'fuel_type': 'petrol',
'id': '9d1372f1-daf7-5393-84d2-6558cf8347e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM60509',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 86042,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-01',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2015}
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60509%27 HTTP/1.1" 200 None
2026-03-29 18:43:45 [auto1.de] INFO: Saving data for YM60509: {'auction_closing_time': 1774882807.0, 'created_time': 1774522110.049694, 'last_price_update_time': 1774809825.945699}
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM60509') HTTP/1.1" 204 0
2026-03-29 18:43:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:46 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA69467%27 HTTP/1.1" 200 None
2026-03-29 18:43:46 [auto1.de] INFO: Scrape type for HA69467: 2
2026-03-29 18:43:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 845139da-8c86-582d-bffc-6ea08e9ae60d with identifier: HA69467
2026-03-29 18:43:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 845139da-8c86-582d-bffc-6ea08e9ae60d with scrape type 2
2026-03-29 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 845139da-8c86-582d-bffc-6ea08e9ae60d with scrape type 2
2026-03-29 18:43:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 845139da-8c86-582d-bffc-6ea08e9ae60d, identifier: HA69467
2026-03-29 18:43:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 845139da-8c86-582d-bffc-6ea08e9ae60d with identifier: HA69467
2026-03-29 18:43:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 845139da-8c86-582d-bffc-6ea08e9ae60d with identifier: HA69467
2026-03-29 18:43:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 845139da-8c86-582d-bffc-6ea08e9ae60d with identifier: HA69467 to the API
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:29:16Z',
'fuel_type': 'diesel',
'id': '845139da-8c86-582d-bffc-6ea08e9ae60d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA69467',
'listing': 'auction',
'make': 'Renault',
'model': 'Talisman',
'odometer': 184389,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-29',
'seller_name': None,
'title': 'Renault Talisman 1.6 dCi Energy Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2016}
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA69467%27 HTTP/1.1" 200 None
2026-03-29 18:43:46 [auto1.de] INFO: Saving data for HA69467: {'auction_closing_time': 1774884556.0, 'created_time': 1773859427.344956, 'last_price_update_time': 1774809826.648997}
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA69467') HTTP/1.1" 204 0
2026-03-29 18:43:46 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13561%27 HTTP/1.1" 200 None
2026-03-29 18:43:46 [auto1.de] INFO: Scrape type for EA13561: 2
2026-03-29 18:43:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0e39d28-937d-54ff-a131-ab56b06a77ab with identifier: EA13561
2026-03-29 18:43:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0e39d28-937d-54ff-a131-ab56b06a77ab with scrape type 2
2026-03-29 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0e39d28-937d-54ff-a131-ab56b06a77ab with scrape type 2
2026-03-29 18:43:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0e39d28-937d-54ff-a131-ab56b06a77ab, identifier: EA13561
2026-03-29 18:43:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0e39d28-937d-54ff-a131-ab56b06a77ab with identifier: EA13561
2026-03-29 18:43:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0e39d28-937d-54ff-a131-ab56b06a77ab with identifier: EA13561
2026-03-29 18:43:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0e39d28-937d-54ff-a131-ab56b06a77ab with identifier: EA13561 to the API
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:56:59Z',
'fuel_type': 'petrol',
'id': 'd0e39d28-937d-54ff-a131-ab56b06a77ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA13561',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 30261,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-20',
'seller_name': None,
'title': 'Citroen C4 1.2 PureTech Max',
'transmission': 'automatic',
'trim': 'Max',
'year': 2023}
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13561%27 HTTP/1.1" 200 None
2026-03-29 18:43:47 [auto1.de] INFO: Saving data for EA13561: {'auction_closing_time': 1774886219.0, 'created_time': 1774607696.282242, 'last_price_update_time': 1774809827.175474}
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA13561') HTTP/1.1" 204 0
2026-03-29 18:43:47 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:47 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK59182%27 HTTP/1.1" 200 None
2026-03-29 18:43:47 [auto1.de] INFO: Scrape type for XK59182: 2
2026-03-29 18:43:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: add08cfe-4aa1-56ed-9e24-2b5175520a73 with identifier: XK59182
2026-03-29 18:43:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add08cfe-4aa1-56ed-9e24-2b5175520a73 with scrape type 2
2026-03-29 18:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item add08cfe-4aa1-56ed-9e24-2b5175520a73 with scrape type 2
2026-03-29 18:43:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: add08cfe-4aa1-56ed-9e24-2b5175520a73, identifier: XK59182
2026-03-29 18:43:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: add08cfe-4aa1-56ed-9e24-2b5175520a73 with identifier: XK59182
2026-03-29 18:43:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: add08cfe-4aa1-56ed-9e24-2b5175520a73 with identifier: XK59182
2026-03-29 18:43:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: add08cfe-4aa1-56ed-9e24-2b5175520a73 with identifier: XK59182 to the API
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 328,
'expiration_date': '2026-03-30T15:37:20Z',
'fuel_type': 'petrol',
'id': 'add08cfe-4aa1-56ed-9e24-2b5175520a73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK59182',
'listing': 'auction',
'make': 'Nissan',
'model': '370 Z',
'odometer': 68857,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-01',
'seller_name': None,
'title': 'Nissan 370 Z 3.7 V6 Roadster Pack',
'transmission': 'manual',
'trim': 'Roadster Pack',
'year': 2015}
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK59182%27 HTTP/1.1" 200 None
2026-03-29 18:43:47 [auto1.de] INFO: Saving data for XK59182: {'auction_closing_time': 1774885040.0, 'created_time': 1774521246.306808, 'last_price_update_time': 1774809827.579275}
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK59182') HTTP/1.1" 204 0
2026-03-29 18:43:47 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-29 18:43:47 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG91001%27 HTTP/1.1" 200 None
2026-03-29 18:43:47 [auto1.de] INFO: Scrape type for SG91001: 0
2026-03-29 18:43:47 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-29 18:43:47 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL30875%27 HTTP/1.1" 200 None
2026-03-29 18:43:47 [auto1.de] INFO: Scrape type for UL30875: 0
2026-03-29 18:43:47 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX61886%27 HTTP/1.1" 200 None
2026-03-29 18:43:47 [auto1.de] INFO: Scrape type for DX61886: 2
2026-03-29 18:43:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with identifier: DX61886
2026-03-29 18:43:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with scrape type 2
2026-03-29 18:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with scrape type 2
2026-03-29 18:43:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1669ee62-6172-5c20-bf51-2dd54c7f34c9, identifier: DX61886
2026-03-29 18:43:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with identifier: DX61886
2026-03-29 18:43:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with identifier: DX61886
2026-03-29 18:43:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with identifier: DX61886 to the API
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:07:22Z',
'fuel_type': 'diesel',
'id': '1669ee62-6172-5c20-bf51-2dd54c7f34c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX61886',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 288118,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-31',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2009}
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX61886%27 HTTP/1.1" 200 None
2026-03-29 18:43:48 [auto1.de] INFO: Saving data for DX61886: {'auction_closing_time': 1774883242.0, 'created_time': 1773304013.021955, 'last_price_update_time': 1774809828.142591}
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX61886') HTTP/1.1" 204 0
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT00768%27 HTTP/1.1" 200 None
2026-03-29 18:43:48 [auto1.de] INFO: Scrape type for GT00768: 2
2026-03-29 18:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 567c8caf-ea6d-5941-9aa1-a05e879c82e0 with identifier: GT00768
2026-03-29 18:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 567c8caf-ea6d-5941-9aa1-a05e879c82e0 with scrape type 2
2026-03-29 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 567c8caf-ea6d-5941-9aa1-a05e879c82e0 with scrape type 2
2026-03-29 18:43:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 567c8caf-ea6d-5941-9aa1-a05e879c82e0, identifier: GT00768
2026-03-29 18:43:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 567c8caf-ea6d-5941-9aa1-a05e879c82e0 with identifier: GT00768
2026-03-29 18:43:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 567c8caf-ea6d-5941-9aa1-a05e879c82e0 with identifier: GT00768
2026-03-29 18:43:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 567c8caf-ea6d-5941-9aa1-a05e879c82e0 with identifier: GT00768 to the API
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:02:32Z',
'fuel_type': 'petrol',
'id': '567c8caf-ea6d-5941-9aa1-a05e879c82e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT00768',
'listing': 'auction',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 87830,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-09',
'seller_name': None,
'title': 'Ford EcoSport 1.0 EcoBoost ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2020}
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT00768%27 HTTP/1.1" 200 None
2026-03-29 18:43:48 [auto1.de] INFO: Saving data for GT00768: {'auction_closing_time': 1774882952.0, 'created_time': 1773428036.089805, 'last_price_update_time': 1774809828.545044}
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT00768') HTTP/1.1" 204 0
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR38870%27 HTTP/1.1" 200 None
2026-03-29 18:43:48 [auto1.de] INFO: Scrape type for MR38870: 2
2026-03-29 18:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 925fe307-61b1-578f-910b-43f985bb1dd5 with identifier: MR38870
2026-03-29 18:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 925fe307-61b1-578f-910b-43f985bb1dd5 with scrape type 2
2026-03-29 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 925fe307-61b1-578f-910b-43f985bb1dd5 with scrape type 2
2026-03-29 18:43:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 925fe307-61b1-578f-910b-43f985bb1dd5, identifier: MR38870
2026-03-29 18:43:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 925fe307-61b1-578f-910b-43f985bb1dd5 with identifier: MR38870
2026-03-29 18:43:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 925fe307-61b1-578f-910b-43f985bb1dd5 with identifier: MR38870
2026-03-29 18:43:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 925fe307-61b1-578f-910b-43f985bb1dd5 with identifier: MR38870 to the API
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:46:46Z',
'fuel_type': 'petrol',
'id': '925fe307-61b1-578f-910b-43f985bb1dd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR38870',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia',
'odometer': 203593,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-21',
'seller_name': None,
'title': 'Opel Insignia 1.6 Turbo Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2009}
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR38870%27 HTTP/1.1" 200 None
2026-03-29 18:43:48 [auto1.de] INFO: Saving data for MR38870: {'auction_closing_time': 1774885606.0, 'created_time': 1774521665.686118, 'last_price_update_time': 1774809828.932949}
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR38870') HTTP/1.1" 204 0
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN01973%27 HTTP/1.1" 200 None
2026-03-29 18:43:49 [auto1.de] INFO: Scrape type for ZN01973: 2
2026-03-29 18:43:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a5099c9-aaf5-5cff-b340-cc4b0e508db6 with identifier: ZN01973
2026-03-29 18:43:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a5099c9-aaf5-5cff-b340-cc4b0e508db6 with scrape type 2
2026-03-29 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a5099c9-aaf5-5cff-b340-cc4b0e508db6 with scrape type 2
2026-03-29 18:43:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a5099c9-aaf5-5cff-b340-cc4b0e508db6, identifier: ZN01973
2026-03-29 18:43:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a5099c9-aaf5-5cff-b340-cc4b0e508db6 with identifier: ZN01973
2026-03-29 18:43:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a5099c9-aaf5-5cff-b340-cc4b0e508db6 with identifier: ZN01973
2026-03-29 18:43:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a5099c9-aaf5-5cff-b340-cc4b0e508db6 with identifier: ZN01973 to the API
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:46:20Z',
'fuel_type': 'petrol',
'id': '0a5099c9-aaf5-5cff-b340-cc4b0e508db6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN01973',
'listing': 'auction',
'make': 'Mazda',
'model': '2',
'odometer': 148458,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-17',
'seller_name': None,
'title': 'Mazda 2 1.3 Sendo',
'transmission': 'manual',
'trim': 'Sendo',
'year': 2014}
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN01973%27 HTTP/1.1" 200 None
2026-03-29 18:43:49 [auto1.de] INFO: Saving data for ZN01973: {'auction_closing_time': 1774885580.0, 'created_time': 1774521251.00514, 'last_price_update_time': 1774809829.463051}
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN01973') HTTP/1.1" 204 0
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS21206%27 HTTP/1.1" 200 None
2026-03-29 18:43:49 [auto1.de] INFO: Scrape type for YS21206: 2
2026-03-29 18:43:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4009654-c333-5c68-9d3a-c1b1b92c5cfa with identifier: YS21206
2026-03-29 18:43:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4009654-c333-5c68-9d3a-c1b1b92c5cfa with scrape type 2
2026-03-29 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4009654-c333-5c68-9d3a-c1b1b92c5cfa with scrape type 2
2026-03-29 18:43:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4009654-c333-5c68-9d3a-c1b1b92c5cfa, identifier: YS21206
2026-03-29 18:43:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4009654-c333-5c68-9d3a-c1b1b92c5cfa with identifier: YS21206
2026-03-29 18:43:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4009654-c333-5c68-9d3a-c1b1b92c5cfa with identifier: YS21206
2026-03-29 18:43:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4009654-c333-5c68-9d3a-c1b1b92c5cfa with identifier: YS21206 to the API
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:11:50Z',
'fuel_type': 'diesel',
'id': 'f4009654-c333-5c68-9d3a-c1b1b92c5cfa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS21206',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand Tourneo Connect',
'odometer': 251704,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-06',
'seller_name': None,
'title': 'Ford Grand Tourneo Connect 1.5 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2016}
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS21206%27 HTTP/1.1" 200 None
2026-03-29 18:43:49 [auto1.de] INFO: Saving data for YS21206: {'auction_closing_time': 1774883510.0, 'created_time': 1774292686.376603, 'last_price_update_time': 1774809829.903158}
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS21206') HTTP/1.1" 204 0
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79531%27 HTTP/1.1" 200 None
2026-03-29 18:43:49 [auto1.de] INFO: Scrape type for LD79531: 2
2026-03-29 18:43:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba9ed45b-4afa-5635-9edc-35391ded3f62 with identifier: LD79531
2026-03-29 18:43:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba9ed45b-4afa-5635-9edc-35391ded3f62 with scrape type 2
2026-03-29 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba9ed45b-4afa-5635-9edc-35391ded3f62 with scrape type 2
2026-03-29 18:43:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba9ed45b-4afa-5635-9edc-35391ded3f62, identifier: LD79531
2026-03-29 18:43:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba9ed45b-4afa-5635-9edc-35391ded3f62 with identifier: LD79531
2026-03-29 18:43:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba9ed45b-4afa-5635-9edc-35391ded3f62 with identifier: LD79531
2026-03-29 18:43:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba9ed45b-4afa-5635-9edc-35391ded3f62 with identifier: LD79531 to the API
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:31:50Z',
'fuel_type': 'diesel',
'id': 'ba9ed45b-4afa-5635-9edc-35391ded3f62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD79531',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 129735,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-12-03',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2006}
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79531%27 HTTP/1.1" 200 None
2026-03-29 18:43:50 [auto1.de] INFO: Saving data for LD79531: {'auction_closing_time': 1774884710.0, 'created_time': 1773340486.428731, 'last_price_update_time': 1774809830.409905}
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD79531') HTTP/1.1" 204 0
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67119%27 HTTP/1.1" 200 None
2026-03-29 18:43:50 [auto1.de] INFO: Scrape type for VY67119: 0
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX52309%27 HTTP/1.1" 200 None
2026-03-29 18:43:50 [auto1.de] INFO: Scrape type for UX52309: 0
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS74936%27 HTTP/1.1" 200 None
2026-03-29 18:43:50 [auto1.de] INFO: Scrape type for XS74936: 0
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63966%27 HTTP/1.1" 200 None
2026-03-29 18:43:50 [auto1.de] INFO: Scrape type for LD63966: 0
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT52067%27 HTTP/1.1" 200 None
2026-03-29 18:43:50 [auto1.de] INFO: Scrape type for PT52067: 2
2026-03-29 18:43:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 283b5831-7161-5609-a054-c35120bd52ec with identifier: PT52067
2026-03-29 18:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 283b5831-7161-5609-a054-c35120bd52ec with scrape type 2
2026-03-29 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 283b5831-7161-5609-a054-c35120bd52ec with scrape type 2
2026-03-29 18:43:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 283b5831-7161-5609-a054-c35120bd52ec, identifier: PT52067
2026-03-29 18:43:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 283b5831-7161-5609-a054-c35120bd52ec with identifier: PT52067
2026-03-29 18:43:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 283b5831-7161-5609-a054-c35120bd52ec with identifier: PT52067
2026-03-29 18:43:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 283b5831-7161-5609-a054-c35120bd52ec with identifier: PT52067 to the API
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:07:15Z',
'fuel_type': 'diesel',
'id': '283b5831-7161-5609-a054-c35120bd52ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT52067',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 246115,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-18',
'seller_name': None,
'title': 'BMW 4er 418d Gran Coupé M Sport',
'transmission': 'manual',
'trim': 'M Sport',
'year': 2018}
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT52067%27 HTTP/1.1" 200 None
2026-03-29 18:43:50 [auto1.de] INFO: Saving data for PT52067: {'auction_closing_time': 1774883235.0, 'created_time': 1774636338.802791, 'last_price_update_time': 1774809830.902563}
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT52067') HTTP/1.1" 204 0
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH24339%27 HTTP/1.1" 200 None
2026-03-29 18:43:51 [auto1.de] INFO: Scrape type for MH24339: 2
2026-03-29 18:43:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339
2026-03-29 18:43:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acea335d-749a-573e-9503-5e65dd24a15c with scrape type 2
2026-03-29 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acea335d-749a-573e-9503-5e65dd24a15c with scrape type 2
2026-03-29 18:43:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acea335d-749a-573e-9503-5e65dd24a15c, identifier: MH24339
2026-03-29 18:43:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339
2026-03-29 18:43:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339
2026-03-29 18:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339 to the API
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:53:50Z',
'fuel_type': 'diesel',
'id': 'acea335d-749a-573e-9503-5e65dd24a15c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH24339',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 300246,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-02',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH24339%27 HTTP/1.1" 200 None
2026-03-29 18:43:51 [auto1.de] INFO: Saving data for MH24339: {'auction_closing_time': 1774886030.0, 'created_time': 1773859421.609044, 'last_price_update_time': 1774809831.483829}
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH24339') HTTP/1.1" 204 0
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX71275%27 HTTP/1.1" 200 None
2026-03-29 18:43:51 [auto1.de] INFO: Scrape type for PX71275: 0
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV17454%27 HTTP/1.1" 200 None
2026-03-29 18:43:51 [auto1.de] INFO: Scrape type for TV17454: 2
2026-03-29 18:43:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b7f275c-e2d2-5b70-990e-661f91471912 with identifier: TV17454
2026-03-29 18:43:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b7f275c-e2d2-5b70-990e-661f91471912 with scrape type 2
2026-03-29 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b7f275c-e2d2-5b70-990e-661f91471912 with scrape type 2
2026-03-29 18:43:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b7f275c-e2d2-5b70-990e-661f91471912, identifier: TV17454
2026-03-29 18:43:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b7f275c-e2d2-5b70-990e-661f91471912 with identifier: TV17454
2026-03-29 18:43:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b7f275c-e2d2-5b70-990e-661f91471912 with identifier: TV17454
2026-03-29 18:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b7f275c-e2d2-5b70-990e-661f91471912 with identifier: TV17454 to the API
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:15:25Z',
'fuel_type': 'diesel',
'id': '2b7f275c-e2d2-5b70-990e-661f91471912',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV17454',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 151607,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-11',
'seller_name': None,
'title': 'BMW 3er 320d Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2018}
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV17454%27 HTTP/1.1" 200 None
2026-03-29 18:43:51 [auto1.de] INFO: Saving data for TV17454: {'auction_closing_time': 1774883725.0, 'created_time': 1773859615.92452, 'last_price_update_time': 1774809831.994392}
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV17454') HTTP/1.1" 204 0
2026-03-29 18:43:52 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC44311%27 HTTP/1.1" 200 None
2026-03-29 18:43:52 [auto1.de] INFO: Scrape type for EC44311: 0
2026-03-29 18:43:52 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-29 18:43:52 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-29 18:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:52 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:52 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-29 18:43:52 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-29 18:43:52 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-29 18:43:52 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-29 18:43:52 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-29 18:43:52 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19748%27 HTTP/1.1" 200 None
2026-03-29 18:43:52 [auto1.de] INFO: Scrape type for ED19748: 2
2026-03-29 18:43:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ebe3833-29fb-5033-941d-3bb64549385d with identifier: ED19748
2026-03-29 18:43:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ebe3833-29fb-5033-941d-3bb64549385d with scrape type 2
2026-03-29 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ebe3833-29fb-5033-941d-3bb64549385d with scrape type 2
2026-03-29 18:43:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ebe3833-29fb-5033-941d-3bb64549385d, identifier: ED19748
2026-03-29 18:43:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ebe3833-29fb-5033-941d-3bb64549385d with identifier: ED19748
2026-03-29 18:43:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ebe3833-29fb-5033-941d-3bb64549385d with identifier: ED19748
2026-03-29 18:43:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ebe3833-29fb-5033-941d-3bb64549385d with identifier: ED19748 to the API
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:54:18Z',
'fuel_type': 'diesel',
'id': '4ebe3833-29fb-5033-941d-3bb64549385d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED19748',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 308342,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-03',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueTDI',
'transmission': 'automatic',
'trim': 'Highline BlueTDI',
'year': 2011}
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19748%27 HTTP/1.1" 200 None
2026-03-29 18:43:52 [auto1.de] INFO: Saving data for ED19748: {'auction_closing_time': 1774886058.0, 'created_time': 1773772239.384143, 'last_price_update_time': 1774809832.682577}
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED19748') HTTP/1.1" 204 0
2026-03-29 18:43:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:52 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG11243%27 HTTP/1.1" 200 None
2026-03-29 18:43:52 [auto1.de] INFO: Scrape type for LG11243: 0
2026-03-29 18:43:52 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP44038%27 HTTP/1.1" 200 None
2026-03-29 18:43:52 [auto1.de] INFO: Scrape type for BP44038: 0
2026-03-29 18:43:52 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71101%27 HTTP/1.1" 200 None
2026-03-29 18:43:52 [auto1.de] INFO: Scrape type for GJ71101: 0
2026-03-29 18:43:52 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49272%27 HTTP/1.1" 200 None
2026-03-29 18:43:52 [auto1.de] INFO: Scrape type for AB49272: 2
2026-03-29 18:43:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50c864d2-f226-5120-a71e-75bfa3f07747 with identifier: AB49272
2026-03-29 18:43:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50c864d2-f226-5120-a71e-75bfa3f07747 with scrape type 2
2026-03-29 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50c864d2-f226-5120-a71e-75bfa3f07747 with scrape type 2
2026-03-29 18:43:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50c864d2-f226-5120-a71e-75bfa3f07747, identifier: AB49272
2026-03-29 18:43:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50c864d2-f226-5120-a71e-75bfa3f07747 with identifier: AB49272
2026-03-29 18:43:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50c864d2-f226-5120-a71e-75bfa3f07747 with identifier: AB49272
2026-03-29 18:43:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50c864d2-f226-5120-a71e-75bfa3f07747 with identifier: AB49272 to the API
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:36:13Z',
'fuel_type': 'diesel',
'id': '50c864d2-f226-5120-a71e-75bfa3f07747',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB49272',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 194424,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-11',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI First Edition',
'transmission': 'automatic',
'trim': 'First Edition',
'year': 2021}
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49272%27 HTTP/1.1" 200 None
2026-03-29 18:43:53 [auto1.de] INFO: Saving data for AB49272: {'auction_closing_time': 1774884973.0, 'created_time': 1773134489.569824, 'last_price_update_time': 1774809833.159138}
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB49272') HTTP/1.1" 204 0
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG37948%27 HTTP/1.1" 200 None
2026-03-29 18:43:53 [auto1.de] INFO: Scrape type for NG37948: 2
2026-03-29 18:43:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f9add73-e214-5282-9ef7-3caf8e81af99 with identifier: NG37948
2026-03-29 18:43:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f9add73-e214-5282-9ef7-3caf8e81af99 with scrape type 2
2026-03-29 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f9add73-e214-5282-9ef7-3caf8e81af99 with scrape type 2
2026-03-29 18:43:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f9add73-e214-5282-9ef7-3caf8e81af99, identifier: NG37948
2026-03-29 18:43:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f9add73-e214-5282-9ef7-3caf8e81af99 with identifier: NG37948
2026-03-29 18:43:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f9add73-e214-5282-9ef7-3caf8e81af99 with identifier: NG37948
2026-03-29 18:43:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f9add73-e214-5282-9ef7-3caf8e81af99 with identifier: NG37948 to the API
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:44:37Z',
'fuel_type': 'petrol',
'id': '5f9add73-e214-5282-9ef7-3caf8e81af99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG37948',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 33603,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-17',
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive passion',
'year': 2014}
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG37948%27 HTTP/1.1" 200 None
2026-03-29 18:43:53 [auto1.de] INFO: Saving data for NG37948: {'auction_closing_time': 1774885477.0, 'created_time': 1773686200.167837, 'last_price_update_time': 1774809833.709826}
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG37948') HTTP/1.1" 204 0
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP81367%27 HTTP/1.1" 200 None
2026-03-29 18:43:53 [auto1.de] INFO: Scrape type for WP81367: 2
2026-03-29 18:43:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0af088b-a073-53fb-9e7e-7eb5823956b9 with identifier: WP81367
2026-03-29 18:43:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0af088b-a073-53fb-9e7e-7eb5823956b9 with scrape type 2
2026-03-29 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0af088b-a073-53fb-9e7e-7eb5823956b9 with scrape type 2
2026-03-29 18:43:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0af088b-a073-53fb-9e7e-7eb5823956b9, identifier: WP81367
2026-03-29 18:43:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0af088b-a073-53fb-9e7e-7eb5823956b9 with identifier: WP81367
2026-03-29 18:43:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0af088b-a073-53fb-9e7e-7eb5823956b9 with identifier: WP81367
2026-03-29 18:43:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0af088b-a073-53fb-9e7e-7eb5823956b9 with identifier: WP81367 to the API
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:50:52Z',
'fuel_type': 'petrol',
'id': 'a0af088b-a073-53fb-9e7e-7eb5823956b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP81367',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 108086,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-28',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Classic',
'transmission': 'manual',
'trim': 'BlueEfficiency Classic',
'year': 2010}
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP81367%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Saving data for WP81367: {'auction_closing_time': 1774885852.0, 'created_time': 1773860260.499782, 'last_price_update_time': 1774809834.18796}
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP81367') HTTP/1.1" 204 0
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS33010%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Scrape type for GS33010: 2
2026-03-29 18:43:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68add022-1957-5f1e-b41c-9cc43047c1e6 with identifier: GS33010
2026-03-29 18:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68add022-1957-5f1e-b41c-9cc43047c1e6 with scrape type 2
2026-03-29 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68add022-1957-5f1e-b41c-9cc43047c1e6 with scrape type 2
2026-03-29 18:43:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68add022-1957-5f1e-b41c-9cc43047c1e6, identifier: GS33010
2026-03-29 18:43:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68add022-1957-5f1e-b41c-9cc43047c1e6 with identifier: GS33010
2026-03-29 18:43:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68add022-1957-5f1e-b41c-9cc43047c1e6 with identifier: GS33010
2026-03-29 18:43:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68add022-1957-5f1e-b41c-9cc43047c1e6 with identifier: GS33010 to the API
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:02:12Z',
'fuel_type': 'diesel',
'id': '68add022-1957-5f1e-b41c-9cc43047c1e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS33010',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 136487,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-28',
'seller_name': None,
'title': 'Renault Kadjar 1.5 dCi Energy Bose Edition',
'transmission': 'automatic',
'trim': 'Bose Edition',
'year': 2016}
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS33010%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Saving data for GS33010: {'auction_closing_time': 1774882932.0, 'created_time': 1773306688.360531, 'last_price_update_time': 1774809834.638763}
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS33010') HTTP/1.1" 204 0
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA95146%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Scrape type for UA95146: 0
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG27070%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Scrape type for GG27070: 0
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC84625%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Scrape type for RC84625: 0
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF40931%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Scrape type for VF40931: 0
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB99961%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Scrape type for PB99961: 2
2026-03-29 18:43:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5556c295-1c7e-5a61-8600-fb12ec46023d with identifier: PB99961
2026-03-29 18:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5556c295-1c7e-5a61-8600-fb12ec46023d with scrape type 2
2026-03-29 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5556c295-1c7e-5a61-8600-fb12ec46023d with scrape type 2
2026-03-29 18:43:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5556c295-1c7e-5a61-8600-fb12ec46023d, identifier: PB99961
2026-03-29 18:43:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5556c295-1c7e-5a61-8600-fb12ec46023d with identifier: PB99961
2026-03-29 18:43:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5556c295-1c7e-5a61-8600-fb12ec46023d with identifier: PB99961
2026-03-29 18:43:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5556c295-1c7e-5a61-8600-fb12ec46023d with identifier: PB99961 to the API
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 280,
'expiration_date': '2026-03-30T15:58:47Z',
'fuel_type': 'petrol',
'id': '5556c295-1c7e-5a61-8600-fb12ec46023d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB99961',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 30840,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-09',
'seller_name': None,
'title': 'Hyundai i30 2.0 T-GDI N Performance',
'transmission': 'automatic',
'trim': 'N Performance',
'year': 2022}
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB99961%27 HTTP/1.1" 200 None
2026-03-29 18:43:55 [auto1.de] INFO: Saving data for PB99961: {'auction_closing_time': 1774886327.0, 'created_time': 1773303705.857701, 'last_price_update_time': 1774809835.192638}
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB99961') HTTP/1.1" 204 0
2026-03-29 18:43:55 [auto1.de] INFO: Found listing with ID: HD35365
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD35365%27 HTTP/1.1" 200 None
2026-03-29 18:43:55 [auto1.de] INFO: Scrape type for HD35365: 2
2026-03-29 18:43:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db112f04-e76c-5ac9-99b9-8f698c1c398d with identifier: HD35365
2026-03-29 18:43:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db112f04-e76c-5ac9-99b9-8f698c1c398d with scrape type 2
2026-03-29 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db112f04-e76c-5ac9-99b9-8f698c1c398d with scrape type 2
2026-03-29 18:43:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db112f04-e76c-5ac9-99b9-8f698c1c398d, identifier: HD35365
2026-03-29 18:43:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db112f04-e76c-5ac9-99b9-8f698c1c398d with identifier: HD35365
2026-03-29 18:43:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db112f04-e76c-5ac9-99b9-8f698c1c398d with identifier: HD35365
2026-03-29 18:43:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db112f04-e76c-5ac9-99b9-8f698c1c398d with identifier: HD35365 to the API
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:11:58Z',
'fuel_type': 'diesel',
'id': 'db112f04-e76c-5ac9-99b9-8f698c1c398d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD35365',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 188997,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-17',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2015}
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD35365%27 HTTP/1.1" 200 None
2026-03-29 18:43:55 [auto1.de] INFO: Saving data for HD35365: {'auction_closing_time': 1774883518.0, 'created_time': 1773301154.013313, 'last_price_update_time': 1774809835.699934}
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD35365') HTTP/1.1" 204 0
2026-03-29 18:43:55 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS86742%27 HTTP/1.1" 200 None
2026-03-29 18:43:55 [auto1.de] INFO: Scrape type for VS86742: 2
2026-03-29 18:43:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82006470-a810-59fb-b933-94aeeee466a8 with identifier: VS86742
2026-03-29 18:43:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82006470-a810-59fb-b933-94aeeee466a8 with scrape type 2
2026-03-29 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82006470-a810-59fb-b933-94aeeee466a8 with scrape type 2
2026-03-29 18:43:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82006470-a810-59fb-b933-94aeeee466a8, identifier: VS86742
2026-03-29 18:43:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82006470-a810-59fb-b933-94aeeee466a8 with identifier: VS86742
2026-03-29 18:43:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82006470-a810-59fb-b933-94aeeee466a8 with identifier: VS86742
2026-03-29 18:43:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82006470-a810-59fb-b933-94aeeee466a8 with identifier: VS86742 to the API
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:38:58Z',
'fuel_type': 'petrol',
'id': '82006470-a810-59fb-b933-94aeeee466a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS86742',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 161028,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-31',
'seller_name': None,
'title': 'Opel Astra 1.6 Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2015}
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS86742%27 HTTP/1.1" 200 None
2026-03-29 18:43:56 [auto1.de] INFO: Saving data for VS86742: {'auction_closing_time': 1774885138.0, 'created_time': 1774294700.782556, 'last_price_update_time': 1774809836.181111}
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS86742') HTTP/1.1" 204 0
2026-03-29 18:43:56 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-29 18:43:56 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU13937%27 HTTP/1.1" 200 None
2026-03-29 18:43:56 [auto1.de] INFO: Scrape type for CU13937: 0
2026-03-29 18:43:56 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC05156%27 HTTP/1.1" 200 None
2026-03-29 18:43:56 [auto1.de] INFO: Scrape type for GC05156: 2
2026-03-29 18:43:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with identifier: GC05156
2026-03-29 18:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with scrape type 2
2026-03-29 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with scrape type 2
2026-03-29 18:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cdaedf7-0126-5c15-bf32-b3c3de23f139, identifier: GC05156
2026-03-29 18:43:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with identifier: GC05156
2026-03-29 18:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with identifier: GC05156
2026-03-29 18:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with identifier: GC05156 to the API
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:00:56Z',
'fuel_type': 'diesel',
'id': '5cdaedf7-0126-5c15-bf32-b3c3de23f139',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC05156',
'listing': 'auction',
'make': 'Jeep',
'model': 'Cherokee',
'odometer': 32485,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-30',
'seller_name': None,
'title': 'Jeep Cherokee 2.2 M-Jet Limited 4WD',
'transmission': 'automatic',
'trim': 'Limited 4WD',
'year': 2019}
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC05156%27 HTTP/1.1" 200 None
2026-03-29 18:43:56 [auto1.de] INFO: Saving data for GC05156: {'auction_closing_time': 1774882856.0, 'created_time': 1774607777.330793, 'last_price_update_time': 1774809836.689189}
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC05156') HTTP/1.1" 204 0
2026-03-29 18:43:56 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66521%27 HTTP/1.1" 200 None
2026-03-29 18:43:56 [auto1.de] INFO: Scrape type for HS66521: 2
2026-03-29 18:43:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 902f27fe-dceb-59f4-822e-05fabfe636e1 with identifier: HS66521
2026-03-29 18:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 902f27fe-dceb-59f4-822e-05fabfe636e1 with scrape type 2
2026-03-29 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 902f27fe-dceb-59f4-822e-05fabfe636e1 with scrape type 2
2026-03-29 18:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 902f27fe-dceb-59f4-822e-05fabfe636e1, identifier: HS66521
2026-03-29 18:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 902f27fe-dceb-59f4-822e-05fabfe636e1 with identifier: HS66521
2026-03-29 18:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 902f27fe-dceb-59f4-822e-05fabfe636e1 with identifier: HS66521
2026-03-29 18:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 902f27fe-dceb-59f4-822e-05fabfe636e1 with identifier: HS66521 to the API
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:05:15Z',
'fuel_type': 'petrol',
'id': '902f27fe-dceb-59f4-822e-05fabfe636e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS66521',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 52789,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-07-23',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 Tour',
'transmission': 'automatic',
'trim': 'Tour',
'year': 2007}
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66521%27 HTTP/1.1" 200 None
2026-03-29 18:43:57 [auto1.de] INFO: Saving data for HS66521: {'auction_closing_time': 1774883115.0, 'created_time': 1773688212.465495, 'last_price_update_time': 1774809837.154369}
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS66521') HTTP/1.1" 204 0
2026-03-29 18:43:57 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT67181%27 HTTP/1.1" 200 None
2026-03-29 18:43:57 [auto1.de] INFO: Scrape type for YT67181: 2
2026-03-29 18:43:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with identifier: YT67181
2026-03-29 18:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with scrape type 2
2026-03-29 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with scrape type 2
2026-03-29 18:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9, identifier: YT67181
2026-03-29 18:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with identifier: YT67181
2026-03-29 18:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with identifier: YT67181
2026-03-29 18:43:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with identifier: YT67181 to the API
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 98,
'expiration_date': '2026-03-30T15:57:33Z',
'fuel_type': 'petrol',
'id': 'fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT67181',
'listing': 'auction',
'make': 'Nissan',
'model': 'Note',
'odometer': 178672,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-24',
'seller_name': None,
'title': 'Nissan Note 1.2 Black Edition',
'transmission': 'automatic',
'trim': 'Black Edition',
'year': 2016}
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT67181%27 HTTP/1.1" 200 None
2026-03-29 18:43:57 [auto1.de] INFO: Saving data for YT67181: {'auction_closing_time': 1774886253.0, 'created_time': 1774293944.070075, 'last_price_update_time': 1774809837.665311}
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT67181') HTTP/1.1" 204 0
2026-03-29 18:43:57 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:57 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC36574%27 HTTP/1.1" 200 None
2026-03-29 18:43:57 [auto1.de] INFO: Scrape type for WC36574: 2
2026-03-29 18:43:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a59a4e2-eaee-5bde-997a-74185c967ddd with identifier: WC36574
2026-03-29 18:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a59a4e2-eaee-5bde-997a-74185c967ddd with scrape type 2
2026-03-29 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a59a4e2-eaee-5bde-997a-74185c967ddd with scrape type 2
2026-03-29 18:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a59a4e2-eaee-5bde-997a-74185c967ddd, identifier: WC36574
2026-03-29 18:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a59a4e2-eaee-5bde-997a-74185c967ddd with identifier: WC36574
2026-03-29 18:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a59a4e2-eaee-5bde-997a-74185c967ddd with identifier: WC36574
2026-03-29 18:43:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a59a4e2-eaee-5bde-997a-74185c967ddd with identifier: WC36574 to the API
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:40:25Z',
'fuel_type': 'diesel',
'id': '3a59a4e2-eaee-5bde-997a-74185c967ddd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC36574',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 148460,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-18',
'seller_name': None,
'title': 'Audi A6 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2017}
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC36574%27 HTTP/1.1" 200 None
2026-03-29 18:43:58 [auto1.de] INFO: Saving data for WC36574: {'auction_closing_time': 1774885225.0, 'created_time': 1773225333.642473, 'last_price_update_time': 1774809838.165572}
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC36574') HTTP/1.1" 204 0
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR33990%27 HTTP/1.1" 200 None
2026-03-29 18:43:58 [auto1.de] INFO: Scrape type for SR33990: 2
2026-03-29 18:43:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a695526-cbfd-5f8e-8175-16e15330fbfc with identifier: SR33990
2026-03-29 18:43:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a695526-cbfd-5f8e-8175-16e15330fbfc with scrape type 2
2026-03-29 18:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a695526-cbfd-5f8e-8175-16e15330fbfc with scrape type 2
2026-03-29 18:43:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a695526-cbfd-5f8e-8175-16e15330fbfc, identifier: SR33990
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL30880%27 HTTP/1.1" 200 None
2026-03-29 18:43:58 [auto1.de] INFO: Scrape type for GL30880: 0
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU26229%27 HTTP/1.1" 200 None
2026-03-29 18:43:58 [auto1.de] INFO: Scrape type for PU26229: 2
2026-03-29 18:43:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7b8a3b0-afa1-5551-9113-b3158158a271 with identifier: PU26229
2026-03-29 18:43:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7b8a3b0-afa1-5551-9113-b3158158a271 with scrape type 2
2026-03-29 18:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7b8a3b0-afa1-5551-9113-b3158158a271 with scrape type 2
2026-03-29 18:43:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7b8a3b0-afa1-5551-9113-b3158158a271, identifier: PU26229
2026-03-29 18:43:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a695526-cbfd-5f8e-8175-16e15330fbfc with identifier: SR33990
2026-03-29 18:43:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a695526-cbfd-5f8e-8175-16e15330fbfc with identifier: SR33990
2026-03-29 18:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a695526-cbfd-5f8e-8175-16e15330fbfc with identifier: SR33990 to the API
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:54:47Z',
'fuel_type': 'diesel',
'id': '2a695526-cbfd-5f8e-8175-16e15330fbfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR33990',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 168607,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-07',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2010}
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR33990%27 HTTP/1.1" 200 None
2026-03-29 18:43:58 [auto1.de] INFO: Saving data for SR33990: {'auction_closing_time': 1774886087.0, 'created_time': 1774521161.311577, 'last_price_update_time': 1774809838.681592}
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR33990') HTTP/1.1" 204 0
2026-03-29 18:43:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7b8a3b0-afa1-5551-9113-b3158158a271 with identifier: PU26229
2026-03-29 18:43:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7b8a3b0-afa1-5551-9113-b3158158a271 with identifier: PU26229
2026-03-29 18:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7b8a3b0-afa1-5551-9113-b3158158a271 with identifier: PU26229 to the API
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 367,
'expiration_date': '2026-03-30T15:15:33Z',
'fuel_type': 'petrol',
'id': 'f7b8a3b0-afa1-5551-9113-b3158158a271',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU26229',
'listing': 'auction',
'make': 'Audi',
'model': 'RS Q3',
'odometer': 156661,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-27',
'seller_name': None,
'title': 'Audi RS Q3 2.5 TFSI quattro Performance',
'transmission': 'automatic',
'trim': 'quattro Performance',
'year': 2016}
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU26229%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Saving data for PU26229: {'auction_closing_time': 1774883733.0, 'created_time': 1774292341.265369, 'last_price_update_time': 1774809839.151625}
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU26229') HTTP/1.1" 204 0
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF13899%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Scrape type for NF13899: 0
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM00936%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Scrape type for GM00936: 0
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA09266%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Scrape type for MA09266: 0
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW93776%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Scrape type for RW93776: 0
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD88360%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Scrape type for SD88360: 0
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: SS79198
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK21596%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Scrape type for EK21596: 2
2026-03-29 18:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596
2026-03-29 18:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with scrape type 2
2026-03-29 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with scrape type 2
2026-03-29 18:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19, identifier: EK21596
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF63164%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Scrape type for ZF63164: 0
2026-03-29 18:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596
2026-03-29 18:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596
2026-03-29 18:43:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596 to the API
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:30:02Z',
'fuel_type': 'petrol',
'id': '6b02dc6b-cad8-5579-8b4c-ba44ecac7f19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK21596',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-30',
'odometer': 6650,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-29',
'seller_name': None,
'title': 'Mazda CX-30 2.0 SKYACTIV-G Mild-Hybrid Homura 2WD',
'transmission': 'manual',
'trim': 'Homura 2WD',
'year': 2022}
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK21596%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Saving data for EK21596: {'auction_closing_time': 1774884602.0, 'created_time': 1774607857.509515, 'last_price_update_time': 1774809839.70222}
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK21596') HTTP/1.1" 204 0
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL42173%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Scrape type for TL42173: 2
2026-03-29 18:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cebd0460-5f0e-5091-be95-be83e214fcca with identifier: TL42173
2026-03-29 18:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cebd0460-5f0e-5091-be95-be83e214fcca with scrape type 2
2026-03-29 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cebd0460-5f0e-5091-be95-be83e214fcca with scrape type 2
2026-03-29 18:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cebd0460-5f0e-5091-be95-be83e214fcca, identifier: TL42173
2026-03-29 18:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cebd0460-5f0e-5091-be95-be83e214fcca with identifier: TL42173
2026-03-29 18:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cebd0460-5f0e-5091-be95-be83e214fcca with identifier: TL42173
2026-03-29 18:44:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cebd0460-5f0e-5091-be95-be83e214fcca with identifier: TL42173 to the API
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:12:43Z',
'fuel_type': 'petrol',
'id': 'cebd0460-5f0e-5091-be95-be83e214fcca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL42173',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 109274,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-24',
'seller_name': None,
'title': 'Hyundai i10 1.1 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2012}
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL42173%27 HTTP/1.1" 200 None
2026-03-29 18:44:00 [auto1.de] INFO: Saving data for TL42173: {'auction_closing_time': 1774883563.0, 'created_time': 1774071034.545013, 'last_price_update_time': 1774809840.340426}
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL42173') HTTP/1.1" 204 0
2026-03-29 18:44:00 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36203%27 HTTP/1.1" 200 None
2026-03-29 18:44:00 [auto1.de] INFO: Scrape type for EC36203: 2
2026-03-29 18:44:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 631a612a-b7d8-5e0d-ae7c-af169ef29462 with identifier: EC36203
2026-03-29 18:44:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 631a612a-b7d8-5e0d-ae7c-af169ef29462 with scrape type 2
2026-03-29 18:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 631a612a-b7d8-5e0d-ae7c-af169ef29462 with scrape type 2
2026-03-29 18:44:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 631a612a-b7d8-5e0d-ae7c-af169ef29462, identifier: EC36203
2026-03-29 18:44:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 631a612a-b7d8-5e0d-ae7c-af169ef29462 with identifier: EC36203
2026-03-29 18:44:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 631a612a-b7d8-5e0d-ae7c-af169ef29462 with identifier: EC36203
2026-03-29 18:44:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 631a612a-b7d8-5e0d-ae7c-af169ef29462 with identifier: EC36203 to the API
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:38:59Z',
'fuel_type': 'diesel',
'id': '631a612a-b7d8-5e0d-ae7c-af169ef29462',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC36203',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Kombi',
'odometer': 139364,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-11',
'seller_name': None,
'title': 'Volkswagen T5 Kombi 2.0 TDI 4Motion',
'transmission': 'manual',
'trim': '4Motion',
'year': 2014}
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36203%27 HTTP/1.1" 200 None
2026-03-29 18:44:00 [auto1.de] INFO: Saving data for EC36203: {'auction_closing_time': 1774885139.0, 'created_time': 1773429006.578121, 'last_price_update_time': 1774809840.820903}
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC36203') HTTP/1.1" 204 0
2026-03-29 18:44:00 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-29 18:44:00 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-29 18:44:00 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU13127%27 HTTP/1.1" 200 None
2026-03-29 18:44:00 [auto1.de] INFO: Scrape type for PU13127: 0
2026-03-29 18:44:00 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31179%27 HTTP/1.1" 200 None
2026-03-29 18:44:00 [auto1.de] INFO: Scrape type for XX31179: 0
2026-03-29 18:44:00 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF28851%27 HTTP/1.1" 200 None
2026-03-29 18:44:00 [auto1.de] INFO: Scrape type for DF28851: 2
2026-03-29 18:44:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7f405cc-8529-53ae-98e0-56716de9a35d with identifier: DF28851
2026-03-29 18:44:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7f405cc-8529-53ae-98e0-56716de9a35d with scrape type 2
2026-03-29 18:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7f405cc-8529-53ae-98e0-56716de9a35d with scrape type 2
2026-03-29 18:44:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7f405cc-8529-53ae-98e0-56716de9a35d, identifier: DF28851
2026-03-29 18:44:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7f405cc-8529-53ae-98e0-56716de9a35d with identifier: DF28851
2026-03-29 18:44:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7f405cc-8529-53ae-98e0-56716de9a35d with identifier: DF28851
2026-03-29 18:44:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7f405cc-8529-53ae-98e0-56716de9a35d with identifier: DF28851 to the API
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:14:21Z',
'fuel_type': 'petrol',
'id': 'a7f405cc-8529-53ae-98e0-56716de9a35d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF28851',
'listing': 'auction',
'make': 'Kia',
'model': "pro_cee'd",
'odometer': 62667,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-29',
'seller_name': None,
'title': "Kia pro_cee'd 1.6 TGDI GT",
'transmission': 'automatic',
'trim': 'GT',
'year': 2020}
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF28851%27 HTTP/1.1" 200 None
2026-03-29 18:44:01 [auto1.de] INFO: Saving data for DF28851: {'auction_closing_time': 1774883661.0, 'created_time': 1773226845.565927, 'last_price_update_time': 1774809841.339419}
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF28851') HTTP/1.1" 204 0
2026-03-29 18:44:01 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-29 18:44:01 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83378%27 HTTP/1.1" 200 None
2026-03-29 18:44:01 [auto1.de] INFO: Scrape type for UC83378: 0
2026-03-29 18:44:01 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-29 18:44:01 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-29 18:44:01 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-29 18:44:01 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW22662%27 HTTP/1.1" 200 None
2026-03-29 18:44:01 [auto1.de] INFO: Scrape type for MW22662: 2
2026-03-29 18:44:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc6cb348-dd04-59cc-8e81-195f4ed65c45 with identifier: MW22662
2026-03-29 18:44:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc6cb348-dd04-59cc-8e81-195f4ed65c45 with scrape type 2
2026-03-29 18:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc6cb348-dd04-59cc-8e81-195f4ed65c45 with scrape type 2
2026-03-29 18:44:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc6cb348-dd04-59cc-8e81-195f4ed65c45, identifier: MW22662
2026-03-29 18:44:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc6cb348-dd04-59cc-8e81-195f4ed65c45 with identifier: MW22662
2026-03-29 18:44:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc6cb348-dd04-59cc-8e81-195f4ed65c45 with identifier: MW22662
2026-03-29 18:44:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc6cb348-dd04-59cc-8e81-195f4ed65c45 with identifier: MW22662 to the API
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:34:51Z',
'fuel_type': 'diesel',
'id': 'dc6cb348-dd04-59cc-8e81-195f4ed65c45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW22662',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 161813,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-18',
'seller_name': None,
'title': 'Ford Transit 1.6 TDCi Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2015}
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW22662%27 HTTP/1.1" 200 None
2026-03-29 18:44:01 [auto1.de] INFO: Saving data for MW22662: {'auction_closing_time': 1774884891.0, 'created_time': 1774607673.95788, 'last_price_update_time': 1774809841.836849}
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW22662') HTTP/1.1" 204 0
2026-03-29 18:44:01 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU75285%27 HTTP/1.1" 200 None
2026-03-29 18:44:01 [auto1.de] INFO: Scrape type for LU75285: 2
2026-03-29 18:44:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2ab30ba-586e-50e6-a31c-16bf841dba46 with identifier: LU75285
2026-03-29 18:44:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2ab30ba-586e-50e6-a31c-16bf841dba46 with scrape type 2
2026-03-29 18:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2ab30ba-586e-50e6-a31c-16bf841dba46 with scrape type 2
2026-03-29 18:44:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2ab30ba-586e-50e6-a31c-16bf841dba46, identifier: LU75285
2026-03-29 18:44:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2ab30ba-586e-50e6-a31c-16bf841dba46 with identifier: LU75285
2026-03-29 18:44:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2ab30ba-586e-50e6-a31c-16bf841dba46 with identifier: LU75285
2026-03-29 18:44:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2ab30ba-586e-50e6-a31c-16bf841dba46 with identifier: LU75285 to the API
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:59:31Z',
'fuel_type': 'petrol',
'id': 'f2ab30ba-586e-50e6-a31c-16bf841dba46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU75285',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Space Star',
'odometer': 84656,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-27',
'seller_name': None,
'title': 'Mitsubishi Space Star 1.0 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2017}
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU75285%27 HTTP/1.1" 200 None
2026-03-29 18:44:02 [auto1.de] INFO: Saving data for LU75285: {'auction_closing_time': 1774886371.0, 'created_time': 1773513939.245053, 'last_price_update_time': 1774809842.375598}
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU75285') HTTP/1.1" 204 0
2026-03-29 18:44:02 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-29 18:44:02 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF68220%27 HTTP/1.1" 200 None
2026-03-29 18:44:02 [auto1.de] INFO: Scrape type for CF68220: 0
2026-03-29 18:44:02 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74026%27 HTTP/1.1" 200 None
2026-03-29 18:44:02 [auto1.de] INFO: Scrape type for ZA74026: 2
2026-03-29 18:44:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcfef345-1b32-5cb8-9ff0-611c2dcef261 with identifier: ZA74026
2026-03-29 18:44:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcfef345-1b32-5cb8-9ff0-611c2dcef261 with scrape type 2
2026-03-29 18:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcfef345-1b32-5cb8-9ff0-611c2dcef261 with scrape type 2
2026-03-29 18:44:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcfef345-1b32-5cb8-9ff0-611c2dcef261, identifier: ZA74026
2026-03-29 18:44:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcfef345-1b32-5cb8-9ff0-611c2dcef261 with identifier: ZA74026
2026-03-29 18:44:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcfef345-1b32-5cb8-9ff0-611c2dcef261 with identifier: ZA74026
2026-03-29 18:44:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcfef345-1b32-5cb8-9ff0-611c2dcef261 with identifier: ZA74026 to the API
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:46:31Z',
'fuel_type': 'petrol',
'id': 'dcfef345-1b32-5cb8-9ff0-611c2dcef261',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA74026',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 101539,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-07',
'seller_name': None,
'title': 'Volkswagen Polo 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2018}
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74026%27 HTTP/1.1" 200 None
2026-03-29 18:44:02 [auto1.de] INFO: Saving data for ZA74026: {'auction_closing_time': 1774885591.0, 'created_time': 1774521541.200776, 'last_price_update_time': 1774809842.817712}
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA74026') HTTP/1.1" 204 0
2026-03-29 18:44:02 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-29 18:44:02 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-29 18:44:02 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30737%27 HTTP/1.1" 200 None
2026-03-29 18:44:02 [auto1.de] INFO: Scrape type for GC30737: 2
2026-03-29 18:44:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 434cafca-5dd2-5817-b3f8-0170e0166b93 with identifier: GC30737
2026-03-29 18:44:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 434cafca-5dd2-5817-b3f8-0170e0166b93 with scrape type 2
2026-03-29 18:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 434cafca-5dd2-5817-b3f8-0170e0166b93 with scrape type 2
2026-03-29 18:44:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 434cafca-5dd2-5817-b3f8-0170e0166b93, identifier: GC30737
2026-03-29 18:44:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 434cafca-5dd2-5817-b3f8-0170e0166b93 with identifier: GC30737
2026-03-29 18:44:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 434cafca-5dd2-5817-b3f8-0170e0166b93 with identifier: GC30737
2026-03-29 18:44:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 434cafca-5dd2-5817-b3f8-0170e0166b93 with identifier: GC30737 to the API
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:08:34Z',
'fuel_type': 'petrol',
'id': '434cafca-5dd2-5817-b3f8-0170e0166b93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC30737',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 156789,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-25',
'seller_name': None,
'title': 'BMW 3er 320i GT',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30737%27 HTTP/1.1" 200 None
2026-03-29 18:44:03 [auto1.de] INFO: Saving data for GC30737: {'auction_closing_time': 1774883314.0, 'created_time': 1774118777.473261, 'last_price_update_time': 1774809843.228097}
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC30737') HTTP/1.1" 204 0
2026-03-29 18:44:03 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP00408%27 HTTP/1.1" 200 None
2026-03-29 18:44:03 [auto1.de] INFO: Scrape type for SP00408: 2
2026-03-29 18:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eb6064f-a88c-5a7d-94e9-64bdda550d85 with identifier: SP00408
2026-03-29 18:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eb6064f-a88c-5a7d-94e9-64bdda550d85 with scrape type 2
2026-03-29 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7eb6064f-a88c-5a7d-94e9-64bdda550d85 with scrape type 2
2026-03-29 18:44:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7eb6064f-a88c-5a7d-94e9-64bdda550d85, identifier: SP00408
2026-03-29 18:44:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7eb6064f-a88c-5a7d-94e9-64bdda550d85 with identifier: SP00408
2026-03-29 18:44:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7eb6064f-a88c-5a7d-94e9-64bdda550d85 with identifier: SP00408
2026-03-29 18:44:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7eb6064f-a88c-5a7d-94e9-64bdda550d85 with identifier: SP00408 to the API
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:24:31Z',
'fuel_type': 'petrol',
'id': '7eb6064f-a88c-5a7d-94e9-64bdda550d85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP00408',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 79868,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-21',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP00408%27 HTTP/1.1" 200 None
2026-03-29 18:44:03 [auto1.de] INFO: Saving data for SP00408: {'auction_closing_time': 1774884271.0, 'created_time': 1774118724.223235, 'last_price_update_time': 1774809843.647874}
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP00408') HTTP/1.1" 204 0
2026-03-29 18:44:03 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-29 18:44:03 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC58383%27 HTTP/1.1" 200 None
2026-03-29 18:44:03 [auto1.de] INFO: Scrape type for EC58383: 0
2026-03-29 18:44:03 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-29 18:44:03 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB76211%27 HTTP/1.1" 200 None
2026-03-29 18:44:03 [auto1.de] INFO: Scrape type for GB76211: 2
2026-03-29 18:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8477624-4cce-54d0-8fe2-58bf0385166e with identifier: GB76211
2026-03-29 18:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8477624-4cce-54d0-8fe2-58bf0385166e with scrape type 2
2026-03-29 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8477624-4cce-54d0-8fe2-58bf0385166e with scrape type 2
2026-03-29 18:44:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8477624-4cce-54d0-8fe2-58bf0385166e, identifier: GB76211
2026-03-29 18:44:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8477624-4cce-54d0-8fe2-58bf0385166e with identifier: GB76211
2026-03-29 18:44:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8477624-4cce-54d0-8fe2-58bf0385166e with identifier: GB76211
2026-03-29 18:44:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8477624-4cce-54d0-8fe2-58bf0385166e with identifier: GB76211 to the API
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:19:07Z',
'fuel_type': 'diesel',
'id': 'f8477624-4cce-54d0-8fe2-58bf0385166e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB76211',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLK-Klasse',
'odometer': 74638,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-19',
'seller_name': None,
'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
'transmission': 'automatic',
'trim': '4Matic BlueEfficiency',
'year': 2013}
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB76211%27 HTTP/1.1" 200 None
2026-03-29 18:44:04 [auto1.de] INFO: Saving data for GB76211: {'auction_closing_time': 1774883947.0, 'created_time': 1774636603.288018, 'last_price_update_time': 1774809844.089225}
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB76211') HTTP/1.1" 204 0
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-29 18:44:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:04 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77146%27 HTTP/1.1" 200 None
2026-03-29 18:44:04 [auto1.de] INFO: Scrape type for HL77146: 2
2026-03-29 18:44:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18591d8e-6685-5dda-a802-8e18af14aef7 with identifier: HL77146
2026-03-29 18:44:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18591d8e-6685-5dda-a802-8e18af14aef7 with scrape type 2
2026-03-29 18:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18591d8e-6685-5dda-a802-8e18af14aef7 with scrape type 2
2026-03-29 18:44:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18591d8e-6685-5dda-a802-8e18af14aef7, identifier: HL77146
2026-03-29 18:44:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18591d8e-6685-5dda-a802-8e18af14aef7 with identifier: HL77146
2026-03-29 18:44:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18591d8e-6685-5dda-a802-8e18af14aef7 with identifier: HL77146
2026-03-29 18:44:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18591d8e-6685-5dda-a802-8e18af14aef7 with identifier: HL77146 to the API
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:12:47Z',
'fuel_type': 'petrol',
'id': '18591d8e-6685-5dda-a802-8e18af14aef7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL77146',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 186261,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-27',
'seller_name': None,
'title': 'BMW X1 xDrive 20i xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2016}
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77146%27 HTTP/1.1" 200 None
2026-03-29 18:44:04 [auto1.de] INFO: Saving data for HL77146: {'auction_closing_time': 1774883567.0, 'created_time': 1773399963.704201, 'last_price_update_time': 1774809844.764965}
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL77146') HTTP/1.1" 204 0
2026-03-29 18:44:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR58128%27 HTTP/1.1" 200 None
2026-03-29 18:44:04 [auto1.de] INFO: Scrape type for XR58128: 2
2026-03-29 18:44:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2fd21e0-790d-5d3a-a691-437ce04a69c8 with identifier: XR58128
2026-03-29 18:44:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2fd21e0-790d-5d3a-a691-437ce04a69c8 with scrape type 2
2026-03-29 18:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2fd21e0-790d-5d3a-a691-437ce04a69c8 with scrape type 2
2026-03-29 18:44:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2fd21e0-790d-5d3a-a691-437ce04a69c8, identifier: XR58128
2026-03-29 18:44:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2fd21e0-790d-5d3a-a691-437ce04a69c8 with identifier: XR58128
2026-03-29 18:44:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2fd21e0-790d-5d3a-a691-437ce04a69c8 with identifier: XR58128
2026-03-29 18:44:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2fd21e0-790d-5d3a-a691-437ce04a69c8 with identifier: XR58128 to the API
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:18:35Z',
'fuel_type': 'diesel',
'id': 'a2fd21e0-790d-5d3a-a691-437ce04a69c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR58128',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 160999,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-18',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Multivan Generation Six 4Motion',
'transmission': 'automatic',
'trim': 'Multivan Generation Six 4Motion',
'year': 2016}
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR58128%27 HTTP/1.1" 200 None
2026-03-29 18:44:05 [auto1.de] INFO: Saving data for XR58128: {'auction_closing_time': 1774883915.0, 'created_time': 1774263264.809831, 'last_price_update_time': 1774809845.251706}
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR58128') HTTP/1.1" 204 0
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM06695%27 HTTP/1.1" 200 None
2026-03-29 18:44:05 [auto1.de] INFO: Scrape type for TM06695: 0
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST45837%27 HTTP/1.1" 200 None
2026-03-29 18:44:05 [auto1.de] INFO: Scrape type for ST45837: 0
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU26227%27 HTTP/1.1" 200 None
2026-03-29 18:44:05 [auto1.de] INFO: Scrape type for JU26227: 2
2026-03-29 18:44:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbf5d9d-21db-5905-8cef-1fb6348cf837 with identifier: JU26227
2026-03-29 18:44:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbf5d9d-21db-5905-8cef-1fb6348cf837 with scrape type 2
2026-03-29 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdbf5d9d-21db-5905-8cef-1fb6348cf837 with scrape type 2
2026-03-29 18:44:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdbf5d9d-21db-5905-8cef-1fb6348cf837, identifier: JU26227
2026-03-29 18:44:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdbf5d9d-21db-5905-8cef-1fb6348cf837 with identifier: JU26227
2026-03-29 18:44:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdbf5d9d-21db-5905-8cef-1fb6348cf837 with identifier: JU26227
2026-03-29 18:44:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdbf5d9d-21db-5905-8cef-1fb6348cf837 with identifier: JU26227 to the API
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:04:46Z',
'fuel_type': 'diesel',
'id': 'cdbf5d9d-21db-5905-8cef-1fb6348cf837',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU26227',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Viano',
'odometer': 361466,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-22',
'seller_name': None,
'title': 'Mercedes-Benz Viano 2.1 CDI lang Trend Edition',
'transmission': 'automatic',
'trim': 'lang Trend Edition',
'year': 2013}
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU26227%27 HTTP/1.1" 200 None
2026-03-29 18:44:05 [auto1.de] INFO: Saving data for JU26227: {'auction_closing_time': 1774883086.0, 'created_time': 1774089050.747313, 'last_price_update_time': 1774809845.696691}
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU26227') HTTP/1.1" 204 0
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA68492%27 HTTP/1.1" 200 None
2026-03-29 18:44:05 [auto1.de] INFO: Scrape type for YA68492: 2
2026-03-29 18:44:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85bbabfd-dd83-5302-a9a9-740c6d226387 with identifier: YA68492
2026-03-29 18:44:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85bbabfd-dd83-5302-a9a9-740c6d226387 with scrape type 2
2026-03-29 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85bbabfd-dd83-5302-a9a9-740c6d226387 with scrape type 2
2026-03-29 18:44:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85bbabfd-dd83-5302-a9a9-740c6d226387, identifier: YA68492
2026-03-29 18:44:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85bbabfd-dd83-5302-a9a9-740c6d226387 with identifier: YA68492
2026-03-29 18:44:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85bbabfd-dd83-5302-a9a9-740c6d226387 with identifier: YA68492
2026-03-29 18:44:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85bbabfd-dd83-5302-a9a9-740c6d226387 with identifier: YA68492 to the API
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:50:13Z',
'fuel_type': 'petrol',
'id': '85bbabfd-dd83-5302-a9a9-740c6d226387',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA68492',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Jetta',
'odometer': 50564,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-12',
'seller_name': None,
'title': 'Volkswagen Jetta 1.4 TSI Highline',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2014}
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA68492%27 HTTP/1.1" 200 None
2026-03-29 18:44:06 [auto1.de] INFO: Saving data for YA68492: {'auction_closing_time': 1774885813.0, 'created_time': 1773345120.763248, 'last_price_update_time': 1774809846.283264}
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA68492') HTTP/1.1" 204 0
2026-03-29 18:44:06 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU44330%27 HTTP/1.1" 200 None
2026-03-29 18:44:06 [auto1.de] INFO: Scrape type for MU44330: 2
2026-03-29 18:44:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bd6aa9b-9088-5e3d-af89-c37292938060 with identifier: MU44330
2026-03-29 18:44:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bd6aa9b-9088-5e3d-af89-c37292938060 with scrape type 2
2026-03-29 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bd6aa9b-9088-5e3d-af89-c37292938060 with scrape type 2
2026-03-29 18:44:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bd6aa9b-9088-5e3d-af89-c37292938060, identifier: MU44330
2026-03-29 18:44:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bd6aa9b-9088-5e3d-af89-c37292938060 with identifier: MU44330
2026-03-29 18:44:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bd6aa9b-9088-5e3d-af89-c37292938060 with identifier: MU44330
2026-03-29 18:44:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bd6aa9b-9088-5e3d-af89-c37292938060 with identifier: MU44330 to the API
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:39:43Z',
'fuel_type': 'petrol',
'id': '5bd6aa9b-9088-5e3d-af89-c37292938060',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU44330',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 64819,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-27',
'seller_name': None,
'title': 'Opel Astra 1.2 Turbo Elegance Start/Stop',
'transmission': 'manual',
'trim': 'Elegance Start/Stop',
'year': 2020}
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU44330%27 HTTP/1.1" 200 None
2026-03-29 18:44:06 [auto1.de] INFO: Saving data for MU44330: {'auction_closing_time': 1774885183.0, 'created_time': 1773860936.7361, 'last_price_update_time': 1774809846.769435}
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU44330') HTTP/1.1" 204 0
2026-03-29 18:44:06 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67460%27 HTTP/1.1" 200 None
2026-03-29 18:44:06 [auto1.de] INFO: Scrape type for GV67460: 2
2026-03-29 18:44:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbecd5be-17dc-53d0-8010-e3df9787376c with identifier: GV67460
2026-03-29 18:44:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbecd5be-17dc-53d0-8010-e3df9787376c with scrape type 2
2026-03-29 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbecd5be-17dc-53d0-8010-e3df9787376c with scrape type 2
2026-03-29 18:44:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbecd5be-17dc-53d0-8010-e3df9787376c, identifier: GV67460
2026-03-29 18:44:06 [scrapy.extensions.logstats] INFO: Crawled 151 pages (at 11 pages/min), scraped 1260 items (at 116 items/min)
2026-03-29 18:44:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:44:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbecd5be-17dc-53d0-8010-e3df9787376c with identifier: GV67460
2026-03-29 18:44:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbecd5be-17dc-53d0-8010-e3df9787376c with identifier: GV67460
2026-03-29 18:44:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbecd5be-17dc-53d0-8010-e3df9787376c with identifier: GV67460 to the API
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:44:34Z',
'fuel_type': 'diesel',
'id': 'bbecd5be-17dc-53d0-8010-e3df9787376c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV67460',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 189845,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-05-31',
'seller_name': None,
'title': 'Volkswagen Touran 1.9 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2003}
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67460%27 HTTP/1.1" 200 None
2026-03-29 18:44:07 [auto1.de] INFO: Saving data for GV67460: {'auction_closing_time': 1774885474.0, 'created_time': 1774089166.279476, 'last_price_update_time': 1774809847.195824}
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV67460') HTTP/1.1" 204 0
2026-03-29 18:44:07 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ17394%27 HTTP/1.1" 200 None
2026-03-29 18:44:07 [auto1.de] INFO: Scrape type for NZ17394: 0
2026-03-29 18:44:07 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-29 18:44:07 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-29 18:44:07 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH92253%27 HTTP/1.1" 200 None
2026-03-29 18:44:07 [auto1.de] INFO: Scrape type for GH92253: 0
2026-03-29 18:44:07 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT94173%27 HTTP/1.1" 200 None
2026-03-29 18:44:07 [auto1.de] INFO: Scrape type for VT94173: 0
2026-03-29 18:44:07 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY90175%27 HTTP/1.1" 200 None
2026-03-29 18:44:07 [auto1.de] INFO: Scrape type for MY90175: 2
2026-03-29 18:44:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd55e608-d211-5e90-8cd1-18189c1791c0 with identifier: MY90175
2026-03-29 18:44:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd55e608-d211-5e90-8cd1-18189c1791c0 with scrape type 2
2026-03-29 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd55e608-d211-5e90-8cd1-18189c1791c0 with scrape type 2
2026-03-29 18:44:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd55e608-d211-5e90-8cd1-18189c1791c0, identifier: MY90175
2026-03-29 18:44:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd55e608-d211-5e90-8cd1-18189c1791c0 with identifier: MY90175
2026-03-29 18:44:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd55e608-d211-5e90-8cd1-18189c1791c0 with identifier: MY90175
2026-03-29 18:44:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd55e608-d211-5e90-8cd1-18189c1791c0 with identifier: MY90175 to the API
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:19:29Z',
'fuel_type': 'petrol',
'id': 'fd55e608-d211-5e90-8cd1-18189c1791c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY90175',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 41278,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-29',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY90175%27 HTTP/1.1" 200 None
2026-03-29 18:44:07 [auto1.de] INFO: Saving data for MY90175: {'auction_closing_time': 1774883969.0, 'created_time': 1774521878.501841, 'last_price_update_time': 1774809847.75517}
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY90175') HTTP/1.1" 204 0
2026-03-29 18:44:07 [auto1.de] INFO: Found listing with ID: NH48980
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH48980%27 HTTP/1.1" 200 None
2026-03-29 18:44:07 [auto1.de] INFO: Scrape type for NH48980: 2
2026-03-29 18:44:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26ca1067-05ff-5237-9e43-12b34b062583 with identifier: NH48980
2026-03-29 18:44:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26ca1067-05ff-5237-9e43-12b34b062583 with scrape type 2
2026-03-29 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26ca1067-05ff-5237-9e43-12b34b062583 with scrape type 2
2026-03-29 18:44:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26ca1067-05ff-5237-9e43-12b34b062583, identifier: NH48980
2026-03-29 18:44:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26ca1067-05ff-5237-9e43-12b34b062583 with identifier: NH48980
2026-03-29 18:44:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26ca1067-05ff-5237-9e43-12b34b062583 with identifier: NH48980
2026-03-29 18:44:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26ca1067-05ff-5237-9e43-12b34b062583 with identifier: NH48980 to the API
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 305,
'expiration_date': '2026-03-30T15:53:22Z',
'fuel_type': 'petrol',
'id': '26ca1067-05ff-5237-9e43-12b34b062583',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH48980',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 155872,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-18',
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 350 CGI L 4Matic BlueEfficiency',
'transmission': 'automatic',
'trim': 'L 4Matic BlueEfficiency',
'year': 2011}
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH48980%27 HTTP/1.1" 200 None
2026-03-29 18:44:08 [auto1.de] INFO: Saving data for NH48980: {'auction_closing_time': 1774886002.0, 'created_time': 1774723073.243849, 'last_price_update_time': 1774809848.165693}
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH48980') HTTP/1.1" 204 0
2026-03-29 18:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:08 [auto1.de] INFO: Found listing with ID: PW96816
2026-03-29 18:44:08 [auto1.de] INFO: Found listing with ID: UZ14919
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ14919%27 HTTP/1.1" 200 None
2026-03-29 18:44:08 [auto1.de] INFO: Scrape type for UZ14919: 2
2026-03-29 18:44:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b51ed3f0-14e6-50a0-90b4-95077e501314 with identifier: UZ14919
2026-03-29 18:44:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b51ed3f0-14e6-50a0-90b4-95077e501314 with scrape type 2
2026-03-29 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b51ed3f0-14e6-50a0-90b4-95077e501314 with scrape type 2
2026-03-29 18:44:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b51ed3f0-14e6-50a0-90b4-95077e501314, identifier: UZ14919
2026-03-29 18:44:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b51ed3f0-14e6-50a0-90b4-95077e501314 with identifier: UZ14919
2026-03-29 18:44:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b51ed3f0-14e6-50a0-90b4-95077e501314 with identifier: UZ14919
2026-03-29 18:44:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b51ed3f0-14e6-50a0-90b4-95077e501314 with identifier: UZ14919 to the API
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:55:43Z',
'fuel_type': 'petrol',
'id': 'b51ed3f0-14e6-50a0-90b4-95077e501314',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ14919',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 150712,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-11',
'seller_name': None,
'title': 'Volkswagen Beetle 1.2 TSI',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ14919%27 HTTP/1.1" 200 None
2026-03-29 18:44:08 [auto1.de] INFO: Saving data for UZ14919: {'auction_closing_time': 1774886143.0, 'created_time': 1773467677.789609, 'last_price_update_time': 1774809848.583185}
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ14919') HTTP/1.1" 204 0
2026-03-29 18:44:08 [auto1.de] INFO: Found listing with ID: JU61936
2026-03-29 18:44:08 [auto1.de] INFO: Found listing with ID: KC56991
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC56991%27 HTTP/1.1" 200 None
2026-03-29 18:44:08 [auto1.de] INFO: Scrape type for KC56991: 2
2026-03-29 18:44:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42ac30f8-832c-5d92-b6a6-b3829f0ea04b with identifier: KC56991
2026-03-29 18:44:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42ac30f8-832c-5d92-b6a6-b3829f0ea04b with scrape type 2
2026-03-29 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42ac30f8-832c-5d92-b6a6-b3829f0ea04b with scrape type 2
2026-03-29 18:44:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42ac30f8-832c-5d92-b6a6-b3829f0ea04b, identifier: KC56991
2026-03-29 18:44:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42ac30f8-832c-5d92-b6a6-b3829f0ea04b with identifier: KC56991
2026-03-29 18:44:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42ac30f8-832c-5d92-b6a6-b3829f0ea04b with identifier: KC56991
2026-03-29 18:44:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42ac30f8-832c-5d92-b6a6-b3829f0ea04b with identifier: KC56991 to the API
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:55:35Z',
'fuel_type': 'diesel',
'id': '42ac30f8-832c-5d92-b6a6-b3829f0ea04b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC56991',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 159266,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-26',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Cup',
'transmission': 'manual',
'trim': 'Cup',
'year': 2015}
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC56991%27 HTTP/1.1" 200 None
2026-03-29 18:44:09 [auto1.de] INFO: Saving data for KC56991: {'auction_closing_time': 1774886135.0, 'created_time': 1774031880.84158, 'last_price_update_time': 1774809849.092298}
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC56991') HTTP/1.1" 204 0
2026-03-29 18:44:09 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:09 [auto1.de] INFO: Found listing with ID: FY38947
2026-03-29 18:44:09 [auto1.de] INFO: Found listing with ID: MU41228
2026-03-29 18:44:09 [auto1.de] INFO: Found listing with ID: NG13141
2026-03-29 18:44:09 [auto1.de] INFO: Found listing with ID: SP37211
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP37211%27 HTTP/1.1" 200 None
2026-03-29 18:44:09 [auto1.de] INFO: Scrape type for SP37211: 2
2026-03-29 18:44:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb4523d6-941d-519e-b6f2-39392a99145b with identifier: SP37211
2026-03-29 18:44:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb4523d6-941d-519e-b6f2-39392a99145b with scrape type 2
2026-03-29 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb4523d6-941d-519e-b6f2-39392a99145b with scrape type 2
2026-03-29 18:44:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb4523d6-941d-519e-b6f2-39392a99145b, identifier: SP37211
2026-03-29 18:44:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb4523d6-941d-519e-b6f2-39392a99145b with identifier: SP37211
2026-03-29 18:44:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb4523d6-941d-519e-b6f2-39392a99145b with identifier: SP37211
2026-03-29 18:44:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb4523d6-941d-519e-b6f2-39392a99145b with identifier: SP37211 to the API
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 128,
'expiration_date': '2026-03-30T15:08:05Z',
'fuel_type': 'diesel',
'id': 'bb4523d6-941d-519e-b6f2-39392a99145b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP37211',
'listing': 'auction',
'make': 'Kia',
'model': 'Venga',
'odometer': 166200,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-03',
'seller_name': None,
'title': 'Kia Venga 1.6 CRDi Platinum Edition',
'transmission': 'manual',
'trim': 'Platinum Edition',
'year': 2014}
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP37211%27 HTTP/1.1" 200 None
2026-03-29 18:44:09 [auto1.de] INFO: Saving data for SP37211: {'auction_closing_time': 1774883285.0, 'created_time': 1774002110.709302, 'last_price_update_time': 1774809849.483699}
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP37211') HTTP/1.1" 204 0
2026-03-29 18:44:09 [auto1.de] INFO: Found listing with ID: ST53597
2026-03-29 18:44:09 [auto1.de] INFO: Found listing with ID: AD05986
2026-03-29 18:44:09 [auto1.de] INFO: Found listing with ID: LU20114
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU20114%27 HTTP/1.1" 200 None
2026-03-29 18:44:09 [auto1.de] INFO: Scrape type for LU20114: 2
2026-03-29 18:44:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cc88dcd-33e4-504f-8d73-653126e220a7 with identifier: LU20114
2026-03-29 18:44:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cc88dcd-33e4-504f-8d73-653126e220a7 with scrape type 2
2026-03-29 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cc88dcd-33e4-504f-8d73-653126e220a7 with scrape type 2
2026-03-29 18:44:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cc88dcd-33e4-504f-8d73-653126e220a7, identifier: LU20114
2026-03-29 18:44:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:09 [auto1.de] INFO: Found listing with ID: BP15722
2026-03-29 18:44:09 [auto1.de] INFO: Found listing with ID: ZJ20785
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20785%27 HTTP/1.1" 200 None
2026-03-29 18:44:09 [auto1.de] INFO: Scrape type for ZJ20785: 2
2026-03-29 18:44:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 791be7a6-da4c-50d6-9bbb-b920c41babb7 with identifier: ZJ20785
2026-03-29 18:44:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 791be7a6-da4c-50d6-9bbb-b920c41babb7 with scrape type 2
2026-03-29 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 791be7a6-da4c-50d6-9bbb-b920c41babb7 with scrape type 2
2026-03-29 18:44:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 791be7a6-da4c-50d6-9bbb-b920c41babb7, identifier: ZJ20785
2026-03-29 18:44:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cc88dcd-33e4-504f-8d73-653126e220a7 with identifier: LU20114
2026-03-29 18:44:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cc88dcd-33e4-504f-8d73-653126e220a7 with identifier: LU20114
2026-03-29 18:44:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cc88dcd-33e4-504f-8d73-653126e220a7 with identifier: LU20114 to the API
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:38:32Z',
'fuel_type': 'petrol',
'id': '3cc88dcd-33e4-504f-8d73-653126e220a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU20114',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 100649,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-27',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.2 TSI Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2013}
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU20114%27 HTTP/1.1" 200 None
2026-03-29 18:44:10 [auto1.de] INFO: Saving data for LU20114: {'auction_closing_time': 1774885112.0, 'created_time': 1773402486.306377, 'last_price_update_time': 1774809850.020307}
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU20114') HTTP/1.1" 204 0
2026-03-29 18:44:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 791be7a6-da4c-50d6-9bbb-b920c41babb7 with identifier: ZJ20785
2026-03-29 18:44:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 791be7a6-da4c-50d6-9bbb-b920c41babb7 with identifier: ZJ20785
2026-03-29 18:44:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 791be7a6-da4c-50d6-9bbb-b920c41babb7 with identifier: ZJ20785 to the API
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:09:43Z',
'fuel_type': 'petrol',
'id': '791be7a6-da4c-50d6-9bbb-b920c41babb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ20785',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 93166,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-29',
'seller_name': None,
'title': 'Hyundai ix35 1.6 Trend 2WD',
'transmission': 'manual',
'trim': 'Trend 2WD',
'year': 2014}
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20785%27 HTTP/1.1" 200 None
2026-03-29 18:44:10 [auto1.de] INFO: Saving data for ZJ20785: {'auction_closing_time': 1774883383.0, 'created_time': 1774034562.980507, 'last_price_update_time': 1774809850.440444}
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ20785') HTTP/1.1" 204 0
2026-03-29 18:44:10 [auto1.de] INFO: Found listing with ID: WT09019
2026-03-29 18:44:10 [auto1.de] INFO: Found listing with ID: MA38279
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA38279%27 HTTP/1.1" 200 None
2026-03-29 18:44:10 [auto1.de] INFO: Scrape type for MA38279: 2
2026-03-29 18:44:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11bc6dc2-17bc-5e12-89c2-10d62d8d5b89 with identifier: MA38279
2026-03-29 18:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11bc6dc2-17bc-5e12-89c2-10d62d8d5b89 with scrape type 2
2026-03-29 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11bc6dc2-17bc-5e12-89c2-10d62d8d5b89 with scrape type 2
2026-03-29 18:44:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11bc6dc2-17bc-5e12-89c2-10d62d8d5b89, identifier: MA38279
2026-03-29 18:44:10 [auto1.de] INFO: Found listing with ID: PG70940
2026-03-29 18:44:10 [auto1.de] INFO: Found listing with ID: HJ15324
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ15324%27 HTTP/1.1" 200 None
2026-03-29 18:44:10 [auto1.de] INFO: Scrape type for HJ15324: 2
2026-03-29 18:44:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 764cc605-b551-5d77-b757-5317bb0c70bd with identifier: HJ15324
2026-03-29 18:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 764cc605-b551-5d77-b757-5317bb0c70bd with scrape type 2
2026-03-29 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 764cc605-b551-5d77-b757-5317bb0c70bd with scrape type 2
2026-03-29 18:44:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 764cc605-b551-5d77-b757-5317bb0c70bd, identifier: HJ15324
2026-03-29 18:44:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11bc6dc2-17bc-5e12-89c2-10d62d8d5b89 with identifier: MA38279
2026-03-29 18:44:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11bc6dc2-17bc-5e12-89c2-10d62d8d5b89 with identifier: MA38279
2026-03-29 18:44:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11bc6dc2-17bc-5e12-89c2-10d62d8d5b89 with identifier: MA38279 to the API
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:12:08Z',
'fuel_type': 'petrol',
'id': '11bc6dc2-17bc-5e12-89c2-10d62d8d5b89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA38279',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 97135,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-20',
'seller_name': None,
'title': 'Hyundai i10 1.1 FIFA WM Edition',
'transmission': 'manual',
'trim': 'FIFA WM Edition',
'year': 2011}
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA38279%27 HTTP/1.1" 200 None
2026-03-29 18:44:10 [auto1.de] INFO: Saving data for MA38279: {'auction_closing_time': 1774883528.0, 'created_time': 1774032833.945117, 'last_price_update_time': 1774809850.966846}
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA38279') HTTP/1.1" 204 0
2026-03-29 18:44:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 764cc605-b551-5d77-b757-5317bb0c70bd with identifier: HJ15324
2026-03-29 18:44:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 764cc605-b551-5d77-b757-5317bb0c70bd with identifier: HJ15324
2026-03-29 18:44:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 764cc605-b551-5d77-b757-5317bb0c70bd with identifier: HJ15324 to the API
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:34:02Z',
'fuel_type': 'diesel',
'id': '764cc605-b551-5d77-b757-5317bb0c70bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ15324',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 193970,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-03',
'seller_name': None,
'title': 'Ford Mondeo 1.6 TDCi Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2014}
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ15324%27 HTTP/1.1" 200 None
2026-03-29 18:44:11 [auto1.de] INFO: Saving data for HJ15324: {'auction_closing_time': 1774884842.0, 'created_time': 1774377524.672996, 'last_price_update_time': 1774809851.28318}
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ15324') HTTP/1.1" 204 0
2026-03-29 18:44:11 [auto1.de] INFO: Found listing with ID: PZ30496
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ30496%27 HTTP/1.1" 200 None
2026-03-29 18:44:11 [auto1.de] INFO: Scrape type for PZ30496: 2
2026-03-29 18:44:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab2078ff-555f-5d3c-90ff-3a1c8659cf1a with identifier: PZ30496
2026-03-29 18:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab2078ff-555f-5d3c-90ff-3a1c8659cf1a with scrape type 2
2026-03-29 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab2078ff-555f-5d3c-90ff-3a1c8659cf1a with scrape type 2
2026-03-29 18:44:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab2078ff-555f-5d3c-90ff-3a1c8659cf1a, identifier: PZ30496
2026-03-29 18:44:11 [auto1.de] INFO: Found listing with ID: YJ96267
2026-03-29 18:44:11 [auto1.de] INFO: Found listing with ID: BH45975
2026-03-29 18:44:11 [auto1.de] INFO: Found listing with ID: JS30878
2026-03-29 18:44:11 [auto1.de] INFO: Found listing with ID: NL79635
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL79635%27 HTTP/1.1" 200 None
2026-03-29 18:44:11 [auto1.de] INFO: Scrape type for NL79635: 2
2026-03-29 18:44:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1aed78a9-af99-5ac0-abb7-f00bc51f1de8 with identifier: NL79635
2026-03-29 18:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aed78a9-af99-5ac0-abb7-f00bc51f1de8 with scrape type 2
2026-03-29 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1aed78a9-af99-5ac0-abb7-f00bc51f1de8 with scrape type 2
2026-03-29 18:44:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1aed78a9-af99-5ac0-abb7-f00bc51f1de8, identifier: NL79635
2026-03-29 18:44:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab2078ff-555f-5d3c-90ff-3a1c8659cf1a with identifier: PZ30496
2026-03-29 18:44:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab2078ff-555f-5d3c-90ff-3a1c8659cf1a with identifier: PZ30496
2026-03-29 18:44:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab2078ff-555f-5d3c-90ff-3a1c8659cf1a with identifier: PZ30496 to the API
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 231,
'expiration_date': '2026-03-30T15:16:56Z',
'fuel_type': 'diesel',
'id': 'ab2078ff-555f-5d3c-90ff-3a1c8659cf1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ30496',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 46002,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-25',
'seller_name': None,
'title': 'BMW X5 xDrive 25d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2021}
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ30496%27 HTTP/1.1" 200 None
2026-03-29 18:44:11 [auto1.de] INFO: Saving data for PZ30496: {'auction_closing_time': 1774883816.0, 'created_time': 1774002249.989397, 'last_price_update_time': 1774809851.823204}
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ30496') HTTP/1.1" 204 0
2026-03-29 18:44:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1aed78a9-af99-5ac0-abb7-f00bc51f1de8 with identifier: NL79635
2026-03-29 18:44:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1aed78a9-af99-5ac0-abb7-f00bc51f1de8 with identifier: NL79635
2026-03-29 18:44:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1aed78a9-af99-5ac0-abb7-f00bc51f1de8 with identifier: NL79635 to the API
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:34:23Z',
'fuel_type': 'gas',
'id': '1aed78a9-af99-5ac0-abb7-f00bc51f1de8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL79635',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 62899,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-28',
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Stepway Prestige',
'transmission': 'manual',
'trim': 'Stepway Prestige',
'year': 2020}
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL79635%27 HTTP/1.1" 200 None
2026-03-29 18:44:12 [auto1.de] INFO: Saving data for NL79635: {'auction_closing_time': 1774884863.0, 'created_time': 1774723080.202552, 'last_price_update_time': 1774809852.192248}
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL79635') HTTP/1.1" 204 0
2026-03-29 18:44:12 [auto1.de] INFO: Found listing with ID: CH12661
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH12661%27 HTTP/1.1" 200 None
2026-03-29 18:44:12 [auto1.de] INFO: Scrape type for CH12661: 2
2026-03-29 18:44:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0489f933-f2e3-53b3-a14b-48b95e1af591 with identifier: CH12661
2026-03-29 18:44:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0489f933-f2e3-53b3-a14b-48b95e1af591 with scrape type 2
2026-03-29 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0489f933-f2e3-53b3-a14b-48b95e1af591 with scrape type 2
2026-03-29 18:44:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0489f933-f2e3-53b3-a14b-48b95e1af591, identifier: CH12661
2026-03-29 18:44:12 [auto1.de] INFO: Found listing with ID: LF10236
2026-03-29 18:44:12 [auto1.de] INFO: Found listing with ID: DP76469
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP76469%27 HTTP/1.1" 200 None
2026-03-29 18:44:12 [auto1.de] INFO: Scrape type for DP76469: 2
2026-03-29 18:44:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61cb4329-635a-52ce-9548-9eb289967e13 with identifier: DP76469
2026-03-29 18:44:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61cb4329-635a-52ce-9548-9eb289967e13 with scrape type 2
2026-03-29 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61cb4329-635a-52ce-9548-9eb289967e13 with scrape type 2
2026-03-29 18:44:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61cb4329-635a-52ce-9548-9eb289967e13, identifier: DP76469
2026-03-29 18:44:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0489f933-f2e3-53b3-a14b-48b95e1af591 with identifier: CH12661
2026-03-29 18:44:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0489f933-f2e3-53b3-a14b-48b95e1af591 with identifier: CH12661
2026-03-29 18:44:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0489f933-f2e3-53b3-a14b-48b95e1af591 with identifier: CH12661 to the API
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:12:40Z',
'fuel_type': 'petrol',
'id': '0489f933-f2e3-53b3-a14b-48b95e1af591',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH12661',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 177959,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-06',
'seller_name': None,
'title': 'Audi A4 1.8 TFSI Ambiente',
'transmission': 'automatic',
'trim': 'Ambiente',
'year': 2009}
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH12661%27 HTTP/1.1" 200 None
2026-03-29 18:44:12 [auto1.de] INFO: Saving data for CH12661: {'auction_closing_time': 1774883560.0, 'created_time': 1774349924.881965, 'last_price_update_time': 1774809852.719264}
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH12661') HTTP/1.1" 204 0
2026-03-29 18:44:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61cb4329-635a-52ce-9548-9eb289967e13 with identifier: DP76469
2026-03-29 18:44:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61cb4329-635a-52ce-9548-9eb289967e13 with identifier: DP76469
2026-03-29 18:44:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61cb4329-635a-52ce-9548-9eb289967e13 with identifier: DP76469 to the API
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 398,
'expiration_date': '2026-03-30T15:01:44Z',
'fuel_type': 'hybrid',
'id': '61cb4329-635a-52ce-9548-9eb289967e13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP76469',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 55010,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-19',
'seller_name': None,
'title': 'Volvo XC60 2.0 T6 Recharge Plug-in Hybrid Plus Dark AWD',
'transmission': 'automatic',
'trim': 'Plus Dark AWD',
'year': 2023}
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP76469%27 HTTP/1.1" 200 None
2026-03-29 18:44:13 [auto1.de] INFO: Saving data for DP76469: {'auction_closing_time': 1774882904.0, 'created_time': 1774349249.990046, 'last_price_update_time': 1774809853.096816}
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP76469') HTTP/1.1" 204 0
2026-03-29 18:44:13 [auto1.de] INFO: Found listing with ID: HC35889
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC35889%27 HTTP/1.1" 200 None
2026-03-29 18:44:13 [auto1.de] INFO: Scrape type for HC35889: 2
2026-03-29 18:44:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c8643a1-4c8a-58a1-8bb5-64ccb749ad95 with identifier: HC35889
2026-03-29 18:44:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8643a1-4c8a-58a1-8bb5-64ccb749ad95 with scrape type 2
2026-03-29 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c8643a1-4c8a-58a1-8bb5-64ccb749ad95 with scrape type 2
2026-03-29 18:44:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c8643a1-4c8a-58a1-8bb5-64ccb749ad95, identifier: HC35889
2026-03-29 18:44:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c8643a1-4c8a-58a1-8bb5-64ccb749ad95 with identifier: HC35889
2026-03-29 18:44:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c8643a1-4c8a-58a1-8bb5-64ccb749ad95 with identifier: HC35889
2026-03-29 18:44:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c8643a1-4c8a-58a1-8bb5-64ccb749ad95 with identifier: HC35889 to the API
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:31:24Z',
'fuel_type': 'diesel',
'id': '6c8643a1-4c8a-58a1-8bb5-64ccb749ad95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC35889',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 175988,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-13',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2012}
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC35889%27 HTTP/1.1" 200 None
2026-03-29 18:44:13 [auto1.de] INFO: Saving data for HC35889: {'auction_closing_time': 1774884684.0, 'created_time': 1773304603.127408, 'last_price_update_time': 1774809853.478089}
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC35889') HTTP/1.1" 204 0
2026-03-29 18:44:13 [auto1.de] INFO: Found listing with ID: AX97123
2026-03-29 18:44:13 [auto1.de] INFO: Found listing with ID: ZM69821
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM69821%27 HTTP/1.1" 200 None
2026-03-29 18:44:13 [auto1.de] INFO: Scrape type for ZM69821: 2
2026-03-29 18:44:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1024aae5-7b1d-523e-be36-42ee6c88b39c with identifier: ZM69821
2026-03-29 18:44:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1024aae5-7b1d-523e-be36-42ee6c88b39c with scrape type 2
2026-03-29 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1024aae5-7b1d-523e-be36-42ee6c88b39c with scrape type 2
2026-03-29 18:44:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1024aae5-7b1d-523e-be36-42ee6c88b39c, identifier: ZM69821
2026-03-29 18:44:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1024aae5-7b1d-523e-be36-42ee6c88b39c with identifier: ZM69821
2026-03-29 18:44:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1024aae5-7b1d-523e-be36-42ee6c88b39c with identifier: ZM69821
2026-03-29 18:44:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1024aae5-7b1d-523e-be36-42ee6c88b39c with identifier: ZM69821 to the API
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:31:46Z',
'fuel_type': 'diesel',
'id': '1024aae5-7b1d-523e-be36-42ee6c88b39c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM69821',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 159416,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-22',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI',
'transmission': 'manual',
'trim': '',
'year': 2016}
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM69821%27 HTTP/1.1" 200 None
2026-03-29 18:44:13 [auto1.de] INFO: Saving data for ZM69821: {'auction_closing_time': 1774884706.0, 'created_time': 1774089100.684302, 'last_price_update_time': 1774809853.889203}
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM69821') HTTP/1.1" 204 0
2026-03-29 18:44:13 [auto1.de] INFO: Found listing with ID: ZW92608
2026-03-29 18:44:13 [auto1.de] INFO: Found listing with ID: KF80964
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF80964%27 HTTP/1.1" 200 None
2026-03-29 18:44:13 [auto1.de] INFO: Scrape type for KF80964: 2
2026-03-29 18:44:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 841be485-5981-58ed-922c-c83720fb6685 with identifier: KF80964
2026-03-29 18:44:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 841be485-5981-58ed-922c-c83720fb6685 with scrape type 2
2026-03-29 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 841be485-5981-58ed-922c-c83720fb6685 with scrape type 2
2026-03-29 18:44:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 841be485-5981-58ed-922c-c83720fb6685, identifier: KF80964
2026-03-29 18:44:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 841be485-5981-58ed-922c-c83720fb6685 with identifier: KF80964
2026-03-29 18:44:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 841be485-5981-58ed-922c-c83720fb6685 with identifier: KF80964
2026-03-29 18:44:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 841be485-5981-58ed-922c-c83720fb6685 with identifier: KF80964 to the API
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:51:32Z',
'fuel_type': 'petrol',
'id': '841be485-5981-58ed-922c-c83720fb6685',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF80964',
'listing': 'auction',
'make': 'Fiat',
'model': '500L',
'odometer': 65593,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-08',
'seller_name': None,
'title': 'Fiat 500L 1.4 Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2014}
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF80964%27 HTTP/1.1" 200 None
2026-03-29 18:44:14 [auto1.de] INFO: Saving data for KF80964: {'auction_closing_time': 1774885892.0, 'created_time': 1773468622.268255, 'last_price_update_time': 1774809854.312905}
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF80964') HTTP/1.1" 204 0
2026-03-29 18:44:14 [auto1.de] INFO: Found listing with ID: CE00984
2026-03-29 18:44:14 [auto1.de] INFO: Found listing with ID: KR40526
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR40526%27 HTTP/1.1" 200 None
2026-03-29 18:44:14 [auto1.de] INFO: Scrape type for KR40526: 2
2026-03-29 18:44:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0e9501b-8055-5602-999b-2d9d6c9d3735 with identifier: KR40526
2026-03-29 18:44:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0e9501b-8055-5602-999b-2d9d6c9d3735 with scrape type 2
2026-03-29 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0e9501b-8055-5602-999b-2d9d6c9d3735 with scrape type 2
2026-03-29 18:44:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0e9501b-8055-5602-999b-2d9d6c9d3735, identifier: KR40526
2026-03-29 18:44:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0e9501b-8055-5602-999b-2d9d6c9d3735 with identifier: KR40526
2026-03-29 18:44:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0e9501b-8055-5602-999b-2d9d6c9d3735 with identifier: KR40526
2026-03-29 18:44:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0e9501b-8055-5602-999b-2d9d6c9d3735 with identifier: KR40526 to the API
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:11:52Z',
'fuel_type': 'diesel',
'id': 'b0e9501b-8055-5602-999b-2d9d6c9d3735',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR40526',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 170054,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-27',
'seller_name': None,
'title': 'Suzuki Swift 1.3 DDiS Club',
'transmission': 'manual',
'trim': 'Club',
'year': 2014}
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR40526%27 HTTP/1.1" 200 None
2026-03-29 18:44:14 [auto1.de] INFO: Saving data for KR40526: {'auction_closing_time': 1774883512.0, 'created_time': 1774723088.174897, 'last_price_update_time': 1774809854.745679}
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR40526') HTTP/1.1" 204 0
2026-03-29 18:44:14 [auto1.de] INFO: Found listing with ID: NS83554
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS83554%27 HTTP/1.1" 200 None
2026-03-29 18:44:14 [auto1.de] INFO: Scrape type for NS83554: 2
2026-03-29 18:44:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd447f5-874c-5c58-8bb7-580aae0962a9 with identifier: NS83554
2026-03-29 18:44:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd447f5-874c-5c58-8bb7-580aae0962a9 with scrape type 2
2026-03-29 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fd447f5-874c-5c58-8bb7-580aae0962a9 with scrape type 2
2026-03-29 18:44:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fd447f5-874c-5c58-8bb7-580aae0962a9, identifier: NS83554
2026-03-29 18:44:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fd447f5-874c-5c58-8bb7-580aae0962a9 with identifier: NS83554
2026-03-29 18:44:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fd447f5-874c-5c58-8bb7-580aae0962a9 with identifier: NS83554
2026-03-29 18:44:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fd447f5-874c-5c58-8bb7-580aae0962a9 with identifier: NS83554 to the API
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:51:38Z',
'fuel_type': 'petrol',
'id': '7fd447f5-874c-5c58-8bb7-580aae0962a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS83554',
'listing': 'auction',
'make': 'Honda',
'model': 'Civic',
'odometer': 283389,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-10-26',
'seller_name': None,
'title': 'Honda Civic 1.8 VTEC Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2006}
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS83554%27 HTTP/1.1" 200 None
2026-03-29 18:44:15 [auto1.de] INFO: Saving data for NS83554: {'auction_closing_time': 1774885898.0, 'created_time': 1774723085.428904, 'last_price_update_time': 1774809855.14346}
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS83554') HTTP/1.1" 204 0
2026-03-29 18:44:15 [auto1.de] INFO: Found listing with ID: UV09635
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV09635%27 HTTP/1.1" 200 None
2026-03-29 18:44:15 [auto1.de] INFO: Scrape type for UV09635: 2
2026-03-29 18:44:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5535f39-5b58-5ca5-b54d-1085d87996f6 with identifier: UV09635
2026-03-29 18:44:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5535f39-5b58-5ca5-b54d-1085d87996f6 with scrape type 2
2026-03-29 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5535f39-5b58-5ca5-b54d-1085d87996f6 with scrape type 2
2026-03-29 18:44:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5535f39-5b58-5ca5-b54d-1085d87996f6, identifier: UV09635
2026-03-29 18:44:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5535f39-5b58-5ca5-b54d-1085d87996f6 with identifier: UV09635
2026-03-29 18:44:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5535f39-5b58-5ca5-b54d-1085d87996f6 with identifier: UV09635
2026-03-29 18:44:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5535f39-5b58-5ca5-b54d-1085d87996f6 with identifier: UV09635 to the API
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:46:01Z',
'fuel_type': 'petrol',
'id': 'b5535f39-5b58-5ca5-b54d-1085d87996f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV09635',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 133775,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-06',
'seller_name': None,
'title': 'Hyundai i30 1.4 Comfort Blue',
'transmission': 'manual',
'trim': 'Comfort Blue',
'year': 2009}
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV09635%27 HTTP/1.1" 200 None
2026-03-29 18:44:15 [auto1.de] INFO: Saving data for UV09635: {'auction_closing_time': 1774885561.0, 'created_time': 1774723117.155192, 'last_price_update_time': 1774809855.539373}
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV09635') HTTP/1.1" 204 0
2026-03-29 18:44:15 [auto1.de] INFO: Found listing with ID: CS70589
2026-03-29 18:44:15 [auto1.de] INFO: Found listing with ID: MK47455
2026-03-29 18:44:15 [auto1.de] INFO: Found listing with ID: ND12794
2026-03-29 18:44:15 [auto1.de] INFO: Found listing with ID: TW63260
2026-03-29 18:44:15 [auto1.de] INFO: Found listing with ID: SE34706
2026-03-29 18:44:15 [auto1.de] INFO: Found listing with ID: LR83897
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR83897%27 HTTP/1.1" 200 None
2026-03-29 18:44:15 [auto1.de] INFO: Scrape type for LR83897: 2
2026-03-29 18:44:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e953707-1cb1-5ce1-86ad-850864e2fbfd with identifier: LR83897
2026-03-29 18:44:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e953707-1cb1-5ce1-86ad-850864e2fbfd with scrape type 2
2026-03-29 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e953707-1cb1-5ce1-86ad-850864e2fbfd with scrape type 2
2026-03-29 18:44:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e953707-1cb1-5ce1-86ad-850864e2fbfd, identifier: LR83897
2026-03-29 18:44:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e953707-1cb1-5ce1-86ad-850864e2fbfd with identifier: LR83897
2026-03-29 18:44:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e953707-1cb1-5ce1-86ad-850864e2fbfd with identifier: LR83897
2026-03-29 18:44:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e953707-1cb1-5ce1-86ad-850864e2fbfd with identifier: LR83897 to the API
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:18:19Z',
'fuel_type': 'diesel',
'id': '6e953707-1cb1-5ce1-86ad-850864e2fbfd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR83897',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 191360,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-21',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2016}
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR83897%27 HTTP/1.1" 200 None
2026-03-29 18:44:15 [auto1.de] INFO: Saving data for LR83897: {'auction_closing_time': 1774883899.0, 'created_time': 1773467067.234613, 'last_price_update_time': 1774809855.949987}
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR83897') HTTP/1.1" 204 0
2026-03-29 18:44:16 [auto1.de] INFO: Found listing with ID: EX09851
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX09851%27 HTTP/1.1" 200 None
2026-03-29 18:44:16 [auto1.de] INFO: Scrape type for EX09851: 2
2026-03-29 18:44:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0965f22-7074-578c-ab13-b8c62dfc7c62 with identifier: EX09851
2026-03-29 18:44:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0965f22-7074-578c-ab13-b8c62dfc7c62 with scrape type 2
2026-03-29 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0965f22-7074-578c-ab13-b8c62dfc7c62 with scrape type 2
2026-03-29 18:44:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0965f22-7074-578c-ab13-b8c62dfc7c62, identifier: EX09851
2026-03-29 18:44:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0965f22-7074-578c-ab13-b8c62dfc7c62 with identifier: EX09851
2026-03-29 18:44:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0965f22-7074-578c-ab13-b8c62dfc7c62 with identifier: EX09851
2026-03-29 18:44:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0965f22-7074-578c-ab13-b8c62dfc7c62 with identifier: EX09851 to the API
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:16:26Z',
'fuel_type': 'diesel',
'id': 'a0965f22-7074-578c-ab13-b8c62dfc7c62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX09851',
'listing': 'auction',
'make': 'Hyundai',
'model': 'H1',
'odometer': 146554,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-12',
'seller_name': None,
'title': 'Hyundai H1 2.5 CRDi Travel Classic',
'transmission': 'manual',
'trim': 'Travel Classic',
'year': 2017}
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX09851%27 HTTP/1.1" 200 None
2026-03-29 18:44:16 [auto1.de] INFO: Saving data for EX09851: {'auction_closing_time': 1774883786.0, 'created_time': 1774349356.439792, 'last_price_update_time': 1774809856.467231}
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX09851') HTTP/1.1" 204 0
2026-03-29 18:44:16 [auto1.de] INFO: Found listing with ID: RT47788
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47788%27 HTTP/1.1" 200 None
2026-03-29 18:44:16 [auto1.de] INFO: Scrape type for RT47788: 2
2026-03-29 18:44:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 184f3a56-3b8e-57f7-976b-d899593a4628 with identifier: RT47788
2026-03-29 18:44:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 184f3a56-3b8e-57f7-976b-d899593a4628 with scrape type 2
2026-03-29 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 184f3a56-3b8e-57f7-976b-d899593a4628 with scrape type 2
2026-03-29 18:44:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 184f3a56-3b8e-57f7-976b-d899593a4628, identifier: RT47788
2026-03-29 18:44:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 184f3a56-3b8e-57f7-976b-d899593a4628 with identifier: RT47788
2026-03-29 18:44:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 184f3a56-3b8e-57f7-976b-d899593a4628 with identifier: RT47788
2026-03-29 18:44:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 184f3a56-3b8e-57f7-976b-d899593a4628 with identifier: RT47788 to the API
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:35:39Z',
'fuel_type': 'diesel',
'id': '184f3a56-3b8e-57f7-976b-d899593a4628',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT47788',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLK-Klasse',
'odometer': 344253,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-03',
'seller_name': None,
'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
'transmission': 'automatic',
'trim': '4Matic BlueEfficiency',
'year': 2014}
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47788%27 HTTP/1.1" 200 None
2026-03-29 18:44:16 [auto1.de] INFO: Saving data for RT47788: {'auction_closing_time': 1774884939.0, 'created_time': 1774118857.964236, 'last_price_update_time': 1774809856.871032}
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT47788') HTTP/1.1" 204 0
2026-03-29 18:44:16 [auto1.de] INFO: Found listing with ID: NM77711
2026-03-29 18:44:16 [auto1.de] INFO: Found listing with ID: NF65308
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65308%27 HTTP/1.1" 200 None
2026-03-29 18:44:16 [auto1.de] INFO: Scrape type for NF65308: 2
2026-03-29 18:44:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce0747f5-684c-5e9a-a887-2fd8983d1233 with identifier: NF65308
2026-03-29 18:44:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce0747f5-684c-5e9a-a887-2fd8983d1233 with scrape type 2
2026-03-29 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce0747f5-684c-5e9a-a887-2fd8983d1233 with scrape type 2
2026-03-29 18:44:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce0747f5-684c-5e9a-a887-2fd8983d1233, identifier: NF65308
2026-03-29 18:44:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce0747f5-684c-5e9a-a887-2fd8983d1233 with identifier: NF65308
2026-03-29 18:44:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce0747f5-684c-5e9a-a887-2fd8983d1233 with identifier: NF65308
2026-03-29 18:44:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce0747f5-684c-5e9a-a887-2fd8983d1233 with identifier: NF65308 to the API
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:57:26Z',
'fuel_type': 'petrol',
'id': 'ce0747f5-684c-5e9a-a887-2fd8983d1233',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF65308',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Taigo',
'odometer': 14487,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-04',
'seller_name': None,
'title': 'Volkswagen Taigo 1.0 TSI Goal',
'transmission': 'automatic',
'trim': 'Goal',
'year': 2025}
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65308%27 HTTP/1.1" 200 None
2026-03-29 18:44:17 [auto1.de] INFO: Saving data for NF65308: {'auction_closing_time': 1774886246.0, 'created_time': 1773340797.105527, 'last_price_update_time': 1774809857.311442}
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF65308') HTTP/1.1" 204 0
2026-03-29 18:44:17 [auto1.de] INFO: Found listing with ID: SM15553
2026-03-29 18:44:17 [auto1.de] INFO: Found listing with ID: RB21288
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB21288%27 HTTP/1.1" 200 None
2026-03-29 18:44:17 [auto1.de] INFO: Scrape type for RB21288: 2
2026-03-29 18:44:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47e818fd-0152-593b-a5f6-487cc7b64ddf with identifier: RB21288
2026-03-29 18:44:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47e818fd-0152-593b-a5f6-487cc7b64ddf with scrape type 2
2026-03-29 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47e818fd-0152-593b-a5f6-487cc7b64ddf with scrape type 2
2026-03-29 18:44:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47e818fd-0152-593b-a5f6-487cc7b64ddf, identifier: RB21288
2026-03-29 18:44:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47e818fd-0152-593b-a5f6-487cc7b64ddf with identifier: RB21288
2026-03-29 18:44:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47e818fd-0152-593b-a5f6-487cc7b64ddf with identifier: RB21288
2026-03-29 18:44:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47e818fd-0152-593b-a5f6-487cc7b64ddf with identifier: RB21288 to the API
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:56:08Z',
'fuel_type': 'petrol',
'id': '47e818fd-0152-593b-a5f6-487cc7b64ddf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB21288',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 126649,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-02',
'seller_name': None,
'title': 'Kia Sportage 2.0 Attract 2WD',
'transmission': 'automatic',
'trim': 'Attract 2WD',
'year': 2013}
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB21288%27 HTTP/1.1" 200 None
2026-03-29 18:44:17 [auto1.de] INFO: Saving data for RB21288: {'auction_closing_time': 1774886168.0, 'created_time': 1774031847.233546, 'last_price_update_time': 1774809857.731574}
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB21288') HTTP/1.1" 204 0
2026-03-29 18:44:17 [auto1.de] INFO: Found listing with ID: TL00985
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL00985%27 HTTP/1.1" 200 None
2026-03-29 18:44:17 [auto1.de] INFO: Scrape type for TL00985: 2
2026-03-29 18:44:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77504561-d8c1-58a9-aaac-8bc5f00f10cf with identifier: TL00985
2026-03-29 18:44:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77504561-d8c1-58a9-aaac-8bc5f00f10cf with scrape type 2
2026-03-29 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77504561-d8c1-58a9-aaac-8bc5f00f10cf with scrape type 2
2026-03-29 18:44:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77504561-d8c1-58a9-aaac-8bc5f00f10cf, identifier: TL00985
2026-03-29 18:44:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77504561-d8c1-58a9-aaac-8bc5f00f10cf with identifier: TL00985
2026-03-29 18:44:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77504561-d8c1-58a9-aaac-8bc5f00f10cf with identifier: TL00985
2026-03-29 18:44:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77504561-d8c1-58a9-aaac-8bc5f00f10cf with identifier: TL00985 to the API
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 349,
'expiration_date': '2026-03-30T15:15:57Z',
'fuel_type': 'diesel',
'id': '77504561-d8c1-58a9-aaac-8bc5f00f10cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL00985',
'listing': 'auction',
'make': 'Audi',
'model': 'A6 Allroad',
'odometer': 187449,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-03',
'seller_name': None,
'title': 'Audi A6 Allroad 55 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2020}
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL00985%27 HTTP/1.1" 200 None
2026-03-29 18:44:18 [auto1.de] INFO: Saving data for TL00985: {'auction_closing_time': 1774883757.0, 'created_time': 1773468822.353858, 'last_price_update_time': 1774809858.13957}
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL00985') HTTP/1.1" 204 0
2026-03-29 18:44:18 [auto1.de] INFO: Found listing with ID: WM78340
2026-03-29 18:44:18 [auto1.de] INFO: Found listing with ID: NF79967
2026-03-29 18:44:18 [auto1.de] INFO: Found listing with ID: BP86172
2026-03-29 18:44:18 [auto1.de] INFO: Found listing with ID: SM64754
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM64754%27 HTTP/1.1" 200 None
2026-03-29 18:44:18 [auto1.de] INFO: Scrape type for SM64754: 2
2026-03-29 18:44:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89b085ca-8805-547a-b684-ece7b3cfc007 with identifier: SM64754
2026-03-29 18:44:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89b085ca-8805-547a-b684-ece7b3cfc007 with scrape type 2
2026-03-29 18:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89b085ca-8805-547a-b684-ece7b3cfc007 with scrape type 2
2026-03-29 18:44:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89b085ca-8805-547a-b684-ece7b3cfc007, identifier: SM64754
2026-03-29 18:44:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89b085ca-8805-547a-b684-ece7b3cfc007 with identifier: SM64754
2026-03-29 18:44:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89b085ca-8805-547a-b684-ece7b3cfc007 with identifier: SM64754
2026-03-29 18:44:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89b085ca-8805-547a-b684-ece7b3cfc007 with identifier: SM64754 to the API
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:54:01Z',
'fuel_type': 'petrol',
'id': '89b085ca-8805-547a-b684-ece7b3cfc007',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM64754',
'listing': 'auction',
'make': 'Opel',
'model': 'Karl',
'odometer': 40873,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-29',
'seller_name': None,
'title': 'Opel Karl 1.0 Rocks',
'transmission': 'manual',
'trim': 'Rocks',
'year': 2017}
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM64754%27 HTTP/1.1" 200 None
2026-03-29 18:44:18 [auto1.de] INFO: Saving data for SM64754: {'auction_closing_time': 1774886041.0, 'created_time': 1774033694.071387, 'last_price_update_time': 1774809858.558351}
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM64754') HTTP/1.1" 204 0
2026-03-29 18:44:18 [auto1.de] INFO: Found listing with ID: PL66942
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL66942%27 HTTP/1.1" 200 None
2026-03-29 18:44:18 [auto1.de] INFO: Scrape type for PL66942: 2
2026-03-29 18:44:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 168581f5-722f-5c02-80f9-b7cbf94968e9 with identifier: PL66942
2026-03-29 18:44:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 168581f5-722f-5c02-80f9-b7cbf94968e9 with scrape type 2
2026-03-29 18:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 168581f5-722f-5c02-80f9-b7cbf94968e9 with scrape type 2
2026-03-29 18:44:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 168581f5-722f-5c02-80f9-b7cbf94968e9, identifier: PL66942
2026-03-29 18:44:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 168581f5-722f-5c02-80f9-b7cbf94968e9 with identifier: PL66942
2026-03-29 18:44:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 168581f5-722f-5c02-80f9-b7cbf94968e9 with identifier: PL66942
2026-03-29 18:44:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 168581f5-722f-5c02-80f9-b7cbf94968e9 with identifier: PL66942 to the API
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:53:24Z',
'fuel_type': 'petrol',
'id': '168581f5-722f-5c02-80f9-b7cbf94968e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL66942',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 151635,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-27',
'seller_name': None,
'title': 'Ford Fiesta 1.1 Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2017}
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL66942%27 HTTP/1.1" 200 None
2026-03-29 18:44:19 [auto1.de] INFO: Saving data for PL66942: {'auction_closing_time': 1774886004.0, 'created_time': 1774723085.865003, 'last_price_update_time': 1774809859.040187}
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL66942') HTTP/1.1" 204 0
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: LR99893
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: VG16481
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: RU39212
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU39212%27 HTTP/1.1" 200 None
2026-03-29 18:44:19 [auto1.de] INFO: Scrape type for RU39212: 2
2026-03-29 18:44:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ce1cd3a-eb83-5823-966f-6aa3e60d8e96 with identifier: RU39212
2026-03-29 18:44:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ce1cd3a-eb83-5823-966f-6aa3e60d8e96 with scrape type 2
2026-03-29 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ce1cd3a-eb83-5823-966f-6aa3e60d8e96 with scrape type 2
2026-03-29 18:44:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ce1cd3a-eb83-5823-966f-6aa3e60d8e96, identifier: RU39212
2026-03-29 18:44:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ce1cd3a-eb83-5823-966f-6aa3e60d8e96 with identifier: RU39212
2026-03-29 18:44:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ce1cd3a-eb83-5823-966f-6aa3e60d8e96 with identifier: RU39212
2026-03-29 18:44:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ce1cd3a-eb83-5823-966f-6aa3e60d8e96 with identifier: RU39212 to the API
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:43:01Z',
'fuel_type': 'petrol',
'id': '6ce1cd3a-eb83-5823-966f-6aa3e60d8e96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU39212',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 58846,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-17',
'seller_name': None,
'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2021}
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU39212%27 HTTP/1.1" 200 None
2026-03-29 18:44:19 [auto1.de] INFO: Saving data for RU39212: {'auction_closing_time': 1774885381.0, 'created_time': 1774033736.628846, 'last_price_update_time': 1774809859.461955}
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU39212') HTTP/1.1" 204 0
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: PH19268
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: ZS99681
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS99681%27 HTTP/1.1" 200 None
2026-03-29 18:44:19 [auto1.de] INFO: Scrape type for ZS99681: 2
2026-03-29 18:44:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 034a2824-1c4b-5cd7-9500-e8282218eed6 with identifier: ZS99681
2026-03-29 18:44:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 034a2824-1c4b-5cd7-9500-e8282218eed6 with scrape type 2
2026-03-29 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 034a2824-1c4b-5cd7-9500-e8282218eed6 with scrape type 2
2026-03-29 18:44:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 034a2824-1c4b-5cd7-9500-e8282218eed6, identifier: ZS99681
2026-03-29 18:44:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 034a2824-1c4b-5cd7-9500-e8282218eed6 with identifier: ZS99681
2026-03-29 18:44:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 034a2824-1c4b-5cd7-9500-e8282218eed6 with identifier: ZS99681
2026-03-29 18:44:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 034a2824-1c4b-5cd7-9500-e8282218eed6 with identifier: ZS99681 to the API
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:51:15Z',
'fuel_type': 'petrol',
'id': '034a2824-1c4b-5cd7-9500-e8282218eed6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS99681',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 90736,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-02',
'seller_name': None,
'title': 'Hyundai i20 1.2 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2019}
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS99681%27 HTTP/1.1" 200 None
2026-03-29 18:44:19 [auto1.de] INFO: Saving data for ZS99681: {'auction_closing_time': 1774885875.0, 'created_time': 1773467117.227302, 'last_price_update_time': 1774809859.897172}
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS99681') HTTP/1.1" 204 0
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: PU80535
2026-03-29 18:44:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:24 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:24 [auto1.de] INFO: Found listing with ID: AN91174
2026-03-29 18:44:24 [auto1.de] INFO: Found listing with ID: AF19813
2026-03-29 18:44:24 [auto1.de] INFO: Found listing with ID: DK08847
2026-03-29 18:44:24 [auto1.de] INFO: Found listing with ID: JB87569
2026-03-29 18:44:24 [auto1.de] INFO: Found listing with ID: EE75447
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE75447%27 HTTP/1.1" 200 None
2026-03-29 18:44:24 [auto1.de] INFO: Scrape type for EE75447: 2
2026-03-29 18:44:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44e36140-202a-52aa-bbc8-7287ce5f94bc with identifier: EE75447
2026-03-29 18:44:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44e36140-202a-52aa-bbc8-7287ce5f94bc with scrape type 2
2026-03-29 18:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44e36140-202a-52aa-bbc8-7287ce5f94bc with scrape type 2
2026-03-29 18:44:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44e36140-202a-52aa-bbc8-7287ce5f94bc, identifier: EE75447
2026-03-29 18:44:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44e36140-202a-52aa-bbc8-7287ce5f94bc with identifier: EE75447
2026-03-29 18:44:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44e36140-202a-52aa-bbc8-7287ce5f94bc with identifier: EE75447
2026-03-29 18:44:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44e36140-202a-52aa-bbc8-7287ce5f94bc with identifier: EE75447 to the API
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:34:02Z',
'fuel_type': 'petrol',
'id': '44e36140-202a-52aa-bbc8-7287ce5f94bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE75447',
'listing': 'auction',
'make': 'Peugeot',
'model': '306',
'odometer': 122226,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1997-10-09',
'seller_name': None,
'title': 'Peugeot 306 1.8 XR',
'transmission': 'automatic',
'trim': 'XR',
'year': 1997}
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE75447%27 HTTP/1.1" 200 None
2026-03-29 18:44:24 [auto1.de] INFO: Saving data for EE75447: {'auction_closing_time': 1774884842.0, 'created_time': 1774723117.775918, 'last_price_update_time': 1774809864.623241}
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE75447') HTTP/1.1" 204 0
2026-03-29 18:44:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:24 [auto1.de] INFO: Found listing with ID: RP15985
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15985%27 HTTP/1.1" 200 None
2026-03-29 18:44:24 [auto1.de] INFO: Scrape type for RP15985: 2
2026-03-29 18:44:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2 with identifier: RP15985
2026-03-29 18:44:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2 with scrape type 2
2026-03-29 18:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2 with scrape type 2
2026-03-29 18:44:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2, identifier: RP15985
2026-03-29 18:44:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2 with identifier: RP15985
2026-03-29 18:44:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2 with identifier: RP15985
2026-03-29 18:44:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2 with identifier: RP15985 to the API
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:25:50Z',
'fuel_type': 'diesel',
'id': 'bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP15985',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 289580,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-03',
'seller_name': None,
'title': 'BMW 2er 218d Gran Tourer Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2021}
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15985%27 HTTP/1.1" 200 None
2026-03-29 18:44:25 [auto1.de] INFO: Saving data for RP15985: {'auction_closing_time': 1774884350.0, 'created_time': 1774002726.462658, 'last_price_update_time': 1774809865.108601}
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP15985') HTTP/1.1" 204 0
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: TA77613
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: SP96955
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96955%27 HTTP/1.1" 200 None
2026-03-29 18:44:25 [auto1.de] INFO: Scrape type for SP96955: 2
2026-03-29 18:44:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3385d3d-4e81-5257-8856-61261fd75812 with identifier: SP96955
2026-03-29 18:44:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3385d3d-4e81-5257-8856-61261fd75812 with scrape type 2
2026-03-29 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3385d3d-4e81-5257-8856-61261fd75812 with scrape type 2
2026-03-29 18:44:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3385d3d-4e81-5257-8856-61261fd75812, identifier: SP96955
2026-03-29 18:44:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3385d3d-4e81-5257-8856-61261fd75812 with identifier: SP96955
2026-03-29 18:44:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3385d3d-4e81-5257-8856-61261fd75812 with identifier: SP96955
2026-03-29 18:44:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3385d3d-4e81-5257-8856-61261fd75812 with identifier: SP96955 to the API
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 292,
'expiration_date': '2026-03-30T15:14:16Z',
'fuel_type': 'petrol',
'id': 'c3385d3d-4e81-5257-8856-61261fd75812',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP96955',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 167279,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-26',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 CGI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2009}
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96955%27 HTTP/1.1" 200 None
2026-03-29 18:44:25 [auto1.de] INFO: Saving data for SP96955: {'auction_closing_time': 1774883656.0, 'created_time': 1774723089.632257, 'last_price_update_time': 1774809865.550331}
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP96955') HTTP/1.1" 204 0
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: DW77268
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: DJ18232
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: RL54518
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: GS31332
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS31332%27 HTTP/1.1" 200 None
2026-03-29 18:44:25 [auto1.de] INFO: Scrape type for GS31332: 2
2026-03-29 18:44:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8715f3d4-506f-55d0-bc31-c01447ec435a with identifier: GS31332
2026-03-29 18:44:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8715f3d4-506f-55d0-bc31-c01447ec435a with scrape type 2
2026-03-29 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8715f3d4-506f-55d0-bc31-c01447ec435a with scrape type 2
2026-03-29 18:44:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8715f3d4-506f-55d0-bc31-c01447ec435a, identifier: GS31332
2026-03-29 18:44:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8715f3d4-506f-55d0-bc31-c01447ec435a with identifier: GS31332
2026-03-29 18:44:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8715f3d4-506f-55d0-bc31-c01447ec435a with identifier: GS31332
2026-03-29 18:44:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8715f3d4-506f-55d0-bc31-c01447ec435a with identifier: GS31332 to the API
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:11:15Z',
'fuel_type': 'diesel',
'id': '8715f3d4-506f-55d0-bc31-c01447ec435a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS31332',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 122200,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-03',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2019}
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS31332%27 HTTP/1.1" 200 None
2026-03-29 18:44:25 [auto1.de] INFO: Saving data for GS31332: {'auction_closing_time': 1774883475.0, 'created_time': 1774032704.244902, 'last_price_update_time': 1774809865.940663}
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS31332') HTTP/1.1" 204 0
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: GS03100
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: FC21553
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: CT45397
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: TH39634
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH39634%27 HTTP/1.1" 200 None
2026-03-29 18:44:25 [auto1.de] INFO: Scrape type for TH39634: 2
2026-03-29 18:44:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a0bf665-30ac-58fe-a002-cdc42e0b5153 with identifier: TH39634
2026-03-29 18:44:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a0bf665-30ac-58fe-a002-cdc42e0b5153 with scrape type 2
2026-03-29 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a0bf665-30ac-58fe-a002-cdc42e0b5153 with scrape type 2
2026-03-29 18:44:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a0bf665-30ac-58fe-a002-cdc42e0b5153, identifier: TH39634
2026-03-29 18:44:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a0bf665-30ac-58fe-a002-cdc42e0b5153 with identifier: TH39634
2026-03-29 18:44:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a0bf665-30ac-58fe-a002-cdc42e0b5153 with identifier: TH39634
2026-03-29 18:44:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a0bf665-30ac-58fe-a002-cdc42e0b5153 with identifier: TH39634 to the API
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:21:38Z',
'fuel_type': 'petrol',
'id': '4a0bf665-30ac-58fe-a002-cdc42e0b5153',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH39634',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 96389,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-11',
'seller_name': None,
'title': 'Hyundai i20 1.2 YES!',
'transmission': 'manual',
'trim': 'YES!',
'year': 2019}
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH39634%27 HTTP/1.1" 200 None
2026-03-29 18:44:26 [auto1.de] INFO: Saving data for TH39634: {'auction_closing_time': 1774884098.0, 'created_time': 1774118822.399508, 'last_price_update_time': 1774809866.363497}
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH39634') HTTP/1.1" 204 0
2026-03-29 18:44:26 [auto1.de] INFO: Found listing with ID: MY94359
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY94359%27 HTTP/1.1" 200 None
2026-03-29 18:44:26 [auto1.de] INFO: Scrape type for MY94359: 2
2026-03-29 18:44:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cd6a9bb-9bc7-5717-8c44-5651965042ea with identifier: MY94359
2026-03-29 18:44:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea with scrape type 2
2026-03-29 18:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea with scrape type 2
2026-03-29 18:44:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cd6a9bb-9bc7-5717-8c44-5651965042ea, identifier: MY94359
2026-03-29 18:44:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cd6a9bb-9bc7-5717-8c44-5651965042ea with identifier: MY94359
2026-03-29 18:44:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cd6a9bb-9bc7-5717-8c44-5651965042ea with identifier: MY94359
2026-03-29 18:44:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cd6a9bb-9bc7-5717-8c44-5651965042ea with identifier: MY94359 to the API
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:23:18Z',
'fuel_type': 'diesel',
'id': '6cd6a9bb-9bc7-5717-8c44-5651965042ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY94359',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 161827,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-07',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Alltrack BlueMotion 4Motion',
'transmission': 'automatic',
'trim': 'Alltrack BlueMotion 4Motion',
'year': 2019}
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY94359%27 HTTP/1.1" 200 None
2026-03-29 18:44:26 [auto1.de] INFO: Saving data for MY94359: {'auction_closing_time': 1774884198.0, 'created_time': 1774723120.8107, 'last_price_update_time': 1774809866.833677}
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY94359') HTTP/1.1" 204 0
2026-03-29 18:44:26 [auto1.de] INFO: Found listing with ID: FZ92426
2026-03-29 18:44:26 [auto1.de] INFO: Found listing with ID: RE77380
2026-03-29 18:44:26 [auto1.de] INFO: Found listing with ID: ZS85048
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85048%27 HTTP/1.1" 200 None
2026-03-29 18:44:26 [auto1.de] INFO: Scrape type for ZS85048: 2
2026-03-29 18:44:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65cb925b-c3d9-5376-aab6-922093372766 with identifier: ZS85048
2026-03-29 18:44:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65cb925b-c3d9-5376-aab6-922093372766 with scrape type 2
2026-03-29 18:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65cb925b-c3d9-5376-aab6-922093372766 with scrape type 2
2026-03-29 18:44:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65cb925b-c3d9-5376-aab6-922093372766, identifier: ZS85048
2026-03-29 18:44:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65cb925b-c3d9-5376-aab6-922093372766 with identifier: ZS85048
2026-03-29 18:44:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65cb925b-c3d9-5376-aab6-922093372766 with identifier: ZS85048
2026-03-29 18:44:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65cb925b-c3d9-5376-aab6-922093372766 with identifier: ZS85048 to the API
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:58:07Z',
'fuel_type': 'petrol',
'id': '65cb925b-c3d9-5376-aab6-922093372766',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS85048',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 112324,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-07',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.0 TSI Join',
'transmission': 'manual',
'trim': 'Join',
'year': 2019}
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85048%27 HTTP/1.1" 200 None
2026-03-29 18:44:27 [auto1.de] INFO: Saving data for ZS85048: {'auction_closing_time': 1774886287.0, 'created_time': 1774032517.900893, 'last_price_update_time': 1774809867.238527}
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS85048') HTTP/1.1" 204 0
2026-03-29 18:44:27 [auto1.de] INFO: Found listing with ID: ZY92659
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY92659%27 HTTP/1.1" 200 None
2026-03-29 18:44:27 [auto1.de] INFO: Scrape type for ZY92659: 2
2026-03-29 18:44:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ec7afe0-4458-535c-b90f-321895b6e57c with identifier: ZY92659
2026-03-29 18:44:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec7afe0-4458-535c-b90f-321895b6e57c with scrape type 2
2026-03-29 18:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ec7afe0-4458-535c-b90f-321895b6e57c with scrape type 2
2026-03-29 18:44:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ec7afe0-4458-535c-b90f-321895b6e57c, identifier: ZY92659
2026-03-29 18:44:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ec7afe0-4458-535c-b90f-321895b6e57c with identifier: ZY92659
2026-03-29 18:44:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ec7afe0-4458-535c-b90f-321895b6e57c with identifier: ZY92659
2026-03-29 18:44:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ec7afe0-4458-535c-b90f-321895b6e57c with identifier: ZY92659 to the API
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:11:32Z',
'fuel_type': 'petrol',
'id': '4ec7afe0-4458-535c-b90f-321895b6e57c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY92659',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 94031,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-20',
'seller_name': None,
'title': 'Alfa Romeo Giulietta 1.4 Turbo Turismo',
'transmission': 'manual',
'trim': 'Turismo',
'year': 2012}
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY92659%27 HTTP/1.1" 200 None
2026-03-29 18:44:27 [auto1.de] INFO: Saving data for ZY92659: {'auction_closing_time': 1774883492.0, 'created_time': 1774723186.074097, 'last_price_update_time': 1774809867.621249}
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY92659') HTTP/1.1" 204 0
2026-03-29 18:44:27 [auto1.de] INFO: Found listing with ID: DK37949
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK37949%27 HTTP/1.1" 200 None
2026-03-29 18:44:27 [auto1.de] INFO: Scrape type for DK37949: 2
2026-03-29 18:44:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77ff899a-fdf6-5197-8387-2dc3b38f5959 with identifier: DK37949
2026-03-29 18:44:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77ff899a-fdf6-5197-8387-2dc3b38f5959 with scrape type 2
2026-03-29 18:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77ff899a-fdf6-5197-8387-2dc3b38f5959 with scrape type 2
2026-03-29 18:44:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77ff899a-fdf6-5197-8387-2dc3b38f5959, identifier: DK37949
2026-03-29 18:44:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77ff899a-fdf6-5197-8387-2dc3b38f5959 with identifier: DK37949
2026-03-29 18:44:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77ff899a-fdf6-5197-8387-2dc3b38f5959 with identifier: DK37949
2026-03-29 18:44:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77ff899a-fdf6-5197-8387-2dc3b38f5959 with identifier: DK37949 to the API
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:10:48Z',
'fuel_type': 'diesel',
'id': '77ff899a-fdf6-5197-8387-2dc3b38f5959',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK37949',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 114960,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-25',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 250 d lang 4Matic BlueTEC Avantgarde '
'Edition',
'transmission': 'automatic',
'trim': 'lang 4Matic BlueTEC Avantgarde Edition',
'year': 2018}
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK37949%27 HTTP/1.1" 200 None
2026-03-29 18:44:28 [auto1.de] INFO: Saving data for DK37949: {'auction_closing_time': 1774883448.0, 'created_time': 1774723093.803787, 'last_price_update_time': 1774809868.017529}
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK37949') HTTP/1.1" 204 0
2026-03-29 18:44:28 [auto1.de] INFO: Found listing with ID: ZY32657
2026-03-29 18:44:28 [auto1.de] INFO: Found listing with ID: RF12873
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF12873%27 HTTP/1.1" 200 None
2026-03-29 18:44:28 [auto1.de] INFO: Scrape type for RF12873: 2
2026-03-29 18:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2de83903-3e01-55d4-ae21-eb41d0d128cb with identifier: RF12873
2026-03-29 18:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de83903-3e01-55d4-ae21-eb41d0d128cb with scrape type 2
2026-03-29 18:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2de83903-3e01-55d4-ae21-eb41d0d128cb with scrape type 2
2026-03-29 18:44:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2de83903-3e01-55d4-ae21-eb41d0d128cb, identifier: RF12873
2026-03-29 18:44:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2de83903-3e01-55d4-ae21-eb41d0d128cb with identifier: RF12873
2026-03-29 18:44:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2de83903-3e01-55d4-ae21-eb41d0d128cb with identifier: RF12873
2026-03-29 18:44:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2de83903-3e01-55d4-ae21-eb41d0d128cb with identifier: RF12873 to the API
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:04:57Z',
'fuel_type': 'diesel',
'id': '2de83903-3e01-55d4-ae21-eb41d0d128cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF12873',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 296972,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-22',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2012}
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF12873%27 HTTP/1.1" 200 None
2026-03-29 18:44:28 [auto1.de] INFO: Saving data for RF12873: {'auction_closing_time': 1774883097.0, 'created_time': 1774723116.127225, 'last_price_update_time': 1774809868.414801}
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF12873') HTTP/1.1" 204 0
2026-03-29 18:44:28 [auto1.de] INFO: Found listing with ID: WK31693
2026-03-29 18:44:28 [auto1.de] INFO: Found listing with ID: WL69602
2026-03-29 18:44:28 [auto1.de] INFO: Found listing with ID: XR35811
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR35811%27 HTTP/1.1" 200 None
2026-03-29 18:44:28 [auto1.de] INFO: Scrape type for XR35811: 2
2026-03-29 18:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1689c499-9578-51a4-b130-15ce53373f03 with identifier: XR35811
2026-03-29 18:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1689c499-9578-51a4-b130-15ce53373f03 with scrape type 2
2026-03-29 18:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1689c499-9578-51a4-b130-15ce53373f03 with scrape type 2
2026-03-29 18:44:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1689c499-9578-51a4-b130-15ce53373f03, identifier: XR35811
2026-03-29 18:44:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1689c499-9578-51a4-b130-15ce53373f03 with identifier: XR35811
2026-03-29 18:44:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1689c499-9578-51a4-b130-15ce53373f03 with identifier: XR35811
2026-03-29 18:44:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1689c499-9578-51a4-b130-15ce53373f03 with identifier: XR35811 to the API
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:38:40Z',
'fuel_type': 'petrol',
'id': '1689c499-9578-51a4-b130-15ce53373f03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR35811',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 160267,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-08',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.2 TSI Team',
'transmission': 'automatic',
'trim': 'Team',
'year': 2011}
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR35811%27 HTTP/1.1" 200 None
2026-03-29 18:44:28 [auto1.de] INFO: Saving data for XR35811: {'auction_closing_time': 1774885120.0, 'created_time': 1774723114.581556, 'last_price_update_time': 1774809868.802401}
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR35811') HTTP/1.1" 204 0
2026-03-29 18:44:28 [auto1.de] INFO: Found listing with ID: NC71734
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC71734%27 HTTP/1.1" 200 None
2026-03-29 18:44:28 [auto1.de] INFO: Scrape type for NC71734: 2
2026-03-29 18:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67a9b5cb-7a46-5812-9c65-c8c62d78aad7 with identifier: NC71734
2026-03-29 18:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a9b5cb-7a46-5812-9c65-c8c62d78aad7 with scrape type 2
2026-03-29 18:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67a9b5cb-7a46-5812-9c65-c8c62d78aad7 with scrape type 2
2026-03-29 18:44:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67a9b5cb-7a46-5812-9c65-c8c62d78aad7, identifier: NC71734
2026-03-29 18:44:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67a9b5cb-7a46-5812-9c65-c8c62d78aad7 with identifier: NC71734
2026-03-29 18:44:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67a9b5cb-7a46-5812-9c65-c8c62d78aad7 with identifier: NC71734
2026-03-29 18:44:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67a9b5cb-7a46-5812-9c65-c8c62d78aad7 with identifier: NC71734 to the API
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:36:58Z',
'fuel_type': 'diesel',
'id': '67a9b5cb-7a46-5812-9c65-c8c62d78aad7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC71734',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Amarok',
'odometer': 201097,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-31',
'seller_name': None,
'title': 'Volkswagen Amarok 2.0 TDI Highline DoubleCab 4Motion',
'transmission': 'automatic',
'trim': 'Highline DoubleCab 4Motion',
'year': 2014}
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC71734%27 HTTP/1.1" 200 None
2026-03-29 18:44:29 [auto1.de] INFO: Saving data for NC71734: {'auction_closing_time': 1774885018.0, 'created_time': 1774350129.615007, 'last_price_update_time': 1774809869.31107}
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC71734') HTTP/1.1" 204 0
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: XU03488
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: JN07474
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN07474%27 HTTP/1.1" 200 None
2026-03-29 18:44:29 [auto1.de] INFO: Scrape type for JN07474: 2
2026-03-29 18:44:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26 with identifier: JN07474
2026-03-29 18:44:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26 with scrape type 2
2026-03-29 18:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26 with scrape type 2
2026-03-29 18:44:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26, identifier: JN07474
2026-03-29 18:44:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26 with identifier: JN07474
2026-03-29 18:44:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26 with identifier: JN07474
2026-03-29 18:44:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26 with identifier: JN07474 to the API
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 144,
'expiration_date': '2026-03-30T15:54:51Z',
'fuel_type': 'diesel',
'id': '1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN07474',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 36801,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-22',
'seller_name': None,
'title': 'Citroen Jumpy 2.0 Blue-HDi M L2',
'transmission': 'automatic',
'trim': 'M L2',
'year': 2021}
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN07474%27 HTTP/1.1" 200 None
2026-03-29 18:44:29 [auto1.de] INFO: Saving data for JN07474: {'auction_closing_time': 1774886091.0, 'created_time': 1773340552.233394, 'last_price_update_time': 1774809869.733959}
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN07474') HTTP/1.1" 204 0
2026-03-29 18:44:29 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: CT96582
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: XZ21442
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ21442%27 HTTP/1.1" 200 None
2026-03-29 18:44:29 [auto1.de] INFO: Scrape type for XZ21442: 2
2026-03-29 18:44:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93d26785-fd90-52b9-85c8-3213dce4b022 with identifier: XZ21442
2026-03-29 18:44:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93d26785-fd90-52b9-85c8-3213dce4b022 with scrape type 2
2026-03-29 18:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93d26785-fd90-52b9-85c8-3213dce4b022 with scrape type 2
2026-03-29 18:44:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93d26785-fd90-52b9-85c8-3213dce4b022, identifier: XZ21442
2026-03-29 18:44:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93d26785-fd90-52b9-85c8-3213dce4b022 with identifier: XZ21442
2026-03-29 18:44:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93d26785-fd90-52b9-85c8-3213dce4b022 with identifier: XZ21442
2026-03-29 18:44:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93d26785-fd90-52b9-85c8-3213dce4b022 with identifier: XZ21442 to the API
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:33:03Z',
'fuel_type': 'petrol',
'id': '93d26785-fd90-52b9-85c8-3213dce4b022',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ21442',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 74935,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-09',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2014}
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ21442%27 HTTP/1.1" 200 None
2026-03-29 18:44:30 [auto1.de] INFO: Saving data for XZ21442: {'auction_closing_time': 1774884783.0, 'created_time': 1774723108.14413, 'last_price_update_time': 1774809870.145461}
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ21442') HTTP/1.1" 204 0
2026-03-29 18:44:30 [auto1.de] INFO: Found listing with ID: HA62575
2026-03-29 18:44:30 [auto1.de] INFO: Found listing with ID: AU44008
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU44008%27 HTTP/1.1" 200 None
2026-03-29 18:44:30 [auto1.de] INFO: Scrape type for AU44008: 2
2026-03-29 18:44:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6 with identifier: AU44008
2026-03-29 18:44:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6 with scrape type 2
2026-03-29 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6 with scrape type 2
2026-03-29 18:44:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6, identifier: AU44008
2026-03-29 18:44:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:30 [auto1.de] INFO: Found listing with ID: EK71515
2026-03-29 18:44:30 [auto1.de] INFO: Found listing with ID: YE73742
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE73742%27 HTTP/1.1" 200 None
2026-03-29 18:44:30 [auto1.de] INFO: Scrape type for YE73742: 2
2026-03-29 18:44:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3092703a-3bc1-5fa9-88c2-37c0c1727470 with identifier: YE73742
2026-03-29 18:44:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3092703a-3bc1-5fa9-88c2-37c0c1727470 with scrape type 2
2026-03-29 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3092703a-3bc1-5fa9-88c2-37c0c1727470 with scrape type 2
2026-03-29 18:44:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3092703a-3bc1-5fa9-88c2-37c0c1727470, identifier: YE73742
2026-03-29 18:44:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6 with identifier: AU44008
2026-03-29 18:44:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6 with identifier: AU44008
2026-03-29 18:44:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6 with identifier: AU44008 to the API
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:03:15Z',
'fuel_type': 'petrol',
'id': '91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU44008',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 143506,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-14',
'seller_name': None,
'title': 'BMW 1er M135i xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2013}
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU44008%27 HTTP/1.1" 200 None
2026-03-29 18:44:30 [auto1.de] INFO: Saving data for AU44008: {'auction_closing_time': 1774882995.0, 'created_time': 1774723125.533629, 'last_price_update_time': 1774809870.650444}
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU44008') HTTP/1.1" 204 0
2026-03-29 18:44:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3092703a-3bc1-5fa9-88c2-37c0c1727470 with identifier: YE73742
2026-03-29 18:44:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3092703a-3bc1-5fa9-88c2-37c0c1727470 with identifier: YE73742
2026-03-29 18:44:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3092703a-3bc1-5fa9-88c2-37c0c1727470 with identifier: YE73742 to the API
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:13:31Z',
'fuel_type': 'diesel',
'id': '3092703a-3bc1-5fa9-88c2-37c0c1727470',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE73742',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 226331,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-09',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 180 d Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE73742%27 HTTP/1.1" 200 None
2026-03-29 18:44:30 [auto1.de] INFO: Saving data for YE73742: {'auction_closing_time': 1774883611.0, 'created_time': 1774034558.005813, 'last_price_update_time': 1774809870.948258}
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE73742') HTTP/1.1" 204 0
2026-03-29 18:44:30 [auto1.de] INFO: Found listing with ID: UN89180
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN89180%27 HTTP/1.1" 200 None
2026-03-29 18:44:30 [auto1.de] INFO: Scrape type for UN89180: 2
2026-03-29 18:44:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fb06940-f82d-57ef-b024-a09fe65c2cbb with identifier: UN89180
2026-03-29 18:44:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb with scrape type 2
2026-03-29 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb with scrape type 2
2026-03-29 18:44:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fb06940-f82d-57ef-b024-a09fe65c2cbb, identifier: UN89180
2026-03-29 18:44:31 [auto1.de] INFO: Found listing with ID: CA87699
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87699%27 HTTP/1.1" 200 None
2026-03-29 18:44:31 [auto1.de] INFO: Scrape type for CA87699: 2
2026-03-29 18:44:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db0dde72-9f6f-5c63-95f4-4778f607db0b with identifier: CA87699
2026-03-29 18:44:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db0dde72-9f6f-5c63-95f4-4778f607db0b with scrape type 2
2026-03-29 18:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db0dde72-9f6f-5c63-95f4-4778f607db0b with scrape type 2
2026-03-29 18:44:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db0dde72-9f6f-5c63-95f4-4778f607db0b, identifier: CA87699
2026-03-29 18:44:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fb06940-f82d-57ef-b024-a09fe65c2cbb with identifier: UN89180
2026-03-29 18:44:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fb06940-f82d-57ef-b024-a09fe65c2cbb with identifier: UN89180
2026-03-29 18:44:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fb06940-f82d-57ef-b024-a09fe65c2cbb with identifier: UN89180 to the API
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:37:55Z',
'fuel_type': 'diesel',
'id': '5fb06940-f82d-57ef-b024-a09fe65c2cbb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN89180',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 181732,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-01',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2017}
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN89180%27 HTTP/1.1" 200 None
2026-03-29 18:44:31 [auto1.de] INFO: Saving data for UN89180: {'auction_closing_time': 1774885075.0, 'created_time': 1774723107.717739, 'last_price_update_time': 1774809871.769426}
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN89180') HTTP/1.1" 204 0
2026-03-29 18:44:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db0dde72-9f6f-5c63-95f4-4778f607db0b with identifier: CA87699
2026-03-29 18:44:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db0dde72-9f6f-5c63-95f4-4778f607db0b with identifier: CA87699
2026-03-29 18:44:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db0dde72-9f6f-5c63-95f4-4778f607db0b with identifier: CA87699 to the API
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:45:24Z',
'fuel_type': 'petrol',
'id': 'db0dde72-9f6f-5c63-95f4-4778f607db0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA87699',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 152396,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-02',
'seller_name': None,
'title': 'Mazda 3 2.0 Center-Line',
'transmission': 'automatic',
'trim': 'Center-Line',
'year': 2014}
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87699%27 HTTP/1.1" 200 None
2026-03-29 18:44:32 [auto1.de] INFO: Saving data for CA87699: {'auction_closing_time': 1774885524.0, 'created_time': 1774002844.024808, 'last_price_update_time': 1774809872.167167}
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA87699') HTTP/1.1" 204 0
2026-03-29 18:44:32 [auto1.de] INFO: Found listing with ID: YH18669
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH18669%27 HTTP/1.1" 200 None
2026-03-29 18:44:32 [auto1.de] INFO: Scrape type for YH18669: 2
2026-03-29 18:44:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 980b4369-f2a0-571f-b5fc-859ae3eb91b5 with identifier: YH18669
2026-03-29 18:44:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 980b4369-f2a0-571f-b5fc-859ae3eb91b5 with scrape type 2
2026-03-29 18:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 980b4369-f2a0-571f-b5fc-859ae3eb91b5 with scrape type 2
2026-03-29 18:44:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 980b4369-f2a0-571f-b5fc-859ae3eb91b5, identifier: YH18669
2026-03-29 18:44:32 [auto1.de] INFO: Found listing with ID: XU33519
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU33519%27 HTTP/1.1" 200 None
2026-03-29 18:44:32 [auto1.de] INFO: Scrape type for XU33519: 2
2026-03-29 18:44:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c197dd9f-3e80-5757-83dd-b2e39551ed79 with identifier: XU33519
2026-03-29 18:44:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c197dd9f-3e80-5757-83dd-b2e39551ed79 with scrape type 2
2026-03-29 18:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c197dd9f-3e80-5757-83dd-b2e39551ed79 with scrape type 2
2026-03-29 18:44:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c197dd9f-3e80-5757-83dd-b2e39551ed79, identifier: XU33519
2026-03-29 18:44:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 980b4369-f2a0-571f-b5fc-859ae3eb91b5 with identifier: YH18669
2026-03-29 18:44:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 980b4369-f2a0-571f-b5fc-859ae3eb91b5 with identifier: YH18669
2026-03-29 18:44:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 980b4369-f2a0-571f-b5fc-859ae3eb91b5 with identifier: YH18669 to the API
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:56:21Z',
'fuel_type': 'petrol',
'id': '980b4369-f2a0-571f-b5fc-859ae3eb91b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH18669',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 181867,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-23',
'seller_name': None,
'title': 'Dacia Sandero 1.2 Ambiance',
'transmission': 'manual',
'trim': 'Ambiance',
'year': 2014}
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH18669%27 HTTP/1.1" 200 None
2026-03-29 18:44:32 [auto1.de] INFO: Saving data for YH18669: {'auction_closing_time': 1774886181.0, 'created_time': 1774723130.72701, 'last_price_update_time': 1774809872.706381}
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH18669') HTTP/1.1" 204 0
2026-03-29 18:44:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c197dd9f-3e80-5757-83dd-b2e39551ed79 with identifier: XU33519
2026-03-29 18:44:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c197dd9f-3e80-5757-83dd-b2e39551ed79 with identifier: XU33519
2026-03-29 18:44:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c197dd9f-3e80-5757-83dd-b2e39551ed79 with identifier: XU33519 to the API
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:07:33Z',
'fuel_type': 'petrol',
'id': 'c197dd9f-3e80-5757-83dd-b2e39551ed79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU33519',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 131228,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-14',
'seller_name': None,
'title': 'Volkswagen Beetle 1.4 TSI Design BlueMotion Tech',
'transmission': 'manual',
'trim': 'Design BlueMotion Tech',
'year': 2015}
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU33519%27 HTTP/1.1" 200 None
2026-03-29 18:44:33 [auto1.de] INFO: Saving data for XU33519: {'auction_closing_time': 1774883253.0, 'created_time': 1773306934.145586, 'last_price_update_time': 1774809873.001355}
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU33519') HTTP/1.1" 204 0
2026-03-29 18:44:33 [auto1.de] INFO: Found listing with ID: EL96080
2026-03-29 18:44:33 [auto1.de] INFO: Found listing with ID: KD63113
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD63113%27 HTTP/1.1" 200 None
2026-03-29 18:44:33 [auto1.de] INFO: Scrape type for KD63113: 2
2026-03-29 18:44:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91fbfd3b-6a4b-5490-8430-5cf09c235677 with identifier: KD63113
2026-03-29 18:44:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91fbfd3b-6a4b-5490-8430-5cf09c235677 with scrape type 2
2026-03-29 18:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91fbfd3b-6a4b-5490-8430-5cf09c235677 with scrape type 2
2026-03-29 18:44:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91fbfd3b-6a4b-5490-8430-5cf09c235677, identifier: KD63113
2026-03-29 18:44:33 [auto1.de] INFO: Found listing with ID: HK31829
2026-03-29 18:44:33 [auto1.de] INFO: Found listing with ID: NK26673
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK26673%27 HTTP/1.1" 200 None
2026-03-29 18:44:33 [auto1.de] INFO: Scrape type for NK26673: 2
2026-03-29 18:44:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea551c45-0267-5902-b613-7e226bab0a90 with identifier: NK26673
2026-03-29 18:44:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea551c45-0267-5902-b613-7e226bab0a90 with scrape type 2
2026-03-29 18:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea551c45-0267-5902-b613-7e226bab0a90 with scrape type 2
2026-03-29 18:44:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea551c45-0267-5902-b613-7e226bab0a90, identifier: NK26673
2026-03-29 18:44:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91fbfd3b-6a4b-5490-8430-5cf09c235677 with identifier: KD63113
2026-03-29 18:44:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91fbfd3b-6a4b-5490-8430-5cf09c235677 with identifier: KD63113
2026-03-29 18:44:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91fbfd3b-6a4b-5490-8430-5cf09c235677 with identifier: KD63113 to the API
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 449,
'expiration_date': '2026-03-30T15:54:23Z',
'fuel_type': 'petrol',
'id': '91fbfd3b-6a4b-5490-8430-5cf09c235677',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD63113',
'listing': 'auction',
'make': 'Ford',
'model': 'Mustang',
'odometer': 34141,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-18',
'seller_name': None,
'title': 'Ford Mustang 5.0 Ti-VCT V8 GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2022}
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD63113%27 HTTP/1.1" 200 None
2026-03-29 18:44:33 [auto1.de] INFO: Saving data for KD63113: {'auction_closing_time': 1774886063.0, 'created_time': 1774723103.836504, 'last_price_update_time': 1774809873.518782}
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD63113') HTTP/1.1" 204 0
2026-03-29 18:44:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea551c45-0267-5902-b613-7e226bab0a90 with identifier: NK26673
2026-03-29 18:44:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea551c45-0267-5902-b613-7e226bab0a90 with identifier: NK26673
2026-03-29 18:44:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea551c45-0267-5902-b613-7e226bab0a90 with identifier: NK26673 to the API
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:01:49Z',
'fuel_type': 'diesel',
'id': 'ea551c45-0267-5902-b613-7e226bab0a90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK26673',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 278263,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-09',
'seller_name': None,
'title': 'Volvo XC60 2.4 D5 Linje Inscription AWD',
'transmission': 'automatic',
'trim': 'Linje Inscription AWD',
'year': 2015}
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK26673%27 HTTP/1.1" 200 None
2026-03-29 18:44:33 [auto1.de] INFO: Saving data for NK26673: {'auction_closing_time': 1774882909.0, 'created_time': 1774723124.015642, 'last_price_update_time': 1774809873.849853}
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK26673') HTTP/1.1" 204 0
2026-03-29 18:44:33 [auto1.de] INFO: Found listing with ID: FL46038
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL46038%27 HTTP/1.1" 200 None
2026-03-29 18:44:33 [auto1.de] INFO: Scrape type for FL46038: 2
2026-03-29 18:44:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da with identifier: FL46038
2026-03-29 18:44:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da with scrape type 2
2026-03-29 18:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da with scrape type 2
2026-03-29 18:44:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da, identifier: FL46038
2026-03-29 18:44:33 [auto1.de] INFO: Found listing with ID: XD40949
2026-03-29 18:44:33 [auto1.de] INFO: Found listing with ID: NM76791
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM76791%27 HTTP/1.1" 200 None
2026-03-29 18:44:33 [auto1.de] INFO: Scrape type for NM76791: 2
2026-03-29 18:44:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08933ff9-a470-533b-965d-ca69f5319d78 with identifier: NM76791
2026-03-29 18:44:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08933ff9-a470-533b-965d-ca69f5319d78 with scrape type 2
2026-03-29 18:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08933ff9-a470-533b-965d-ca69f5319d78 with scrape type 2
2026-03-29 18:44:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08933ff9-a470-533b-965d-ca69f5319d78, identifier: NM76791
2026-03-29 18:44:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da with identifier: FL46038
2026-03-29 18:44:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da with identifier: FL46038
2026-03-29 18:44:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da with identifier: FL46038 to the API
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:22:38Z',
'fuel_type': 'petrol',
'id': '65ff5f2a-66d6-5a28-ab61-cb2cb70f66da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL46038',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 113024,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-08',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2012}
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL46038%27 HTTP/1.1" 200 None
2026-03-29 18:44:34 [auto1.de] INFO: Saving data for FL46038: {'auction_closing_time': 1774884158.0, 'created_time': 1774723128.140135, 'last_price_update_time': 1774809874.387854}
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL46038') HTTP/1.1" 204 0
2026-03-29 18:44:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08933ff9-a470-533b-965d-ca69f5319d78 with identifier: NM76791
2026-03-29 18:44:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08933ff9-a470-533b-965d-ca69f5319d78 with identifier: NM76791
2026-03-29 18:44:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08933ff9-a470-533b-965d-ca69f5319d78 with identifier: NM76791 to the API
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:46:56Z',
'fuel_type': 'diesel',
'id': '08933ff9-a470-533b-965d-ca69f5319d78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM76791',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 141966,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-19',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2014}
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM76791%27 HTTP/1.1" 200 None
2026-03-29 18:44:34 [auto1.de] INFO: Saving data for NM76791: {'auction_closing_time': 1774885616.0, 'created_time': 1774032826.279349, 'last_price_update_time': 1774809874.710623}
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM76791') HTTP/1.1" 204 0
2026-03-29 18:44:34 [auto1.de] INFO: Found listing with ID: NX82618
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX82618%27 HTTP/1.1" 200 None
2026-03-29 18:44:34 [auto1.de] INFO: Scrape type for NX82618: 2
2026-03-29 18:44:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8273e0e-7a50-5fa5-87b8-bc94313ba183 with identifier: NX82618
2026-03-29 18:44:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8273e0e-7a50-5fa5-87b8-bc94313ba183 with scrape type 2
2026-03-29 18:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8273e0e-7a50-5fa5-87b8-bc94313ba183 with scrape type 2
2026-03-29 18:44:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8273e0e-7a50-5fa5-87b8-bc94313ba183, identifier: NX82618
2026-03-29 18:44:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8273e0e-7a50-5fa5-87b8-bc94313ba183 with identifier: NX82618
2026-03-29 18:44:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8273e0e-7a50-5fa5-87b8-bc94313ba183 with identifier: NX82618
2026-03-29 18:44:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8273e0e-7a50-5fa5-87b8-bc94313ba183 with identifier: NX82618 to the API
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:04:14Z',
'fuel_type': 'diesel',
'id': 'a8273e0e-7a50-5fa5-87b8-bc94313ba183',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX82618',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 170050,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-20',
'seller_name': None,
'title': 'BMW 5er 520d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2016}
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX82618%27 HTTP/1.1" 200 None
2026-03-29 18:44:35 [auto1.de] INFO: Saving data for NX82618: {'auction_closing_time': 1774883054.0, 'created_time': 1774033421.526101, 'last_price_update_time': 1774809875.157974}
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX82618') HTTP/1.1" 204 0
2026-03-29 18:44:35 [auto1.de] INFO: Found listing with ID: ZD28041
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28041%27 HTTP/1.1" 200 None
2026-03-29 18:44:35 [auto1.de] INFO: Scrape type for ZD28041: 2
2026-03-29 18:44:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79b82387-3f39-57fc-b664-a1afef5d7ab4 with identifier: ZD28041
2026-03-29 18:44:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79b82387-3f39-57fc-b664-a1afef5d7ab4 with scrape type 2
2026-03-29 18:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79b82387-3f39-57fc-b664-a1afef5d7ab4 with scrape type 2
2026-03-29 18:44:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79b82387-3f39-57fc-b664-a1afef5d7ab4, identifier: ZD28041
2026-03-29 18:44:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79b82387-3f39-57fc-b664-a1afef5d7ab4 with identifier: ZD28041
2026-03-29 18:44:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79b82387-3f39-57fc-b664-a1afef5d7ab4 with identifier: ZD28041
2026-03-29 18:44:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79b82387-3f39-57fc-b664-a1afef5d7ab4 with identifier: ZD28041 to the API
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:23:37Z',
'fuel_type': 'petrol',
'id': '79b82387-3f39-57fc-b664-a1afef5d7ab4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD28041',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 111187,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-18',
'seller_name': None,
'title': 'Hyundai i30 1.4 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2013}
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28041%27 HTTP/1.1" 200 None
2026-03-29 18:44:35 [auto1.de] INFO: Saving data for ZD28041: {'auction_closing_time': 1774884217.0, 'created_time': 1773467504.553741, 'last_price_update_time': 1774809875.553173}
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD28041') HTTP/1.1" 204 0
2026-03-29 18:44:35 [auto1.de] INFO: Found listing with ID: LK56613
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK56613%27 HTTP/1.1" 200 None
2026-03-29 18:44:35 [auto1.de] INFO: Scrape type for LK56613: 2
2026-03-29 18:44:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afb22574-3f38-5863-b9e4-e198658a431c with identifier: LK56613
2026-03-29 18:44:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afb22574-3f38-5863-b9e4-e198658a431c with scrape type 2
2026-03-29 18:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afb22574-3f38-5863-b9e4-e198658a431c with scrape type 2
2026-03-29 18:44:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afb22574-3f38-5863-b9e4-e198658a431c, identifier: LK56613
2026-03-29 18:44:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afb22574-3f38-5863-b9e4-e198658a431c with identifier: LK56613
2026-03-29 18:44:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afb22574-3f38-5863-b9e4-e198658a431c with identifier: LK56613
2026-03-29 18:44:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afb22574-3f38-5863-b9e4-e198658a431c with identifier: LK56613 to the API
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 550,
'expiration_date': '2026-03-30T15:03:49Z',
'fuel_type': 'petrol',
'id': 'afb22574-3f38-5863-b9e4-e198658a431c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK56613',
'listing': 'auction',
'make': 'Jaguar',
'model': 'F-TYPE',
'odometer': 126215,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-30',
'seller_name': None,
'title': 'Jaguar F-TYPE 5.0 V8 R AWD',
'transmission': 'automatic',
'trim': 'R AWD',
'year': 2016}
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK56613%27 HTTP/1.1" 200 None
2026-03-29 18:44:36 [auto1.de] INFO: Saving data for LK56613: {'auction_closing_time': 1774883029.0, 'created_time': 1774723104.264065, 'last_price_update_time': 1774809876.075448}
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK56613') HTTP/1.1" 204 0
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: DS29172
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: WE31393
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: CC29120
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: FT90380
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: SA04539
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: KV17598
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV17598%27 HTTP/1.1" 200 None
2026-03-29 18:44:36 [auto1.de] INFO: Scrape type for KV17598: 2
2026-03-29 18:44:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcdb427a-16cc-5853-abb5-e19121cdde3a with identifier: KV17598
2026-03-29 18:44:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcdb427a-16cc-5853-abb5-e19121cdde3a with scrape type 2
2026-03-29 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcdb427a-16cc-5853-abb5-e19121cdde3a with scrape type 2
2026-03-29 18:44:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcdb427a-16cc-5853-abb5-e19121cdde3a, identifier: KV17598
2026-03-29 18:44:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcdb427a-16cc-5853-abb5-e19121cdde3a with identifier: KV17598
2026-03-29 18:44:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcdb427a-16cc-5853-abb5-e19121cdde3a with identifier: KV17598
2026-03-29 18:44:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcdb427a-16cc-5853-abb5-e19121cdde3a with identifier: KV17598 to the API
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:17:25Z',
'fuel_type': 'petrol',
'id': 'fcdb427a-16cc-5853-abb5-e19121cdde3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV17598',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 69320,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-29',
'seller_name': None,
'title': 'Skoda Fabia 1.0 MPI Soleil',
'transmission': 'manual',
'trim': 'Soleil',
'year': 2019}
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV17598%27 HTTP/1.1" 200 None
2026-03-29 18:44:36 [auto1.de] INFO: Saving data for KV17598: {'auction_closing_time': 1774883845.0, 'created_time': 1774723110.620468, 'last_price_update_time': 1774809876.477915}
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV17598') HTTP/1.1" 204 0
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: TV41751
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: HX78633
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX78633%27 HTTP/1.1" 200 None
2026-03-29 18:44:36 [auto1.de] INFO: Scrape type for HX78633: 2
2026-03-29 18:44:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f800f70-39ce-526b-81f0-6f37b93eb330 with identifier: HX78633
2026-03-29 18:44:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f800f70-39ce-526b-81f0-6f37b93eb330 with scrape type 2
2026-03-29 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f800f70-39ce-526b-81f0-6f37b93eb330 with scrape type 2
2026-03-29 18:44:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f800f70-39ce-526b-81f0-6f37b93eb330, identifier: HX78633
2026-03-29 18:44:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f800f70-39ce-526b-81f0-6f37b93eb330 with identifier: HX78633
2026-03-29 18:44:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f800f70-39ce-526b-81f0-6f37b93eb330 with identifier: HX78633
2026-03-29 18:44:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f800f70-39ce-526b-81f0-6f37b93eb330 with identifier: HX78633 to the API
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:07:59Z',
'fuel_type': 'petrol',
'id': '6f800f70-39ce-526b-81f0-6f37b93eb330',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX78633',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 101454,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-11',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2017}
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX78633%27 HTTP/1.1" 200 None
2026-03-29 18:44:36 [auto1.de] INFO: Saving data for HX78633: {'auction_closing_time': 1774883279.0, 'created_time': 1774032876.147342, 'last_price_update_time': 1774809876.873439}
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX78633') HTTP/1.1" 204 0
2026-03-29 18:44:36 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: TE40935
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: GY13468
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: GY83312
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83312%27 HTTP/1.1" 200 None
2026-03-29 18:44:36 [auto1.de] INFO: Scrape type for GY83312: 2
2026-03-29 18:44:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1338f07-e6d1-549a-bfe3-13adfc570814 with identifier: GY83312
2026-03-29 18:44:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1338f07-e6d1-549a-bfe3-13adfc570814 with scrape type 2
2026-03-29 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1338f07-e6d1-549a-bfe3-13adfc570814 with scrape type 2
2026-03-29 18:44:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1338f07-e6d1-549a-bfe3-13adfc570814, identifier: GY83312
2026-03-29 18:44:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1338f07-e6d1-549a-bfe3-13adfc570814 with identifier: GY83312
2026-03-29 18:44:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1338f07-e6d1-549a-bfe3-13adfc570814 with identifier: GY83312
2026-03-29 18:44:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1338f07-e6d1-549a-bfe3-13adfc570814 with identifier: GY83312 to the API
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:13:11Z',
'fuel_type': 'diesel',
'id': 'a1338f07-e6d1-549a-bfe3-13adfc570814',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY83312',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 155938,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-08',
'seller_name': None,
'title': 'Hyundai Tucson 2.0 CRDi Intro Edition 4WD',
'transmission': 'manual',
'trim': 'Intro Edition 4WD',
'year': 2016}
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83312%27 HTTP/1.1" 200 None
2026-03-29 18:44:37 [auto1.de] INFO: Saving data for GY83312: {'auction_closing_time': 1774883591.0, 'created_time': 1773340640.73296, 'last_price_update_time': 1774809877.343218}
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY83312') HTTP/1.1" 204 0
2026-03-29 18:44:37 [auto1.de] INFO: Found listing with ID: JX30830
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX30830%27 HTTP/1.1" 200 None
2026-03-29 18:44:37 [auto1.de] INFO: Scrape type for JX30830: 2
2026-03-29 18:44:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd762ccb-97d1-5580-93e5-cd537b5f9ea0 with identifier: JX30830
2026-03-29 18:44:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd762ccb-97d1-5580-93e5-cd537b5f9ea0 with scrape type 2
2026-03-29 18:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd762ccb-97d1-5580-93e5-cd537b5f9ea0 with scrape type 2
2026-03-29 18:44:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd762ccb-97d1-5580-93e5-cd537b5f9ea0, identifier: JX30830
2026-03-29 18:44:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:37 [auto1.de] INFO: Found listing with ID: BG42804
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG42804%27 HTTP/1.1" 200 None
2026-03-29 18:44:37 [auto1.de] INFO: Scrape type for BG42804: 2
2026-03-29 18:44:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 327845dc-8708-5969-b7b7-75cb2251fa87 with identifier: BG42804
2026-03-29 18:44:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 327845dc-8708-5969-b7b7-75cb2251fa87 with scrape type 2
2026-03-29 18:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 327845dc-8708-5969-b7b7-75cb2251fa87 with scrape type 2
2026-03-29 18:44:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 327845dc-8708-5969-b7b7-75cb2251fa87, identifier: BG42804
2026-03-29 18:44:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd762ccb-97d1-5580-93e5-cd537b5f9ea0 with identifier: JX30830
2026-03-29 18:44:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd762ccb-97d1-5580-93e5-cd537b5f9ea0 with identifier: JX30830
2026-03-29 18:44:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd762ccb-97d1-5580-93e5-cd537b5f9ea0 with identifier: JX30830 to the API
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:17:05Z',
'fuel_type': 'petrol',
'id': 'fd762ccb-97d1-5580-93e5-cd537b5f9ea0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX30830',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 148460,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-10-22',
'seller_name': None,
'title': 'Volkswagen Golf V 1.4 TSI GT Sport',
'transmission': 'manual',
'trim': 'GT Sport',
'year': 2007}
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX30830%27 HTTP/1.1" 200 None
2026-03-29 18:44:37 [auto1.de] INFO: Saving data for JX30830: {'auction_closing_time': 1774883825.0, 'created_time': 1774723102.497863, 'last_price_update_time': 1774809877.972907}
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX30830') HTTP/1.1" 204 0
2026-03-29 18:44:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 327845dc-8708-5969-b7b7-75cb2251fa87 with identifier: BG42804
2026-03-29 18:44:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 327845dc-8708-5969-b7b7-75cb2251fa87 with identifier: BG42804
2026-03-29 18:44:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 327845dc-8708-5969-b7b7-75cb2251fa87 with identifier: BG42804 to the API
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:34:37Z',
'fuel_type': 'hybrid',
'id': '327845dc-8708-5969-b7b7-75cb2251fa87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG42804',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 140087,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-28',
'seller_name': None,
'title': 'Toyota Yaris 1.5 Hybrid Team D',
'transmission': 'automatic',
'trim': 'Team D',
'year': 2022}
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG42804%27 HTTP/1.1" 200 None
2026-03-29 18:44:38 [auto1.de] INFO: Saving data for BG42804: {'auction_closing_time': 1774884877.0, 'created_time': 1774723114.979672, 'last_price_update_time': 1774809878.273927}
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG42804') HTTP/1.1" 204 0
2026-03-29 18:44:38 [auto1.de] INFO: Found listing with ID: EC85375
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC85375%27 HTTP/1.1" 200 None
2026-03-29 18:44:38 [auto1.de] INFO: Scrape type for EC85375: 2
2026-03-29 18:44:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d00fc2ae-8ac7-5bd9-be44-60353de5b84c with identifier: EC85375
2026-03-29 18:44:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d00fc2ae-8ac7-5bd9-be44-60353de5b84c with scrape type 2
2026-03-29 18:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d00fc2ae-8ac7-5bd9-be44-60353de5b84c with scrape type 2
2026-03-29 18:44:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d00fc2ae-8ac7-5bd9-be44-60353de5b84c, identifier: EC85375
2026-03-29 18:44:38 [auto1.de] INFO: Found listing with ID: GM83626
2026-03-29 18:44:38 [auto1.de] INFO: Found listing with ID: HG43188
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG43188%27 HTTP/1.1" 200 None
2026-03-29 18:44:38 [auto1.de] INFO: Scrape type for HG43188: 2
2026-03-29 18:44:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45dec50c-ac33-5893-96d7-8a020af7a3b5 with identifier: HG43188
2026-03-29 18:44:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45dec50c-ac33-5893-96d7-8a020af7a3b5 with scrape type 2
2026-03-29 18:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45dec50c-ac33-5893-96d7-8a020af7a3b5 with scrape type 2
2026-03-29 18:44:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45dec50c-ac33-5893-96d7-8a020af7a3b5, identifier: HG43188
2026-03-29 18:44:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d00fc2ae-8ac7-5bd9-be44-60353de5b84c with identifier: EC85375
2026-03-29 18:44:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d00fc2ae-8ac7-5bd9-be44-60353de5b84c with identifier: EC85375
2026-03-29 18:44:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d00fc2ae-8ac7-5bd9-be44-60353de5b84c with identifier: EC85375 to the API
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 103,
'expiration_date': '2026-03-30T15:17:44Z',
'fuel_type': 'petrol',
'id': 'd00fc2ae-8ac7-5bd9-be44-60353de5b84c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC85375',
'listing': 'auction',
'make': 'Mazda',
'model': '2',
'odometer': 157956,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-30',
'seller_name': None,
'title': 'Mazda 2 1.5 Independence',
'transmission': 'manual',
'trim': 'Independence',
'year': 2010}
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC85375%27 HTTP/1.1" 200 None
2026-03-29 18:44:38 [auto1.de] INFO: Saving data for EC85375: {'auction_closing_time': 1774883864.0, 'created_time': 1774032323.093602, 'last_price_update_time': 1774809878.78425}
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC85375') HTTP/1.1" 204 0
2026-03-29 18:44:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45dec50c-ac33-5893-96d7-8a020af7a3b5 with identifier: HG43188
2026-03-29 18:44:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45dec50c-ac33-5893-96d7-8a020af7a3b5 with identifier: HG43188
2026-03-29 18:44:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45dec50c-ac33-5893-96d7-8a020af7a3b5 with identifier: HG43188 to the API
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:51:47Z',
'fuel_type': 'diesel',
'id': '45dec50c-ac33-5893-96d7-8a020af7a3b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG43188',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 252957,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-05',
'seller_name': None,
'title': 'Opel Zafira Tourer 2.0 CDTI Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2014}
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG43188%27 HTTP/1.1" 200 None
2026-03-29 18:44:39 [auto1.de] INFO: Saving data for HG43188: {'auction_closing_time': 1774885907.0, 'created_time': 1774723097.462095, 'last_price_update_time': 1774809879.081996}
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG43188') HTTP/1.1" 204 0
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: NN03303
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: VX97978
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX97978%27 HTTP/1.1" 200 None
2026-03-29 18:44:39 [auto1.de] INFO: Scrape type for VX97978: 2
2026-03-29 18:44:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6f485d5-d118-56c5-bd8b-9d05d392db74 with identifier: VX97978
2026-03-29 18:44:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6f485d5-d118-56c5-bd8b-9d05d392db74 with scrape type 2
2026-03-29 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6f485d5-d118-56c5-bd8b-9d05d392db74 with scrape type 2
2026-03-29 18:44:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6f485d5-d118-56c5-bd8b-9d05d392db74, identifier: VX97978
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: CW85183
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW85183%27 HTTP/1.1" 200 None
2026-03-29 18:44:39 [auto1.de] INFO: Scrape type for CW85183: 2
2026-03-29 18:44:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6712172-10f3-5907-b451-656f07af9e82 with identifier: CW85183
2026-03-29 18:44:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6712172-10f3-5907-b451-656f07af9e82 with scrape type 2
2026-03-29 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6712172-10f3-5907-b451-656f07af9e82 with scrape type 2
2026-03-29 18:44:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6712172-10f3-5907-b451-656f07af9e82, identifier: CW85183
2026-03-29 18:44:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6f485d5-d118-56c5-bd8b-9d05d392db74 with identifier: VX97978
2026-03-29 18:44:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6f485d5-d118-56c5-bd8b-9d05d392db74 with identifier: VX97978
2026-03-29 18:44:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6f485d5-d118-56c5-bd8b-9d05d392db74 with identifier: VX97978 to the API
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-30T15:32:16Z',
'fuel_type': 'petrol',
'id': 'd6f485d5-d118-56c5-bd8b-9d05d392db74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX97978',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 135389,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-08-30',
'seller_name': None,
'title': 'Suzuki Swift 1.3 Club',
'transmission': 'manual',
'trim': 'Club',
'year': 2007}
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX97978%27 HTTP/1.1" 200 None
2026-03-29 18:44:39 [auto1.de] INFO: Saving data for VX97978: {'auction_closing_time': 1774884736.0, 'created_time': 1773467153.96284, 'last_price_update_time': 1774809879.571483}
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX97978') HTTP/1.1" 204 0
2026-03-29 18:44:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6712172-10f3-5907-b451-656f07af9e82 with identifier: CW85183
2026-03-29 18:44:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6712172-10f3-5907-b451-656f07af9e82 with identifier: CW85183
2026-03-29 18:44:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6712172-10f3-5907-b451-656f07af9e82 with identifier: CW85183 to the API
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:56:05Z',
'fuel_type': 'diesel',
'id': 'd6712172-10f3-5907-b451-656f07af9e82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW85183',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 207154,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-22',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW85183%27 HTTP/1.1" 200 None
2026-03-29 18:44:39 [auto1.de] INFO: Saving data for CW85183: {'auction_closing_time': 1774886165.0, 'created_time': 1774723115.379515, 'last_price_update_time': 1774809879.868304}
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW85183') HTTP/1.1" 204 0
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: LB43778
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: ED69500
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED69500%27 HTTP/1.1" 200 None
2026-03-29 18:44:39 [auto1.de] INFO: Scrape type for ED69500: 2
2026-03-29 18:44:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cf4e678-380e-5396-9dc9-4a4a967d1161 with identifier: ED69500
2026-03-29 18:44:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cf4e678-380e-5396-9dc9-4a4a967d1161 with scrape type 2
2026-03-29 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cf4e678-380e-5396-9dc9-4a4a967d1161 with scrape type 2
2026-03-29 18:44:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cf4e678-380e-5396-9dc9-4a4a967d1161, identifier: ED69500
2026-03-29 18:44:40 [auto1.de] INFO: Found listing with ID: NP47731
2026-03-29 18:44:40 [auto1.de] INFO: Found listing with ID: KV68719
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV68719%27 HTTP/1.1" 200 None
2026-03-29 18:44:40 [auto1.de] INFO: Scrape type for KV68719: 2
2026-03-29 18:44:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54013860-46d6-5195-9db8-7e03037465bc with identifier: KV68719
2026-03-29 18:44:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54013860-46d6-5195-9db8-7e03037465bc with scrape type 2
2026-03-29 18:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54013860-46d6-5195-9db8-7e03037465bc with scrape type 2
2026-03-29 18:44:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54013860-46d6-5195-9db8-7e03037465bc, identifier: KV68719
2026-03-29 18:44:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cf4e678-380e-5396-9dc9-4a4a967d1161 with identifier: ED69500
2026-03-29 18:44:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cf4e678-380e-5396-9dc9-4a4a967d1161 with identifier: ED69500
2026-03-29 18:44:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cf4e678-380e-5396-9dc9-4a4a967d1161 with identifier: ED69500 to the API
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:35:59Z',
'fuel_type': 'petrol',
'id': '3cf4e678-380e-5396-9dc9-4a4a967d1161',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED69500',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 78683,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-27',
'seller_name': None,
'title': 'Peugeot 207 1.4 VTi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2012}
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED69500%27 HTTP/1.1" 200 None
2026-03-29 18:44:40 [auto1.de] INFO: Saving data for ED69500: {'auction_closing_time': 1774884959.0, 'created_time': 1773400177.767628, 'last_price_update_time': 1774809880.38135}
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED69500') HTTP/1.1" 204 0
2026-03-29 18:44:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54013860-46d6-5195-9db8-7e03037465bc with identifier: KV68719
2026-03-29 18:44:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54013860-46d6-5195-9db8-7e03037465bc with identifier: KV68719
2026-03-29 18:44:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54013860-46d6-5195-9db8-7e03037465bc with identifier: KV68719 to the API
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:38:17Z',
'fuel_type': 'petrol',
'id': '54013860-46d6-5195-9db8-7e03037465bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV68719',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 222142,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-03-04',
'seller_name': None,
'title': 'Audi A4 2.0 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2008}
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV68719%27 HTTP/1.1" 200 None
2026-03-29 18:44:40 [auto1.de] INFO: Saving data for KV68719: {'auction_closing_time': 1774885097.0, 'created_time': 1774723101.394687, 'last_price_update_time': 1774809880.773864}
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV68719') HTTP/1.1" 204 0
2026-03-29 18:44:40 [auto1.de] INFO: Found listing with ID: HC86157
2026-03-29 18:44:40 [auto1.de] INFO: Found listing with ID: AN99140
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN99140%27 HTTP/1.1" 200 None
2026-03-29 18:44:40 [auto1.de] INFO: Scrape type for AN99140: 2
2026-03-29 18:44:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0f532b4-b525-51ff-a333-0a0579dcf330 with identifier: AN99140
2026-03-29 18:44:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0f532b4-b525-51ff-a333-0a0579dcf330 with scrape type 2
2026-03-29 18:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0f532b4-b525-51ff-a333-0a0579dcf330 with scrape type 2
2026-03-29 18:44:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0f532b4-b525-51ff-a333-0a0579dcf330, identifier: AN99140
2026-03-29 18:44:40 [auto1.de] INFO: Found listing with ID: JP17422
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP17422%27 HTTP/1.1" 200 None
2026-03-29 18:44:40 [auto1.de] INFO: Scrape type for JP17422: 2
2026-03-29 18:44:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfa59ca2-9092-5d9b-ad4d-57251afabb46 with identifier: JP17422
2026-03-29 18:44:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfa59ca2-9092-5d9b-ad4d-57251afabb46 with scrape type 2
2026-03-29 18:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfa59ca2-9092-5d9b-ad4d-57251afabb46 with scrape type 2
2026-03-29 18:44:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bfa59ca2-9092-5d9b-ad4d-57251afabb46, identifier: JP17422
2026-03-29 18:44:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0f532b4-b525-51ff-a333-0a0579dcf330 with identifier: AN99140
2026-03-29 18:44:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0f532b4-b525-51ff-a333-0a0579dcf330 with identifier: AN99140
2026-03-29 18:44:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0f532b4-b525-51ff-a333-0a0579dcf330 with identifier: AN99140 to the API
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:04:31Z',
'fuel_type': 'petrol',
'id': 'd0f532b4-b525-51ff-a333-0a0579dcf330',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN99140',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 46494,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-20',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN99140%27 HTTP/1.1" 200 None
2026-03-29 18:44:41 [auto1.de] INFO: Saving data for AN99140: {'auction_closing_time': 1774883071.0, 'created_time': 1774002402.66474, 'last_price_update_time': 1774809881.333011}
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN99140') HTTP/1.1" 204 0
2026-03-29 18:44:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bfa59ca2-9092-5d9b-ad4d-57251afabb46 with identifier: JP17422
2026-03-29 18:44:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bfa59ca2-9092-5d9b-ad4d-57251afabb46 with identifier: JP17422
2026-03-29 18:44:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bfa59ca2-9092-5d9b-ad4d-57251afabb46 with identifier: JP17422 to the API
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:18:33Z',
'fuel_type': 'petrol',
'id': 'bfa59ca2-9092-5d9b-ad4d-57251afabb46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP17422',
'listing': 'auction',
'make': 'Nissan',
'model': 'Pulsar',
'odometer': 194921,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-08',
'seller_name': None,
'title': 'Nissan Pulsar 1.2 Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2018}
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP17422%27 HTTP/1.1" 200 None
2026-03-29 18:44:41 [auto1.de] INFO: Saving data for JP17422: {'auction_closing_time': 1774883913.0, 'created_time': 1773466955.848406, 'last_price_update_time': 1774809881.626541}
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP17422') HTTP/1.1" 204 0
2026-03-29 18:44:41 [auto1.de] INFO: Found listing with ID: FD40697
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD40697%27 HTTP/1.1" 200 None
2026-03-29 18:44:41 [auto1.de] INFO: Scrape type for FD40697: 2
2026-03-29 18:44:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 532327ad-702b-5c8b-9114-da01ba67ec6a with identifier: FD40697
2026-03-29 18:44:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 532327ad-702b-5c8b-9114-da01ba67ec6a with scrape type 2
2026-03-29 18:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 532327ad-702b-5c8b-9114-da01ba67ec6a with scrape type 2
2026-03-29 18:44:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 532327ad-702b-5c8b-9114-da01ba67ec6a, identifier: FD40697
2026-03-29 18:44:41 [auto1.de] INFO: Found listing with ID: GJ18953
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ18953%27 HTTP/1.1" 200 None
2026-03-29 18:44:41 [auto1.de] INFO: Scrape type for GJ18953: 2
2026-03-29 18:44:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 392ce6f0-1e5b-5695-8f94-a24c39110444 with identifier: GJ18953
2026-03-29 18:44:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 392ce6f0-1e5b-5695-8f94-a24c39110444 with scrape type 2
2026-03-29 18:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 392ce6f0-1e5b-5695-8f94-a24c39110444 with scrape type 2
2026-03-29 18:44:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 392ce6f0-1e5b-5695-8f94-a24c39110444, identifier: GJ18953
2026-03-29 18:44:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 532327ad-702b-5c8b-9114-da01ba67ec6a with identifier: FD40697
2026-03-29 18:44:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 532327ad-702b-5c8b-9114-da01ba67ec6a with identifier: FD40697
2026-03-29 18:44:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 532327ad-702b-5c8b-9114-da01ba67ec6a with identifier: FD40697 to the API
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:12:36Z',
'fuel_type': 'petrol',
'id': '532327ad-702b-5c8b-9114-da01ba67ec6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD40697',
'listing': 'auction',
'make': 'Mazda',
'model': '2',
'odometer': 28791,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-06',
'seller_name': None,
'title': 'Mazda 2 1.5 Kizoku',
'transmission': 'manual',
'trim': 'Kizoku',
'year': 2019}
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD40697%27 HTTP/1.1" 200 None
2026-03-29 18:44:42 [auto1.de] INFO: Saving data for FD40697: {'auction_closing_time': 1774883556.0, 'created_time': 1774723172.772274, 'last_price_update_time': 1774809882.224535}
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD40697') HTTP/1.1" 204 0
2026-03-29 18:44:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 392ce6f0-1e5b-5695-8f94-a24c39110444 with identifier: GJ18953
2026-03-29 18:44:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 392ce6f0-1e5b-5695-8f94-a24c39110444 with identifier: GJ18953
2026-03-29 18:44:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 392ce6f0-1e5b-5695-8f94-a24c39110444 with identifier: GJ18953 to the API
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:36:22Z',
'fuel_type': 'petrol',
'id': '392ce6f0-1e5b-5695-8f94-a24c39110444',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ18953',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 75421,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-22',
'seller_name': None,
'title': 'Toyota Yaris 1.0 VVT-i Cool',
'transmission': 'manual',
'trim': 'Cool',
'year': 2009}
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ18953%27 HTTP/1.1" 200 None
2026-03-29 18:44:42 [auto1.de] INFO: Saving data for GJ18953: {'auction_closing_time': 1774884982.0, 'created_time': 1774723167.195632, 'last_price_update_time': 1774809882.505402}
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ18953') HTTP/1.1" 204 0
2026-03-29 18:44:42 [auto1.de] INFO: Found listing with ID: UK28270
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28270%27 HTTP/1.1" 200 None
2026-03-29 18:44:42 [auto1.de] INFO: Scrape type for UK28270: 2
2026-03-29 18:44:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef21c165-76d9-5102-9f85-0a741d1a19f0 with identifier: UK28270
2026-03-29 18:44:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef21c165-76d9-5102-9f85-0a741d1a19f0 with scrape type 2
2026-03-29 18:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef21c165-76d9-5102-9f85-0a741d1a19f0 with scrape type 2
2026-03-29 18:44:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef21c165-76d9-5102-9f85-0a741d1a19f0, identifier: UK28270
2026-03-29 18:44:42 [auto1.de] INFO: Found listing with ID: GR83992
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR83992%27 HTTP/1.1" 200 None
2026-03-29 18:44:42 [auto1.de] INFO: Scrape type for GR83992: 2
2026-03-29 18:44:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5 with identifier: GR83992
2026-03-29 18:44:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5 with scrape type 2
2026-03-29 18:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5 with scrape type 2
2026-03-29 18:44:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5, identifier: GR83992
2026-03-29 18:44:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef21c165-76d9-5102-9f85-0a741d1a19f0 with identifier: UK28270
2026-03-29 18:44:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef21c165-76d9-5102-9f85-0a741d1a19f0 with identifier: UK28270
2026-03-29 18:44:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef21c165-76d9-5102-9f85-0a741d1a19f0 with identifier: UK28270 to the API
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:44:16Z',
'fuel_type': 'hybrid',
'id': 'ef21c165-76d9-5102-9f85-0a741d1a19f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK28270',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 116459,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-10',
'seller_name': None,
'title': 'Skoda Superb 1.4 Plug-in Hybrid Style iV',
'transmission': 'automatic',
'trim': 'Style iV',
'year': 2020}
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28270%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Saving data for UK28270: {'auction_closing_time': 1774885456.0, 'created_time': 1774349034.900698, 'last_price_update_time': 1774809883.065074}
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK28270') HTTP/1.1" 204 0
2026-03-29 18:44:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5 with identifier: GR83992
2026-03-29 18:44:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5 with identifier: GR83992
2026-03-29 18:44:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5 with identifier: GR83992 to the API
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:00:55Z',
'fuel_type': 'diesel',
'id': '6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR83992',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 168105,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-18',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI Innovation Start/Stop',
'transmission': 'manual',
'trim': 'Innovation Start/Stop',
'year': 2019}
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR83992%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Saving data for GR83992: {'auction_closing_time': 1774882855.0, 'created_time': 1774723169.102785, 'last_price_update_time': 1774809883.361848}
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR83992') HTTP/1.1" 204 0
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: TM32674
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: UG29438
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG29438%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Scrape type for UG29438: 2
2026-03-29 18:44:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f819c8c-1d31-5467-8b47-fd3748c1d0e1 with identifier: UG29438
2026-03-29 18:44:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1 with scrape type 2
2026-03-29 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1 with scrape type 2
2026-03-29 18:44:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f819c8c-1d31-5467-8b47-fd3748c1d0e1, identifier: UG29438
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: JJ86463
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: BV89454
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV89454%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Scrape type for BV89454: 2
2026-03-29 18:44:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b06400e5-91ce-5ce0-9773-19f871822648 with identifier: BV89454
2026-03-29 18:44:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b06400e5-91ce-5ce0-9773-19f871822648 with scrape type 2
2026-03-29 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b06400e5-91ce-5ce0-9773-19f871822648 with scrape type 2
2026-03-29 18:44:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b06400e5-91ce-5ce0-9773-19f871822648, identifier: BV89454
2026-03-29 18:44:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f819c8c-1d31-5467-8b47-fd3748c1d0e1 with identifier: UG29438
2026-03-29 18:44:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f819c8c-1d31-5467-8b47-fd3748c1d0e1 with identifier: UG29438
2026-03-29 18:44:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f819c8c-1d31-5467-8b47-fd3748c1d0e1 with identifier: UG29438 to the API
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:16:04Z',
'fuel_type': 'petrol',
'id': '8f819c8c-1d31-5467-8b47-fd3748c1d0e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG29438',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 23402,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-15',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 CGI BlueEfficiency Elegance',
'transmission': 'automatic',
'trim': 'BlueEfficiency Elegance',
'year': 2011}
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG29438%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Saving data for UG29438: {'auction_closing_time': 1774883764.0, 'created_time': 1774723111.92646, 'last_price_update_time': 1774809883.869667}
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG29438') HTTP/1.1" 204 0
2026-03-29 18:44:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b06400e5-91ce-5ce0-9773-19f871822648 with identifier: BV89454
2026-03-29 18:44:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b06400e5-91ce-5ce0-9773-19f871822648 with identifier: BV89454
2026-03-29 18:44:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b06400e5-91ce-5ce0-9773-19f871822648 with identifier: BV89454 to the API
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-30T15:36:58Z',
'fuel_type': 'petrol',
'id': 'b06400e5-91ce-5ce0-9773-19f871822648',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV89454',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 189699,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-08',
'seller_name': None,
'title': 'Citroen C3 1.4 Tonic',
'transmission': 'manual',
'trim': 'Tonic',
'year': 2009}
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV89454%27 HTTP/1.1" 200 None
2026-03-29 18:44:44 [auto1.de] INFO: Saving data for BV89454: {'auction_closing_time': 1774885018.0, 'created_time': 1774349516.343567, 'last_price_update_time': 1774809884.259508}
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV89454') HTTP/1.1" 204 0
2026-03-29 18:44:44 [auto1.de] INFO: Found listing with ID: NY30954
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY30954%27 HTTP/1.1" 200 None
2026-03-29 18:44:44 [auto1.de] INFO: Scrape type for NY30954: 2
2026-03-29 18:44:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfe25d2f-e968-5447-a2bd-ce1d0dc23b05 with identifier: NY30954
2026-03-29 18:44:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfe25d2f-e968-5447-a2bd-ce1d0dc23b05 with scrape type 2
2026-03-29 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfe25d2f-e968-5447-a2bd-ce1d0dc23b05 with scrape type 2
2026-03-29 18:44:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfe25d2f-e968-5447-a2bd-ce1d0dc23b05, identifier: NY30954
2026-03-29 18:44:44 [auto1.de] INFO: Found listing with ID: MX21840
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX21840%27 HTTP/1.1" 200 None
2026-03-29 18:44:44 [auto1.de] INFO: Scrape type for MX21840: 2
2026-03-29 18:44:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3a25024-0e37-5a46-9b5b-91027aade4ba with identifier: MX21840
2026-03-29 18:44:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3a25024-0e37-5a46-9b5b-91027aade4ba with scrape type 2
2026-03-29 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3a25024-0e37-5a46-9b5b-91027aade4ba with scrape type 2
2026-03-29 18:44:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3a25024-0e37-5a46-9b5b-91027aade4ba, identifier: MX21840
2026-03-29 18:44:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfe25d2f-e968-5447-a2bd-ce1d0dc23b05 with identifier: NY30954
2026-03-29 18:44:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfe25d2f-e968-5447-a2bd-ce1d0dc23b05 with identifier: NY30954
2026-03-29 18:44:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfe25d2f-e968-5447-a2bd-ce1d0dc23b05 with identifier: NY30954 to the API
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:30:03Z',
'fuel_type': 'diesel',
'id': 'cfe25d2f-e968-5447-a2bd-ce1d0dc23b05',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY30954',
'listing': 'auction',
'make': 'MINI',
'model': 'Clubman',
'odometer': 118299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-08',
'seller_name': None,
'title': 'MINI Clubman Cooper SD ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2018}
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY30954%27 HTTP/1.1" 200 None
2026-03-29 18:44:44 [auto1.de] INFO: Saving data for NY30954: {'auction_closing_time': 1774884603.0, 'created_time': 1774723122.415777, 'last_price_update_time': 1774809884.797639}
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY30954') HTTP/1.1" 204 0
2026-03-29 18:44:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3a25024-0e37-5a46-9b5b-91027aade4ba with identifier: MX21840
2026-03-29 18:44:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3a25024-0e37-5a46-9b5b-91027aade4ba with identifier: MX21840
2026-03-29 18:44:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3a25024-0e37-5a46-9b5b-91027aade4ba with identifier: MX21840 to the API
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:34:45Z',
'fuel_type': 'petrol',
'id': 'b3a25024-0e37-5a46-9b5b-91027aade4ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX21840',
'listing': 'auction',
'make': 'Skoda',
'model': 'Rapid Spaceback',
'odometer': 114518,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-22',
'seller_name': None,
'title': 'Skoda Rapid Spaceback 1.2 TSI StylePlus',
'transmission': 'manual',
'trim': 'StylePlus',
'year': 2014}
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX21840%27 HTTP/1.1" 200 None
2026-03-29 18:44:45 [auto1.de] INFO: Saving data for MX21840: {'auction_closing_time': 1774884885.0, 'created_time': 1774723182.116302, 'last_price_update_time': 1774809885.088226}
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX21840') HTTP/1.1" 204 0
2026-03-29 18:44:45 [auto1.de] INFO: Found listing with ID: NZ79152
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ79152%27 HTTP/1.1" 200 None
2026-03-29 18:44:45 [auto1.de] INFO: Scrape type for NZ79152: 2
2026-03-29 18:44:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c38c50e-0e07-51ec-bf59-7ab99493dc8c with identifier: NZ79152
2026-03-29 18:44:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c with scrape type 2
2026-03-29 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c with scrape type 2
2026-03-29 18:44:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c38c50e-0e07-51ec-bf59-7ab99493dc8c, identifier: NZ79152
2026-03-29 18:44:45 [auto1.de] INFO: Found listing with ID: DR45963
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR45963%27 HTTP/1.1" 200 None
2026-03-29 18:44:45 [auto1.de] INFO: Scrape type for DR45963: 2
2026-03-29 18:44:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ec509d3-cc6b-526d-a90c-7cbc0c665212 with identifier: DR45963
2026-03-29 18:44:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ec509d3-cc6b-526d-a90c-7cbc0c665212 with scrape type 2
2026-03-29 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ec509d3-cc6b-526d-a90c-7cbc0c665212 with scrape type 2
2026-03-29 18:44:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ec509d3-cc6b-526d-a90c-7cbc0c665212, identifier: DR45963
2026-03-29 18:44:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c38c50e-0e07-51ec-bf59-7ab99493dc8c with identifier: NZ79152
2026-03-29 18:44:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c38c50e-0e07-51ec-bf59-7ab99493dc8c with identifier: NZ79152
2026-03-29 18:44:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c38c50e-0e07-51ec-bf59-7ab99493dc8c with identifier: NZ79152 to the API
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:53:57Z',
'fuel_type': 'petrol',
'id': '3c38c50e-0e07-51ec-bf59-7ab99493dc8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ79152',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 96674,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-20',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2011}
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ79152%27 HTTP/1.1" 200 None
2026-03-29 18:44:45 [auto1.de] INFO: Saving data for NZ79152: {'auction_closing_time': 1774886037.0, 'created_time': 1774723174.778453, 'last_price_update_time': 1774809885.596002}
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ79152') HTTP/1.1" 204 0
2026-03-29 18:44:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ec509d3-cc6b-526d-a90c-7cbc0c665212 with identifier: DR45963
2026-03-29 18:44:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ec509d3-cc6b-526d-a90c-7cbc0c665212 with identifier: DR45963
2026-03-29 18:44:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ec509d3-cc6b-526d-a90c-7cbc0c665212 with identifier: DR45963 to the API
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-30T15:06:30Z',
'fuel_type': 'petrol',
'id': '7ec509d3-cc6b-526d-a90c-7cbc0c665212',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR45963',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 145654,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-08-31',
'seller_name': None,
'title': 'Suzuki Swift 1.3 Dance',
'transmission': 'manual',
'trim': 'Dance',
'year': 2007}
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR45963%27 HTTP/1.1" 200 None
2026-03-29 18:44:45 [auto1.de] INFO: Saving data for DR45963: {'auction_closing_time': 1774883190.0, 'created_time': 1774723122.789598, 'last_price_update_time': 1774809885.881175}
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR45963') HTTP/1.1" 204 0
2026-03-29 18:44:45 [auto1.de] INFO: Found listing with ID: HH84481
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH84481%27 HTTP/1.1" 200 None
2026-03-29 18:44:45 [auto1.de] INFO: Scrape type for HH84481: 2
2026-03-29 18:44:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 918d6851-986f-5c47-9508-5d77ea02efee with identifier: HH84481
2026-03-29 18:44:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 918d6851-986f-5c47-9508-5d77ea02efee with scrape type 2
2026-03-29 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 918d6851-986f-5c47-9508-5d77ea02efee with scrape type 2
2026-03-29 18:44:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 918d6851-986f-5c47-9508-5d77ea02efee, identifier: HH84481
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: UB44378
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: CE18724
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: WN98696
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: RW68722
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW68722%27 HTTP/1.1" 200 None
2026-03-29 18:44:46 [auto1.de] INFO: Scrape type for RW68722: 2
2026-03-29 18:44:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b280a314-9b68-5026-a5dd-2cb64bbac5c5 with identifier: RW68722
2026-03-29 18:44:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b280a314-9b68-5026-a5dd-2cb64bbac5c5 with scrape type 2
2026-03-29 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b280a314-9b68-5026-a5dd-2cb64bbac5c5 with scrape type 2
2026-03-29 18:44:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b280a314-9b68-5026-a5dd-2cb64bbac5c5, identifier: RW68722
2026-03-29 18:44:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 918d6851-986f-5c47-9508-5d77ea02efee with identifier: HH84481
2026-03-29 18:44:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 918d6851-986f-5c47-9508-5d77ea02efee with identifier: HH84481
2026-03-29 18:44:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 918d6851-986f-5c47-9508-5d77ea02efee with identifier: HH84481 to the API
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:08:35Z',
'fuel_type': 'hybrid',
'id': '918d6851-986f-5c47-9508-5d77ea02efee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH84481',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 53438,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-24',
'seller_name': None,
'title': 'BMW X1 xDrive 25e Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2022}
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH84481%27 HTTP/1.1" 200 None
2026-03-29 18:44:46 [auto1.de] INFO: Saving data for HH84481: {'auction_closing_time': 1774883315.0, 'created_time': 1774723182.485562, 'last_price_update_time': 1774809886.452475}
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH84481') HTTP/1.1" 204 0
2026-03-29 18:44:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b280a314-9b68-5026-a5dd-2cb64bbac5c5 with identifier: RW68722
2026-03-29 18:44:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b280a314-9b68-5026-a5dd-2cb64bbac5c5 with identifier: RW68722
2026-03-29 18:44:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b280a314-9b68-5026-a5dd-2cb64bbac5c5 with identifier: RW68722 to the API
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:53:34Z',
'fuel_type': 'petrol',
'id': 'b280a314-9b68-5026-a5dd-2cb64bbac5c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW68722',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 144910,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-28',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Black Edition',
'transmission': 'manual',
'trim': 'Black Edition',
'year': 2013}
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW68722%27 HTTP/1.1" 200 None
2026-03-29 18:44:46 [auto1.de] INFO: Saving data for RW68722: {'auction_closing_time': 1774886014.0, 'created_time': 1774723184.177124, 'last_price_update_time': 1774809886.73792}
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW68722') HTTP/1.1" 204 0
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: AJ75381
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: KA54911
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA54911%27 HTTP/1.1" 200 None
2026-03-29 18:44:46 [auto1.de] INFO: Scrape type for KA54911: 2
2026-03-29 18:44:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d897b9bb-8551-5964-9ce8-4570df9c55fa with identifier: KA54911
2026-03-29 18:44:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d897b9bb-8551-5964-9ce8-4570df9c55fa with scrape type 2
2026-03-29 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d897b9bb-8551-5964-9ce8-4570df9c55fa with scrape type 2
2026-03-29 18:44:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d897b9bb-8551-5964-9ce8-4570df9c55fa, identifier: KA54911
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: YD40390
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: AJ11888
2026-03-29 18:44:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d897b9bb-8551-5964-9ce8-4570df9c55fa with identifier: KA54911
2026-03-29 18:44:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d897b9bb-8551-5964-9ce8-4570df9c55fa with identifier: KA54911
2026-03-29 18:44:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d897b9bb-8551-5964-9ce8-4570df9c55fa with identifier: KA54911 to the API
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:13:38Z',
'fuel_type': 'petrol',
'id': 'd897b9bb-8551-5964-9ce8-4570df9c55fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA54911',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 137843,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-09-26',
'seller_name': None,
'title': 'Volkswagen Golf V 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2007}
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA54911%27 HTTP/1.1" 200 None
2026-03-29 18:44:47 [auto1.de] INFO: Saving data for KA54911: {'auction_closing_time': 1774883618.0, 'created_time': 1774723128.532903, 'last_price_update_time': 1774809887.147612}
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA54911') HTTP/1.1" 204 0
2026-03-29 18:44:47 [auto1.de] INFO: Found listing with ID: TV53465
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV53465%27 HTTP/1.1" 200 None
2026-03-29 18:44:47 [auto1.de] INFO: Scrape type for TV53465: 2
2026-03-29 18:44:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77b69424-bb8b-5763-accf-ed3c86f3729f with identifier: TV53465
2026-03-29 18:44:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77b69424-bb8b-5763-accf-ed3c86f3729f with scrape type 2
2026-03-29 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77b69424-bb8b-5763-accf-ed3c86f3729f with scrape type 2
2026-03-29 18:44:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77b69424-bb8b-5763-accf-ed3c86f3729f, identifier: TV53465
2026-03-29 18:44:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77b69424-bb8b-5763-accf-ed3c86f3729f with identifier: TV53465
2026-03-29 18:44:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77b69424-bb8b-5763-accf-ed3c86f3729f with identifier: TV53465
2026-03-29 18:44:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77b69424-bb8b-5763-accf-ed3c86f3729f with identifier: TV53465 to the API
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:10:59Z',
'fuel_type': 'diesel',
'id': '77b69424-bb8b-5763-accf-ed3c86f3729f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV53465',
'listing': 'auction',
'make': 'Opel',
'model': 'Movano',
'odometer': 105467,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-20',
'seller_name': None,
'title': 'Opel Movano 2.5 CDTI L1H1 Ka 3,5t',
'transmission': 'manual',
'trim': 'L1H1 Ka 3,5t',
'year': 2010}
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV53465%27 HTTP/1.1" 200 None
2026-03-29 18:44:47 [auto1.de] INFO: Saving data for TV53465: {'auction_closing_time': 1774883459.0, 'created_time': 1774723105.561843, 'last_price_update_time': 1774809887.684111}
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV53465') HTTP/1.1" 204 0
2026-03-29 18:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:47 [auto1.de] INFO: Found listing with ID: UP69379
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP69379%27 HTTP/1.1" 200 None
2026-03-29 18:44:47 [auto1.de] INFO: Scrape type for UP69379: 2
2026-03-29 18:44:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fa03297-478c-5b20-a92c-90c36e413862 with identifier: UP69379
2026-03-29 18:44:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fa03297-478c-5b20-a92c-90c36e413862 with scrape type 2
2026-03-29 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fa03297-478c-5b20-a92c-90c36e413862 with scrape type 2
2026-03-29 18:44:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fa03297-478c-5b20-a92c-90c36e413862, identifier: UP69379
2026-03-29 18:44:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fa03297-478c-5b20-a92c-90c36e413862 with identifier: UP69379
2026-03-29 18:44:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fa03297-478c-5b20-a92c-90c36e413862 with identifier: UP69379
2026-03-29 18:44:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fa03297-478c-5b20-a92c-90c36e413862 with identifier: UP69379 to the API
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:10:03Z',
'fuel_type': 'petrol',
'id': '0fa03297-478c-5b20-a92c-90c36e413862',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP69379',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 177767,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-31',
'seller_name': None,
'title': 'Toyota Aygo 1.0 X',
'transmission': 'manual',
'trim': 'X',
'year': 2016}
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP69379%27 HTTP/1.1" 200 None
2026-03-29 18:44:48 [auto1.de] INFO: Saving data for UP69379: {'auction_closing_time': 1774883403.0, 'created_time': 1774379562.115091, 'last_price_update_time': 1774809888.109295}
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP69379') HTTP/1.1" 204 0
2026-03-29 18:44:48 [auto1.de] INFO: Found listing with ID: TP61394
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP61394%27 HTTP/1.1" 200 None
2026-03-29 18:44:48 [auto1.de] INFO: Scrape type for TP61394: 2
2026-03-29 18:44:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5be6b186-7fb6-5c74-8f15-cd3e02ef3595 with identifier: TP61394
2026-03-29 18:44:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5be6b186-7fb6-5c74-8f15-cd3e02ef3595 with scrape type 2
2026-03-29 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5be6b186-7fb6-5c74-8f15-cd3e02ef3595 with scrape type 2
2026-03-29 18:44:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5be6b186-7fb6-5c74-8f15-cd3e02ef3595, identifier: TP61394
2026-03-29 18:44:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5be6b186-7fb6-5c74-8f15-cd3e02ef3595 with identifier: TP61394
2026-03-29 18:44:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5be6b186-7fb6-5c74-8f15-cd3e02ef3595 with identifier: TP61394
2026-03-29 18:44:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5be6b186-7fb6-5c74-8f15-cd3e02ef3595 with identifier: TP61394 to the API
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:51:19Z',
'fuel_type': 'petrol',
'id': '5be6b186-7fb6-5c74-8f15-cd3e02ef3595',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP61394',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 207006,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-01',
'seller_name': None,
'title': 'Skoda Fabia 1.2 Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2009}
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP61394%27 HTTP/1.1" 200 None
2026-03-29 18:44:48 [auto1.de] INFO: Saving data for TP61394: {'auction_closing_time': 1774885879.0, 'created_time': 1774723149.225521, 'last_price_update_time': 1774809888.498017}
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP61394') HTTP/1.1" 204 0
2026-03-29 18:44:48 [auto1.de] INFO: Found listing with ID: SG76993
2026-03-29 18:44:48 [auto1.de] INFO: Found listing with ID: EY95933
2026-03-29 18:44:48 [auto1.de] INFO: Found listing with ID: KR30537
2026-03-29 18:44:48 [auto1.de] INFO: Found listing with ID: BU21003
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU21003%27 HTTP/1.1" 200 None
2026-03-29 18:44:48 [auto1.de] INFO: Scrape type for BU21003: 2
2026-03-29 18:44:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc33c191-2f76-589c-a08b-0648b040af26 with identifier: BU21003
2026-03-29 18:44:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc33c191-2f76-589c-a08b-0648b040af26 with scrape type 2
2026-03-29 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc33c191-2f76-589c-a08b-0648b040af26 with scrape type 2
2026-03-29 18:44:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc33c191-2f76-589c-a08b-0648b040af26, identifier: BU21003
2026-03-29 18:44:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc33c191-2f76-589c-a08b-0648b040af26 with identifier: BU21003
2026-03-29 18:44:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc33c191-2f76-589c-a08b-0648b040af26 with identifier: BU21003
2026-03-29 18:44:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc33c191-2f76-589c-a08b-0648b040af26 with identifier: BU21003 to the API
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:39:18Z',
'fuel_type': 'petrol',
'id': 'bc33c191-2f76-589c-a08b-0648b040af26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU21003',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 113677,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-28',
'seller_name': None,
'title': 'Hyundai i20 1.2 YES!',
'transmission': 'manual',
'trim': 'YES!',
'year': 2015}
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU21003%27 HTTP/1.1" 200 None
2026-03-29 18:44:48 [auto1.de] INFO: Saving data for BU21003: {'auction_closing_time': 1774885158.0, 'created_time': 1774723185.722586, 'last_price_update_time': 1774809888.903685}
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU21003') HTTP/1.1" 204 0
2026-03-29 18:44:48 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:48 [auto1.de] INFO: Found listing with ID: JY00372
2026-03-29 18:44:48 [auto1.de] INFO: Found listing with ID: CG91765
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG91765%27 HTTP/1.1" 200 None
2026-03-29 18:44:48 [auto1.de] INFO: Scrape type for CG91765: 2
2026-03-29 18:44:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d905bba-22c8-5505-b1d9-def83f87b672 with identifier: CG91765
2026-03-29 18:44:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d905bba-22c8-5505-b1d9-def83f87b672 with scrape type 2
2026-03-29 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d905bba-22c8-5505-b1d9-def83f87b672 with scrape type 2
2026-03-29 18:44:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d905bba-22c8-5505-b1d9-def83f87b672, identifier: CG91765
2026-03-29 18:44:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d905bba-22c8-5505-b1d9-def83f87b672 with identifier: CG91765
2026-03-29 18:44:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d905bba-22c8-5505-b1d9-def83f87b672 with identifier: CG91765
2026-03-29 18:44:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d905bba-22c8-5505-b1d9-def83f87b672 with identifier: CG91765 to the API
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:37:16Z',
'fuel_type': 'petrol',
'id': '0d905bba-22c8-5505-b1d9-def83f87b672',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG91765',
'listing': 'auction',
'make': 'Peugeot',
'model': '107',
'odometer': 77814,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-23',
'seller_name': None,
'title': 'Peugeot 107 1.0 Petit Filou',
'transmission': 'manual',
'trim': 'Petit Filou',
'year': 2009}
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG91765%27 HTTP/1.1" 200 None
2026-03-29 18:44:49 [auto1.de] INFO: Saving data for CG91765: {'auction_closing_time': 1774885036.0, 'created_time': 1774118522.878795, 'last_price_update_time': 1774809889.310705}
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG91765') HTTP/1.1" 204 0
2026-03-29 18:44:49 [auto1.de] INFO: Found listing with ID: VR46217
2026-03-29 18:44:49 [auto1.de] INFO: Found listing with ID: XH28612
2026-03-29 18:44:49 [auto1.de] INFO: Found listing with ID: KJ41571
2026-03-29 18:44:49 [auto1.de] INFO: Found listing with ID: UD70348
2026-03-29 18:44:49 [auto1.de] INFO: Found listing with ID: CS73315
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS73315%27 HTTP/1.1" 200 None
2026-03-29 18:44:49 [auto1.de] INFO: Scrape type for CS73315: 2
2026-03-29 18:44:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a1fb31d-c361-5370-b026-e914fc16190f with identifier: CS73315
2026-03-29 18:44:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a1fb31d-c361-5370-b026-e914fc16190f with scrape type 2
2026-03-29 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a1fb31d-c361-5370-b026-e914fc16190f with scrape type 2
2026-03-29 18:44:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a1fb31d-c361-5370-b026-e914fc16190f, identifier: CS73315
2026-03-29 18:44:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:49 [auto1.de] INFO: Found listing with ID: NG66001
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG66001%27 HTTP/1.1" 200 None
2026-03-29 18:44:49 [auto1.de] INFO: Scrape type for NG66001: 2
2026-03-29 18:44:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22a47020-25f8-5550-9736-fd11cd8796bf with identifier: NG66001
2026-03-29 18:44:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22a47020-25f8-5550-9736-fd11cd8796bf with scrape type 2
2026-03-29 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22a47020-25f8-5550-9736-fd11cd8796bf with scrape type 2
2026-03-29 18:44:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22a47020-25f8-5550-9736-fd11cd8796bf, identifier: NG66001
2026-03-29 18:44:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a1fb31d-c361-5370-b026-e914fc16190f with identifier: CS73315
2026-03-29 18:44:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a1fb31d-c361-5370-b026-e914fc16190f with identifier: CS73315
2026-03-29 18:44:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a1fb31d-c361-5370-b026-e914fc16190f with identifier: CS73315 to the API
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:49:37Z',
'fuel_type': 'diesel',
'id': '8a1fb31d-c361-5370-b026-e914fc16190f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS73315',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 126542,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-03',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2018}
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS73315%27 HTTP/1.1" 200 None
2026-03-29 18:44:49 [auto1.de] INFO: Saving data for CS73315: {'auction_closing_time': 1774885777.0, 'created_time': 1774723146.290855, 'last_price_update_time': 1774809889.823911}
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS73315') HTTP/1.1" 204 0
2026-03-29 18:44:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22a47020-25f8-5550-9736-fd11cd8796bf with identifier: NG66001
2026-03-29 18:44:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22a47020-25f8-5550-9736-fd11cd8796bf with identifier: NG66001
2026-03-29 18:44:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22a47020-25f8-5550-9736-fd11cd8796bf with identifier: NG66001 to the API
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:11:35Z',
'fuel_type': 'diesel',
'id': '22a47020-25f8-5550-9736-fd11cd8796bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG66001',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 175706,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-24',
'seller_name': None,
'title': 'BMW X1 sDrive 16d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG66001%27 HTTP/1.1" 200 None
2026-03-29 18:44:50 [auto1.de] INFO: Saving data for NG66001: {'auction_closing_time': 1774883495.0, 'created_time': 1774723189.447937, 'last_price_update_time': 1774809890.229463}
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG66001') HTTP/1.1" 204 0
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: SE41978
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE41978%27 HTTP/1.1" 200 None
2026-03-29 18:44:50 [auto1.de] INFO: Scrape type for SE41978: 2
2026-03-29 18:44:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb5cea64-b980-5449-8a3a-6f61ccf1db55 with identifier: SE41978
2026-03-29 18:44:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb5cea64-b980-5449-8a3a-6f61ccf1db55 with scrape type 2
2026-03-29 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb5cea64-b980-5449-8a3a-6f61ccf1db55 with scrape type 2
2026-03-29 18:44:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb5cea64-b980-5449-8a3a-6f61ccf1db55, identifier: SE41978
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: BP09693
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: BT01554
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: MG61327
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: BM00053
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: MK22023
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: EA38947
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA38947%27 HTTP/1.1" 200 None
2026-03-29 18:44:50 [auto1.de] INFO: Scrape type for EA38947: 2
2026-03-29 18:44:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0552dc28-1ee6-5899-832e-c71d069227bd with identifier: EA38947
2026-03-29 18:44:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0552dc28-1ee6-5899-832e-c71d069227bd with scrape type 2
2026-03-29 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0552dc28-1ee6-5899-832e-c71d069227bd with scrape type 2
2026-03-29 18:44:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0552dc28-1ee6-5899-832e-c71d069227bd, identifier: EA38947
2026-03-29 18:44:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb5cea64-b980-5449-8a3a-6f61ccf1db55 with identifier: SE41978
2026-03-29 18:44:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb5cea64-b980-5449-8a3a-6f61ccf1db55 with identifier: SE41978
2026-03-29 18:44:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb5cea64-b980-5449-8a3a-6f61ccf1db55 with identifier: SE41978 to the API
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:08:46Z',
'fuel_type': 'petrol',
'id': 'bb5cea64-b980-5449-8a3a-6f61ccf1db55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE41978',
'listing': 'auction',
'make': 'Mazda',
'model': '5',
'odometer': 137950,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-18',
'seller_name': None,
'title': 'Mazda 5 2.0 Sendo',
'transmission': 'manual',
'trim': 'Sendo',
'year': 2015}
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE41978%27 HTTP/1.1" 200 None
2026-03-29 18:44:50 [auto1.de] INFO: Saving data for SE41978: {'auction_closing_time': 1774883326.0, 'created_time': 1774349988.366238, 'last_price_update_time': 1774809890.734503}
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE41978') HTTP/1.1" 204 0
2026-03-29 18:44:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0552dc28-1ee6-5899-832e-c71d069227bd with identifier: EA38947
2026-03-29 18:44:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0552dc28-1ee6-5899-832e-c71d069227bd with identifier: EA38947
2026-03-29 18:44:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0552dc28-1ee6-5899-832e-c71d069227bd with identifier: EA38947 to the API
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:31:01Z',
'fuel_type': 'diesel',
'id': '0552dc28-1ee6-5899-832e-c71d069227bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA38947',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 135120,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-11',
'seller_name': None,
'title': 'Kia Sportage 1.6 CRDi Edition 7 2WD',
'transmission': 'manual',
'trim': 'Edition 7 2WD',
'year': 2015}
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA38947%27 HTTP/1.1" 200 None
2026-03-29 18:44:51 [auto1.de] INFO: Saving data for EA38947: {'auction_closing_time': 1774884661.0, 'created_time': 1774349279.628415, 'last_price_update_time': 1774809891.035791}
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA38947') HTTP/1.1" 204 0
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: NS35557
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS35557%27 HTTP/1.1" 200 None
2026-03-29 18:44:51 [auto1.de] INFO: Scrape type for NS35557: 2
2026-03-29 18:44:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25eafa3c-1875-5bae-8ca1-33ab78e8aabf with identifier: NS35557
2026-03-29 18:44:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf with scrape type 2
2026-03-29 18:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf with scrape type 2
2026-03-29 18:44:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25eafa3c-1875-5bae-8ca1-33ab78e8aabf, identifier: NS35557
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: BG08845
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: TR37501
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: UL05357
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: HZ69536
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ69536%27 HTTP/1.1" 200 None
2026-03-29 18:44:51 [auto1.de] INFO: Scrape type for HZ69536: 2
2026-03-29 18:44:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e89d4248-00c8-503d-9396-b1e2a70aac31 with identifier: HZ69536
2026-03-29 18:44:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e89d4248-00c8-503d-9396-b1e2a70aac31 with scrape type 2
2026-03-29 18:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e89d4248-00c8-503d-9396-b1e2a70aac31 with scrape type 2
2026-03-29 18:44:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e89d4248-00c8-503d-9396-b1e2a70aac31, identifier: HZ69536
2026-03-29 18:44:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25eafa3c-1875-5bae-8ca1-33ab78e8aabf with identifier: NS35557
2026-03-29 18:44:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25eafa3c-1875-5bae-8ca1-33ab78e8aabf with identifier: NS35557
2026-03-29 18:44:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25eafa3c-1875-5bae-8ca1-33ab78e8aabf with identifier: NS35557 to the API
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:14:20Z',
'fuel_type': 'diesel',
'id': '25eafa3c-1875-5bae-8ca1-33ab78e8aabf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS35557',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 146716,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-11',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2018}
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS35557%27 HTTP/1.1" 200 None
2026-03-29 18:44:51 [auto1.de] INFO: Saving data for NS35557: {'auction_closing_time': 1774883660.0, 'created_time': 1774723175.916181, 'last_price_update_time': 1774809891.544819}
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS35557') HTTP/1.1" 204 0
2026-03-29 18:44:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e89d4248-00c8-503d-9396-b1e2a70aac31 with identifier: HZ69536
2026-03-29 18:44:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e89d4248-00c8-503d-9396-b1e2a70aac31 with identifier: HZ69536
2026-03-29 18:44:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e89d4248-00c8-503d-9396-b1e2a70aac31 with identifier: HZ69536 to the API
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:36:08Z',
'fuel_type': 'petrol',
'id': 'e89d4248-00c8-503d-9396-b1e2a70aac31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ69536',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 170985,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-15',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.2 TSI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2011}
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ69536%27 HTTP/1.1" 200 None
2026-03-29 18:44:51 [auto1.de] INFO: Saving data for HZ69536: {'auction_closing_time': 1774884968.0, 'created_time': 1774723145.480488, 'last_price_update_time': 1774809891.918813}
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ69536') HTTP/1.1" 204 0
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: JJ64066
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: MD22344
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: LW95470
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW95470%27 HTTP/1.1" 200 None
2026-03-29 18:44:51 [auto1.de] INFO: Scrape type for LW95470: 2
2026-03-29 18:44:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98457537-d509-5bbf-84e2-4bea553106a9 with identifier: LW95470
2026-03-29 18:44:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98457537-d509-5bbf-84e2-4bea553106a9 with scrape type 2
2026-03-29 18:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98457537-d509-5bbf-84e2-4bea553106a9 with scrape type 2
2026-03-29 18:44:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98457537-d509-5bbf-84e2-4bea553106a9, identifier: LW95470
2026-03-29 18:44:52 [auto1.de] INFO: Found listing with ID: TK93923
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK93923%27 HTTP/1.1" 200 None
2026-03-29 18:44:52 [auto1.de] INFO: Scrape type for TK93923: 2
2026-03-29 18:44:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e339f6c-e99e-53ba-9288-4b2cbb8e57fc with identifier: TK93923
2026-03-29 18:44:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e339f6c-e99e-53ba-9288-4b2cbb8e57fc with scrape type 2
2026-03-29 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e339f6c-e99e-53ba-9288-4b2cbb8e57fc with scrape type 2
2026-03-29 18:44:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e339f6c-e99e-53ba-9288-4b2cbb8e57fc, identifier: TK93923
2026-03-29 18:44:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98457537-d509-5bbf-84e2-4bea553106a9 with identifier: LW95470
2026-03-29 18:44:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98457537-d509-5bbf-84e2-4bea553106a9 with identifier: LW95470
2026-03-29 18:44:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98457537-d509-5bbf-84e2-4bea553106a9 with identifier: LW95470 to the API
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:32:13Z',
'fuel_type': 'petrol',
'id': '98457537-d509-5bbf-84e2-4bea553106a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW95470',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 210999,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-26',
'seller_name': None,
'title': 'Audi A6 2.8 V6 FSI quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2011}
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW95470%27 HTTP/1.1" 200 None
2026-03-29 18:44:52 [auto1.de] INFO: Saving data for LW95470: {'auction_closing_time': 1774884733.0, 'created_time': 1774723191.240643, 'last_price_update_time': 1774809892.473499}
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW95470') HTTP/1.1" 204 0
2026-03-29 18:44:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e339f6c-e99e-53ba-9288-4b2cbb8e57fc with identifier: TK93923
2026-03-29 18:44:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e339f6c-e99e-53ba-9288-4b2cbb8e57fc with identifier: TK93923
2026-03-29 18:44:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e339f6c-e99e-53ba-9288-4b2cbb8e57fc with identifier: TK93923 to the API
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:46:33Z',
'fuel_type': 'diesel',
'id': '5e339f6c-e99e-53ba-9288-4b2cbb8e57fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK93923',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 145325,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-21',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK93923%27 HTTP/1.1" 200 None
2026-03-29 18:44:52 [auto1.de] INFO: Saving data for TK93923: {'auction_closing_time': 1774885593.0, 'created_time': 1774723168.126663, 'last_price_update_time': 1774809892.764969}
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK93923') HTTP/1.1" 204 0
2026-03-29 18:44:52 [auto1.de] INFO: Found listing with ID: GN95458
2026-03-29 18:44:52 [auto1.de] INFO: Found listing with ID: ZG18767
2026-03-29 18:44:52 [auto1.de] INFO: Found listing with ID: GY54695
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY54695%27 HTTP/1.1" 200 None
2026-03-29 18:44:52 [auto1.de] INFO: Scrape type for GY54695: 2
2026-03-29 18:44:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0 with identifier: GY54695
2026-03-29 18:44:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0 with scrape type 2
2026-03-29 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0 with scrape type 2
2026-03-29 18:44:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0, identifier: GY54695
2026-03-29 18:44:52 [auto1.de] INFO: Found listing with ID: LW29658
2026-03-29 18:44:52 [auto1.de] INFO: Found listing with ID: DV23135
2026-03-29 18:44:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0 with identifier: GY54695
2026-03-29 18:44:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0 with identifier: GY54695
2026-03-29 18:44:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0 with identifier: GY54695 to the API
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:22:26Z',
'fuel_type': 'petrol',
'id': '639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY54695',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 126851,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-13',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
'transmission': 'automatic',
'trim': 'BlueEfficiency AMG Sport',
'year': 2017}
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY54695%27 HTTP/1.1" 200 None
2026-03-29 18:44:53 [auto1.de] INFO: Saving data for GY54695: {'auction_closing_time': 1774884146.0, 'created_time': 1773466647.412847, 'last_price_update_time': 1774809893.194052}
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY54695') HTTP/1.1" 204 0
2026-03-29 18:44:53 [auto1.de] INFO: Found listing with ID: TM38106
2026-03-29 18:44:53 [auto1.de] INFO: Found listing with ID: TK68896
2026-03-29 18:44:53 [auto1.de] INFO: Found listing with ID: TV85934
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV85934%27 HTTP/1.1" 200 None
2026-03-29 18:44:53 [auto1.de] INFO: Scrape type for TV85934: 2
2026-03-29 18:44:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96228e4a-723c-5881-9316-69d26393276a with identifier: TV85934
2026-03-29 18:44:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96228e4a-723c-5881-9316-69d26393276a with scrape type 2
2026-03-29 18:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96228e4a-723c-5881-9316-69d26393276a with scrape type 2
2026-03-29 18:44:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96228e4a-723c-5881-9316-69d26393276a, identifier: TV85934
2026-03-29 18:44:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96228e4a-723c-5881-9316-69d26393276a with identifier: TV85934
2026-03-29 18:44:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96228e4a-723c-5881-9316-69d26393276a with identifier: TV85934
2026-03-29 18:44:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96228e4a-723c-5881-9316-69d26393276a with identifier: TV85934 to the API
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:55:06Z',
'fuel_type': 'petrol',
'id': '96228e4a-723c-5881-9316-69d26393276a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV85934',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 170231,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-30',
'seller_name': None,
'title': 'Volkswagen Touran 1.4 TSI EcoFuel Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2013}
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV85934%27 HTTP/1.1" 200 None
2026-03-29 18:44:53 [auto1.de] INFO: Saving data for TV85934: {'auction_closing_time': 1774886106.0, 'created_time': 1774118451.296094, 'last_price_update_time': 1774809893.57858}
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV85934') HTTP/1.1" 204 0
2026-03-29 18:44:53 [auto1.de] INFO: Found listing with ID: YN89436
2026-03-29 18:44:53 [auto1.de] INFO: Found listing with ID: YN15081
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN15081%27 HTTP/1.1" 200 None
2026-03-29 18:44:53 [auto1.de] INFO: Scrape type for YN15081: 2
2026-03-29 18:44:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eea4de39-9e7f-5d79-ac4b-116917e2eea1 with identifier: YN15081
2026-03-29 18:44:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eea4de39-9e7f-5d79-ac4b-116917e2eea1 with scrape type 2
2026-03-29 18:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eea4de39-9e7f-5d79-ac4b-116917e2eea1 with scrape type 2
2026-03-29 18:44:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eea4de39-9e7f-5d79-ac4b-116917e2eea1, identifier: YN15081
2026-03-29 18:44:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eea4de39-9e7f-5d79-ac4b-116917e2eea1 with identifier: YN15081
2026-03-29 18:44:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eea4de39-9e7f-5d79-ac4b-116917e2eea1 with identifier: YN15081
2026-03-29 18:44:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eea4de39-9e7f-5d79-ac4b-116917e2eea1 with identifier: YN15081 to the API
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:11:46Z',
'fuel_type': 'diesel',
'id': 'eea4de39-9e7f-5d79-ac4b-116917e2eea1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN15081',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 103524,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-08',
'seller_name': None,
'title': 'Audi A1 1.6 TDI S line Sportpaket',
'transmission': 'manual',
'trim': 'S line Sportpaket',
'year': 2015}
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN15081%27 HTTP/1.1" 200 None
2026-03-29 18:44:54 [auto1.de] INFO: Saving data for YN15081: {'auction_closing_time': 1774883506.0, 'created_time': 1773467628.731985, 'last_price_update_time': 1774809894.119226}
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN15081') HTTP/1.1" 204 0
2026-03-29 18:44:54 [auto1.de] INFO: Found listing with ID: PR24120
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR24120%27 HTTP/1.1" 200 None
2026-03-29 18:44:54 [auto1.de] INFO: Scrape type for PR24120: 2
2026-03-29 18:44:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c304d9a5-2d68-5d7a-ac77-74cd66854393 with identifier: PR24120
2026-03-29 18:44:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c304d9a5-2d68-5d7a-ac77-74cd66854393 with scrape type 2
2026-03-29 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c304d9a5-2d68-5d7a-ac77-74cd66854393 with scrape type 2
2026-03-29 18:44:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c304d9a5-2d68-5d7a-ac77-74cd66854393, identifier: PR24120
2026-03-29 18:44:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c304d9a5-2d68-5d7a-ac77-74cd66854393 with identifier: PR24120
2026-03-29 18:44:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c304d9a5-2d68-5d7a-ac77-74cd66854393 with identifier: PR24120
2026-03-29 18:44:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c304d9a5-2d68-5d7a-ac77-74cd66854393 with identifier: PR24120 to the API
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:13:41Z',
'fuel_type': 'diesel',
'id': 'c304d9a5-2d68-5d7a-ac77-74cd66854393',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR24120',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 189766,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-17',
'seller_name': None,
'title': 'BMW 3er 320d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2017}
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR24120%27 HTTP/1.1" 200 None
2026-03-29 18:44:54 [auto1.de] INFO: Saving data for PR24120: {'auction_closing_time': 1774883621.0, 'created_time': 1774723187.27897, 'last_price_update_time': 1774809894.546284}
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR24120') HTTP/1.1" 204 0
2026-03-29 18:44:54 [auto1.de] INFO: Found listing with ID: WB47522
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB47522%27 HTTP/1.1" 200 None
2026-03-29 18:44:54 [auto1.de] INFO: Scrape type for WB47522: 2
2026-03-29 18:44:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2cbd928-884a-5c3b-ae66-2ec13fe642de with identifier: WB47522
2026-03-29 18:44:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2cbd928-884a-5c3b-ae66-2ec13fe642de with scrape type 2
2026-03-29 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2cbd928-884a-5c3b-ae66-2ec13fe642de with scrape type 2
2026-03-29 18:44:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2cbd928-884a-5c3b-ae66-2ec13fe642de, identifier: WB47522
2026-03-29 18:44:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2cbd928-884a-5c3b-ae66-2ec13fe642de with identifier: WB47522
2026-03-29 18:44:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2cbd928-884a-5c3b-ae66-2ec13fe642de with identifier: WB47522
2026-03-29 18:44:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2cbd928-884a-5c3b-ae66-2ec13fe642de with identifier: WB47522 to the API
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:47:03Z',
'fuel_type': 'diesel',
'id': 'c2cbd928-884a-5c3b-ae66-2ec13fe642de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB47522',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 203186,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-05',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI First Edition',
'transmission': 'automatic',
'trim': 'First Edition',
'year': 2020}
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB47522%27 HTTP/1.1" 200 None
2026-03-29 18:44:54 [auto1.de] INFO: Saving data for WB47522: {'auction_closing_time': 1774885623.0, 'created_time': 1774032119.719153, 'last_price_update_time': 1774809894.93991}
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB47522') HTTP/1.1" 204 0
2026-03-29 18:44:54 [auto1.de] INFO: Found listing with ID: PM63573
2026-03-29 18:44:54 [auto1.de] INFO: Found listing with ID: JL46304
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL46304%27 HTTP/1.1" 200 None
2026-03-29 18:44:54 [auto1.de] INFO: Scrape type for JL46304: 2
2026-03-29 18:44:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1412a0d5-fb2d-5511-a1d7-1ce67251c102 with identifier: JL46304
2026-03-29 18:44:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102 with scrape type 2
2026-03-29 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102 with scrape type 2
2026-03-29 18:44:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1412a0d5-fb2d-5511-a1d7-1ce67251c102, identifier: JL46304
2026-03-29 18:44:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1412a0d5-fb2d-5511-a1d7-1ce67251c102 with identifier: JL46304
2026-03-29 18:44:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1412a0d5-fb2d-5511-a1d7-1ce67251c102 with identifier: JL46304
2026-03-29 18:44:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1412a0d5-fb2d-5511-a1d7-1ce67251c102 with identifier: JL46304 to the API
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:48:47Z',
'fuel_type': 'petrol',
'id': '1412a0d5-fb2d-5511-a1d7-1ce67251c102',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL46304',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 71734,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-31',
'seller_name': None,
'title': 'Seat Leon 1.5 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2019}
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL46304%27 HTTP/1.1" 200 None
2026-03-29 18:44:55 [auto1.de] INFO: Saving data for JL46304: {'auction_closing_time': 1774885727.0, 'created_time': 1774723160.604409, 'last_price_update_time': 1774809895.351207}
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL46304') HTTP/1.1" 204 0
2026-03-29 18:44:55 [auto1.de] INFO: Found listing with ID: LL96634
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL96634%27 HTTP/1.1" 200 None
2026-03-29 18:44:55 [auto1.de] INFO: Scrape type for LL96634: 2
2026-03-29 18:44:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf7eada1-8700-581d-ab72-ecb7c2ce9260 with identifier: LL96634
2026-03-29 18:44:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf7eada1-8700-581d-ab72-ecb7c2ce9260 with scrape type 2
2026-03-29 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf7eada1-8700-581d-ab72-ecb7c2ce9260 with scrape type 2
2026-03-29 18:44:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf7eada1-8700-581d-ab72-ecb7c2ce9260, identifier: LL96634
2026-03-29 18:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf7eada1-8700-581d-ab72-ecb7c2ce9260 with identifier: LL96634
2026-03-29 18:44:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf7eada1-8700-581d-ab72-ecb7c2ce9260 with identifier: LL96634
2026-03-29 18:44:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf7eada1-8700-581d-ab72-ecb7c2ce9260 with identifier: LL96634 to the API
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:28:06Z',
'fuel_type': 'petrol',
'id': 'cf7eada1-8700-581d-ab72-ecb7c2ce9260',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL96634',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 138838,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-27',
'seller_name': None,
'title': 'Renault Twingo 1.2 Night & Day',
'transmission': 'manual',
'trim': 'Night & Day',
'year': 2010}
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL96634%27 HTTP/1.1" 200 None
2026-03-29 18:44:55 [auto1.de] INFO: Saving data for LL96634: {'auction_closing_time': 1774884486.0, 'created_time': 1773428606.648739, 'last_price_update_time': 1774809895.737563}
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL96634') HTTP/1.1" 204 0
2026-03-29 18:44:55 [auto1.de] INFO: Found listing with ID: HV52023
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV52023%27 HTTP/1.1" 200 None
2026-03-29 18:44:55 [auto1.de] INFO: Scrape type for HV52023: 2
2026-03-29 18:44:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0af17159-8b74-5aef-bb80-695f654b6a47 with identifier: HV52023
2026-03-29 18:44:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af17159-8b74-5aef-bb80-695f654b6a47 with scrape type 2
2026-03-29 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0af17159-8b74-5aef-bb80-695f654b6a47 with scrape type 2
2026-03-29 18:44:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0af17159-8b74-5aef-bb80-695f654b6a47, identifier: HV52023
2026-03-29 18:44:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0af17159-8b74-5aef-bb80-695f654b6a47 with identifier: HV52023
2026-03-29 18:44:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0af17159-8b74-5aef-bb80-695f654b6a47 with identifier: HV52023
2026-03-29 18:44:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0af17159-8b74-5aef-bb80-695f654b6a47 with identifier: HV52023 to the API
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:55:52Z',
'fuel_type': 'petrol',
'id': '0af17159-8b74-5aef-bb80-695f654b6a47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV52023',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 140496,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-31',
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
'transmission': 'manual',
'trim': 'Stepway Prestige',
'year': 2015}
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV52023%27 HTTP/1.1" 200 None
2026-03-29 18:44:56 [auto1.de] INFO: Saving data for HV52023: {'auction_closing_time': 1774886152.0, 'created_time': 1774723158.717424, 'last_price_update_time': 1774809896.143951}
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV52023') HTTP/1.1" 204 0
2026-03-29 18:44:56 [auto1.de] INFO: Found listing with ID: YT21216
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT21216%27 HTTP/1.1" 200 None
2026-03-29 18:44:56 [auto1.de] INFO: Scrape type for YT21216: 2
2026-03-29 18:44:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e385d2c-486e-5d88-9f27-ac483a1da53b with identifier: YT21216
2026-03-29 18:44:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e385d2c-486e-5d88-9f27-ac483a1da53b with scrape type 2
2026-03-29 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e385d2c-486e-5d88-9f27-ac483a1da53b with scrape type 2
2026-03-29 18:44:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e385d2c-486e-5d88-9f27-ac483a1da53b, identifier: YT21216
2026-03-29 18:44:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e385d2c-486e-5d88-9f27-ac483a1da53b with identifier: YT21216
2026-03-29 18:44:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e385d2c-486e-5d88-9f27-ac483a1da53b with identifier: YT21216
2026-03-29 18:44:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e385d2c-486e-5d88-9f27-ac483a1da53b with identifier: YT21216 to the API
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:54:12Z',
'fuel_type': 'diesel',
'id': '8e385d2c-486e-5d88-9f27-ac483a1da53b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT21216',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 112896,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-06',
'seller_name': None,
'title': 'Seat Ateca 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2019}
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT21216%27 HTTP/1.1" 200 None
2026-03-29 18:44:56 [auto1.de] INFO: Saving data for YT21216: {'auction_closing_time': 1774886052.0, 'created_time': 1774723189.827297, 'last_price_update_time': 1774809896.539714}
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT21216') HTTP/1.1" 204 0
2026-03-29 18:44:56 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:56 [auto1.de] INFO: Found listing with ID: YW86530
2026-03-29 18:44:56 [auto1.de] INFO: Found listing with ID: EH91304
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91304%27 HTTP/1.1" 200 None
2026-03-29 18:44:56 [auto1.de] INFO: Scrape type for EH91304: 2
2026-03-29 18:44:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: badad7c7-3054-5c43-ac97-c6b5556b9350 with identifier: EH91304
2026-03-29 18:44:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item badad7c7-3054-5c43-ac97-c6b5556b9350 with scrape type 2
2026-03-29 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item badad7c7-3054-5c43-ac97-c6b5556b9350 with scrape type 2
2026-03-29 18:44:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: badad7c7-3054-5c43-ac97-c6b5556b9350, identifier: EH91304
2026-03-29 18:44:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: badad7c7-3054-5c43-ac97-c6b5556b9350 with identifier: EH91304
2026-03-29 18:44:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: badad7c7-3054-5c43-ac97-c6b5556b9350 with identifier: EH91304
2026-03-29 18:44:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: badad7c7-3054-5c43-ac97-c6b5556b9350 with identifier: EH91304 to the API
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:33:27Z',
'fuel_type': 'diesel',
'id': 'badad7c7-3054-5c43-ac97-c6b5556b9350',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH91304',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 261392,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-24',
'seller_name': None,
'title': 'Alfa Romeo Giulietta 1.6 JTDM Veloce',
'transmission': 'manual',
'trim': 'Veloce',
'year': 2013}
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91304%27 HTTP/1.1" 200 None
2026-03-29 18:44:56 [auto1.de] INFO: Saving data for EH91304: {'auction_closing_time': 1774884807.0, 'created_time': 1774349845.744843, 'last_price_update_time': 1774809896.968542}
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH91304') HTTP/1.1" 204 0
2026-03-29 18:44:57 [auto1.de] INFO: Found listing with ID: HZ35402
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35402%27 HTTP/1.1" 200 None
2026-03-29 18:44:57 [auto1.de] INFO: Scrape type for HZ35402: 2
2026-03-29 18:44:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aa56d61-0b31-5a5a-8edf-f7216ef165cb with identifier: HZ35402
2026-03-29 18:44:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aa56d61-0b31-5a5a-8edf-f7216ef165cb with scrape type 2
2026-03-29 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0aa56d61-0b31-5a5a-8edf-f7216ef165cb with scrape type 2
2026-03-29 18:44:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0aa56d61-0b31-5a5a-8edf-f7216ef165cb, identifier: HZ35402
2026-03-29 18:44:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:57 [auto1.de] INFO: Found listing with ID: WE57631
2026-03-29 18:44:57 [auto1.de] INFO: Found listing with ID: RR27166
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR27166%27 HTTP/1.1" 200 None
2026-03-29 18:44:57 [auto1.de] INFO: Scrape type for RR27166: 2
2026-03-29 18:44:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f88c03da-f250-560c-9535-18ee7c4faf1f with identifier: RR27166
2026-03-29 18:44:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88c03da-f250-560c-9535-18ee7c4faf1f with scrape type 2
2026-03-29 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f88c03da-f250-560c-9535-18ee7c4faf1f with scrape type 2
2026-03-29 18:44:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f88c03da-f250-560c-9535-18ee7c4faf1f, identifier: RR27166
2026-03-29 18:44:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0aa56d61-0b31-5a5a-8edf-f7216ef165cb with identifier: HZ35402
2026-03-29 18:44:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0aa56d61-0b31-5a5a-8edf-f7216ef165cb with identifier: HZ35402
2026-03-29 18:44:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0aa56d61-0b31-5a5a-8edf-f7216ef165cb with identifier: HZ35402 to the API
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:15:00Z',
'fuel_type': 'petrol',
'id': '0aa56d61-0b31-5a5a-8edf-f7216ef165cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ35402',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 39730,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-29',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2020}
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35402%27 HTTP/1.1" 200 None
2026-03-29 18:44:57 [auto1.de] INFO: Saving data for HZ35402: {'auction_closing_time': 1774883700.0, 'created_time': 1774349499.569714, 'last_price_update_time': 1774809897.587377}
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ35402') HTTP/1.1" 204 0
2026-03-29 18:44:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f88c03da-f250-560c-9535-18ee7c4faf1f with identifier: RR27166
2026-03-29 18:44:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f88c03da-f250-560c-9535-18ee7c4faf1f with identifier: RR27166
2026-03-29 18:44:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f88c03da-f250-560c-9535-18ee7c4faf1f with identifier: RR27166 to the API
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:49:07Z',
'fuel_type': 'diesel',
'id': 'f88c03da-f250-560c-9535-18ee7c4faf1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR27166',
'listing': 'auction',
'make': 'Audi',
'model': 'SQ5',
'odometer': 93661,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-30',
'seller_name': None,
'title': 'Audi SQ5 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2014}
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR27166%27 HTTP/1.1" 200 None
2026-03-29 18:44:57 [auto1.de] INFO: Saving data for RR27166: {'auction_closing_time': 1774885747.0, 'created_time': 1774118809.468489, 'last_price_update_time': 1774809897.884676}
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR27166') HTTP/1.1" 204 0
2026-03-29 18:44:57 [auto1.de] INFO: Found listing with ID: WA51516
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA51516%27 HTTP/1.1" 200 None
2026-03-29 18:44:57 [auto1.de] INFO: Scrape type for WA51516: 2
2026-03-29 18:44:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cacc695-7706-51bc-b762-2927968f0f61 with identifier: WA51516
2026-03-29 18:44:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cacc695-7706-51bc-b762-2927968f0f61 with scrape type 2
2026-03-29 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cacc695-7706-51bc-b762-2927968f0f61 with scrape type 2
2026-03-29 18:44:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cacc695-7706-51bc-b762-2927968f0f61, identifier: WA51516
2026-03-29 18:44:58 [auto1.de] INFO: Found listing with ID: SJ72548
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72548%27 HTTP/1.1" 200 None
2026-03-29 18:44:58 [auto1.de] INFO: Scrape type for SJ72548: 2
2026-03-29 18:44:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2 with identifier: SJ72548
2026-03-29 18:44:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2 with scrape type 2
2026-03-29 18:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2 with scrape type 2
2026-03-29 18:44:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2, identifier: SJ72548
2026-03-29 18:44:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cacc695-7706-51bc-b762-2927968f0f61 with identifier: WA51516
2026-03-29 18:44:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cacc695-7706-51bc-b762-2927968f0f61 with identifier: WA51516
2026-03-29 18:44:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cacc695-7706-51bc-b762-2927968f0f61 with identifier: WA51516 to the API
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:27:05Z',
'fuel_type': 'petrol',
'id': '5cacc695-7706-51bc-b762-2927968f0f61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA51516',
'listing': 'auction',
'make': 'Volvo',
'model': 'C30',
'odometer': 182361,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-03-24',
'seller_name': None,
'title': 'Volvo C30 2.5 T5 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2008}
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA51516%27 HTTP/1.1" 200 None
2026-03-29 18:44:58 [auto1.de] INFO: Saving data for WA51516: {'auction_closing_time': 1774884425.0, 'created_time': 1774723179.818507, 'last_price_update_time': 1774809898.41552}
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA51516') HTTP/1.1" 204 0
2026-03-29 18:44:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2 with identifier: SJ72548
2026-03-29 18:44:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2 with identifier: SJ72548
2026-03-29 18:44:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2 with identifier: SJ72548 to the API
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:45:53Z',
'fuel_type': 'petrol',
'id': '04d9e4da-6166-5b1a-aa26-f24f66e4d0e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ72548',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 89642,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-27',
'seller_name': None,
'title': 'Audi A1 Sportback 1.4 TFSI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2016}
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72548%27 HTTP/1.1" 200 None
2026-03-29 18:44:58 [auto1.de] INFO: Saving data for SJ72548: {'auction_closing_time': 1774885553.0, 'created_time': 1774723147.855121, 'last_price_update_time': 1774809898.708782}
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ72548') HTTP/1.1" 204 0
2026-03-29 18:44:58 [auto1.de] INFO: Found listing with ID: VY12832
2026-03-29 18:44:58 [auto1.de] INFO: Found listing with ID: GA49917
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA49917%27 HTTP/1.1" 200 None
2026-03-29 18:44:58 [auto1.de] INFO: Scrape type for GA49917: 2
2026-03-29 18:44:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c905584c-9be7-54f0-9c47-979d0256b153 with identifier: GA49917
2026-03-29 18:44:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c905584c-9be7-54f0-9c47-979d0256b153 with scrape type 2
2026-03-29 18:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c905584c-9be7-54f0-9c47-979d0256b153 with scrape type 2
2026-03-29 18:44:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c905584c-9be7-54f0-9c47-979d0256b153, identifier: GA49917
2026-03-29 18:44:58 [auto1.de] INFO: Found listing with ID: XR20146
2026-03-29 18:44:58 [auto1.de] INFO: Found listing with ID: RL75454
2026-03-29 18:44:58 [auto1.de] INFO: Found listing with ID: SY42721
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY42721%27 HTTP/1.1" 200 None
2026-03-29 18:44:58 [auto1.de] INFO: Scrape type for SY42721: 2
2026-03-29 18:44:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a6ae06-cf8f-544c-aedc-84723aedb596 with identifier: SY42721
2026-03-29 18:44:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a6ae06-cf8f-544c-aedc-84723aedb596 with scrape type 2
2026-03-29 18:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76a6ae06-cf8f-544c-aedc-84723aedb596 with scrape type 2
2026-03-29 18:44:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76a6ae06-cf8f-544c-aedc-84723aedb596, identifier: SY42721
2026-03-29 18:44:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c905584c-9be7-54f0-9c47-979d0256b153 with identifier: GA49917
2026-03-29 18:44:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c905584c-9be7-54f0-9c47-979d0256b153 with identifier: GA49917
2026-03-29 18:44:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c905584c-9be7-54f0-9c47-979d0256b153 with identifier: GA49917 to the API
2026-03-29 18:44:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 98,
'expiration_date': '2026-03-30T15:36:24Z',
'fuel_type': 'petrol',
'id': 'c905584c-9be7-54f0-9c47-979d0256b153',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA49917',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 100944,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-21',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2014}
2026-03-29 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA49917%27 HTTP/1.1" 200 None
2026-03-29 18:44:59 [auto1.de] INFO: Saving data for GA49917: {'auction_closing_time': 1774884984.0, 'created_time': 1774034319.618263, 'last_price_update_time': 1774809899.210269}
2026-03-29 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA49917') HTTP/1.1" 204 0
2026-03-29 18:44:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76a6ae06-cf8f-544c-aedc-84723aedb596 with identifier: SY42721
2026-03-29 18:44:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76a6ae06-cf8f-544c-aedc-84723aedb596 with identifier: SY42721
2026-03-29 18:44:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76a6ae06-cf8f-544c-aedc-84723aedb596 with identifier: SY42721 to the API
2026-03-29 18:44:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:31:04Z',
'fuel_type': 'petrol',
'id': '76a6ae06-cf8f-544c-aedc-84723aedb596',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY42721',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 77017,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-08',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 220 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2020}
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY42721%27 HTTP/1.1" 200 None
2026-03-29 18:45:00 [auto1.de] INFO: Saving data for SY42721: {'auction_closing_time': 1774884664.0, 'created_time': 1774723178.341707, 'last_price_update_time': 1774809900.406934}
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY42721') HTTP/1.1" 204 0
2026-03-29 18:45:00 [auto1.de] INFO: Found listing with ID: CC10989
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC10989%27 HTTP/1.1" 200 None
2026-03-29 18:45:00 [auto1.de] INFO: Scrape type for CC10989: 2
2026-03-29 18:45:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee7fd7ae-911e-5316-8aa8-a0747560c412 with identifier: CC10989
2026-03-29 18:45:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee7fd7ae-911e-5316-8aa8-a0747560c412 with scrape type 2
2026-03-29 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee7fd7ae-911e-5316-8aa8-a0747560c412 with scrape type 2
2026-03-29 18:45:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee7fd7ae-911e-5316-8aa8-a0747560c412, identifier: CC10989
2026-03-29 18:45:00 [auto1.de] INFO: Found listing with ID: RM21545
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM21545%27 HTTP/1.1" 200 None
2026-03-29 18:45:00 [auto1.de] INFO: Scrape type for RM21545: 2
2026-03-29 18:45:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 596fa0f5-2669-5de8-a958-19c759cea962 with identifier: RM21545
2026-03-29 18:45:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 596fa0f5-2669-5de8-a958-19c759cea962 with scrape type 2
2026-03-29 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 596fa0f5-2669-5de8-a958-19c759cea962 with scrape type 2
2026-03-29 18:45:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 596fa0f5-2669-5de8-a958-19c759cea962, identifier: RM21545
2026-03-29 18:45:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee7fd7ae-911e-5316-8aa8-a0747560c412 with identifier: CC10989
2026-03-29 18:45:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee7fd7ae-911e-5316-8aa8-a0747560c412 with identifier: CC10989
2026-03-29 18:45:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee7fd7ae-911e-5316-8aa8-a0747560c412 with identifier: CC10989 to the API
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:31:30Z',
'fuel_type': 'petrol',
'id': 'ee7fd7ae-911e-5316-8aa8-a0747560c412',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC10989',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 181502,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-01',
'seller_name': None,
'title': 'Opel Corsa 1.4 Energy',
'transmission': 'manual',
'trim': 'Energy',
'year': 2014}
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC10989%27 HTTP/1.1" 200 None
2026-03-29 18:45:00 [auto1.de] INFO: Saving data for CC10989: {'auction_closing_time': 1774884690.0, 'created_time': 1774723156.644973, 'last_price_update_time': 1774809900.93419}
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC10989') HTTP/1.1" 204 0
2026-03-29 18:45:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 596fa0f5-2669-5de8-a958-19c759cea962 with identifier: RM21545
2026-03-29 18:45:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 596fa0f5-2669-5de8-a958-19c759cea962 with identifier: RM21545
2026-03-29 18:45:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 596fa0f5-2669-5de8-a958-19c759cea962 with identifier: RM21545 to the API
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 179,
'expiration_date': '2026-03-30T15:51:32Z',
'fuel_type': 'petrol',
'id': '596fa0f5-2669-5de8-a958-19c759cea962',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM21545',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 38460,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-28',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Prime 4WD',
'transmission': 'automatic',
'trim': 'Prime 4WD',
'year': 2024}
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM21545%27 HTTP/1.1" 200 None
2026-03-29 18:45:01 [auto1.de] INFO: Saving data for RM21545: {'auction_closing_time': 1774885892.0, 'created_time': 1773400217.223871, 'last_price_update_time': 1774809901.403691}
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM21545') HTTP/1.1" 204 0
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: FW05091
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: AZ02782
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: MP53713
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP53713%27 HTTP/1.1" 200 None
2026-03-29 18:45:01 [auto1.de] INFO: Scrape type for MP53713: 2
2026-03-29 18:45:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8eda5a79-01a3-5c33-8a29-cfd6cd137e09 with identifier: MP53713
2026-03-29 18:45:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eda5a79-01a3-5c33-8a29-cfd6cd137e09 with scrape type 2
2026-03-29 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8eda5a79-01a3-5c33-8a29-cfd6cd137e09 with scrape type 2
2026-03-29 18:45:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8eda5a79-01a3-5c33-8a29-cfd6cd137e09, identifier: MP53713
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: UC78524
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78524%27 HTTP/1.1" 200 None
2026-03-29 18:45:01 [auto1.de] INFO: Scrape type for UC78524: 2
2026-03-29 18:45:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8847ecc-e35b-57a1-b118-4c80666801a2 with identifier: UC78524
2026-03-29 18:45:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8847ecc-e35b-57a1-b118-4c80666801a2 with scrape type 2
2026-03-29 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8847ecc-e35b-57a1-b118-4c80666801a2 with scrape type 2
2026-03-29 18:45:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8847ecc-e35b-57a1-b118-4c80666801a2, identifier: UC78524
2026-03-29 18:45:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8eda5a79-01a3-5c33-8a29-cfd6cd137e09 with identifier: MP53713
2026-03-29 18:45:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8eda5a79-01a3-5c33-8a29-cfd6cd137e09 with identifier: MP53713
2026-03-29 18:45:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8eda5a79-01a3-5c33-8a29-cfd6cd137e09 with identifier: MP53713 to the API
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:03:54Z',
'fuel_type': 'petrol',
'id': '8eda5a79-01a3-5c33-8a29-cfd6cd137e09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP53713',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 120517,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-15',
'seller_name': None,
'title': 'Opel Astra 1.6 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2009}
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP53713%27 HTTP/1.1" 200 None
2026-03-29 18:45:01 [auto1.de] INFO: Saving data for MP53713: {'auction_closing_time': 1774883034.0, 'created_time': 1774349847.094026, 'last_price_update_time': 1774809901.981787}
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP53713') HTTP/1.1" 204 0
2026-03-29 18:45:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8847ecc-e35b-57a1-b118-4c80666801a2 with identifier: UC78524
2026-03-29 18:45:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8847ecc-e35b-57a1-b118-4c80666801a2 with identifier: UC78524
2026-03-29 18:45:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8847ecc-e35b-57a1-b118-4c80666801a2 with identifier: UC78524 to the API
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:15:33Z',
'fuel_type': 'petrol',
'id': 'f8847ecc-e35b-57a1-b118-4c80666801a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC78524',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20 Active',
'odometer': 59286,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-07',
'seller_name': None,
'title': 'Hyundai i20 Active 1.0 TGDI Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2020}
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78524%27 HTTP/1.1" 200 None
2026-03-29 18:45:02 [auto1.de] INFO: Saving data for UC78524: {'auction_closing_time': 1774883733.0, 'created_time': 1774034133.334107, 'last_price_update_time': 1774809902.314097}
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC78524') HTTP/1.1" 204 0
2026-03-29 18:45:02 [auto1.de] INFO: Found listing with ID: YA63127
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA63127%27 HTTP/1.1" 200 None
2026-03-29 18:45:02 [auto1.de] INFO: Scrape type for YA63127: 2
2026-03-29 18:45:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae65f7a0-750f-5818-a02a-e8b1d41fbb67 with identifier: YA63127
2026-03-29 18:45:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae65f7a0-750f-5818-a02a-e8b1d41fbb67 with scrape type 2
2026-03-29 18:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae65f7a0-750f-5818-a02a-e8b1d41fbb67 with scrape type 2
2026-03-29 18:45:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae65f7a0-750f-5818-a02a-e8b1d41fbb67, identifier: YA63127
2026-03-29 18:45:02 [auto1.de] INFO: Found listing with ID: WG52031
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG52031%27 HTTP/1.1" 200 None
2026-03-29 18:45:02 [auto1.de] INFO: Scrape type for WG52031: 2
2026-03-29 18:45:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e775dedb-ac94-5a4a-ba6a-fefedb8fd15c with identifier: WG52031
2026-03-29 18:45:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e775dedb-ac94-5a4a-ba6a-fefedb8fd15c with scrape type 2
2026-03-29 18:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e775dedb-ac94-5a4a-ba6a-fefedb8fd15c with scrape type 2
2026-03-29 18:45:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e775dedb-ac94-5a4a-ba6a-fefedb8fd15c, identifier: WG52031
2026-03-29 18:45:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae65f7a0-750f-5818-a02a-e8b1d41fbb67 with identifier: YA63127
2026-03-29 18:45:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae65f7a0-750f-5818-a02a-e8b1d41fbb67 with identifier: YA63127
2026-03-29 18:45:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae65f7a0-750f-5818-a02a-e8b1d41fbb67 with identifier: YA63127 to the API
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:20:34Z',
'fuel_type': 'petrol',
'id': 'ae65f7a0-750f-5818-a02a-e8b1d41fbb67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA63127',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 167272,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-05',
'seller_name': None,
'title': 'Seat Ibiza 1.4 Best of',
'transmission': 'manual',
'trim': 'Best of',
'year': 2009}
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA63127%27 HTTP/1.1" 200 None
2026-03-29 18:45:02 [auto1.de] INFO: Saving data for YA63127: {'auction_closing_time': 1774884034.0, 'created_time': 1773468426.08751, 'last_price_update_time': 1774809902.866539}
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA63127') HTTP/1.1" 204 0
2026-03-29 18:45:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e775dedb-ac94-5a4a-ba6a-fefedb8fd15c with identifier: WG52031
2026-03-29 18:45:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e775dedb-ac94-5a4a-ba6a-fefedb8fd15c with identifier: WG52031
2026-03-29 18:45:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e775dedb-ac94-5a4a-ba6a-fefedb8fd15c with identifier: WG52031 to the API
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:22:33Z',
'fuel_type': 'petrol',
'id': 'e775dedb-ac94-5a4a-ba6a-fefedb8fd15c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG52031',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 207752,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-05',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2010}
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG52031%27 HTTP/1.1" 200 None
2026-03-29 18:45:03 [auto1.de] INFO: Saving data for WG52031: {'auction_closing_time': 1774884153.0, 'created_time': 1774723180.527355, 'last_price_update_time': 1774809903.195857}
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG52031') HTTP/1.1" 204 0
2026-03-29 18:45:03 [auto1.de] INFO: Found listing with ID: YD24318
2026-03-29 18:45:03 [auto1.de] INFO: Found listing with ID: FZ76900
2026-03-29 18:45:03 [auto1.de] INFO: Found listing with ID: PS79135
2026-03-29 18:45:03 [auto1.de] INFO: Found listing with ID: WK48382
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK48382%27 HTTP/1.1" 200 None
2026-03-29 18:45:03 [auto1.de] INFO: Scrape type for WK48382: 2
2026-03-29 18:45:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c914e6e-551b-5156-a1a0-2f722acde46b with identifier: WK48382
2026-03-29 18:45:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c914e6e-551b-5156-a1a0-2f722acde46b with scrape type 2
2026-03-29 18:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c914e6e-551b-5156-a1a0-2f722acde46b with scrape type 2
2026-03-29 18:45:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c914e6e-551b-5156-a1a0-2f722acde46b, identifier: WK48382
2026-03-29 18:45:03 [auto1.de] INFO: Found listing with ID: RY75144
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY75144%27 HTTP/1.1" 200 None
2026-03-29 18:45:03 [auto1.de] INFO: Scrape type for RY75144: 2
2026-03-29 18:45:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b with identifier: RY75144
2026-03-29 18:45:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b with scrape type 2
2026-03-29 18:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b with scrape type 2
2026-03-29 18:45:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b, identifier: RY75144
2026-03-29 18:45:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c914e6e-551b-5156-a1a0-2f722acde46b with identifier: WK48382
2026-03-29 18:45:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c914e6e-551b-5156-a1a0-2f722acde46b with identifier: WK48382
2026-03-29 18:45:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c914e6e-551b-5156-a1a0-2f722acde46b with identifier: WK48382 to the API
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:48:31Z',
'fuel_type': 'petrol',
'id': '6c914e6e-551b-5156-a1a0-2f722acde46b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK48382',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand Tourneo Connect',
'odometer': 114010,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-27',
'seller_name': None,
'title': 'Ford Grand Tourneo Connect 1.6 EcoBoost Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2014}
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK48382%27 HTTP/1.1" 200 None
2026-03-29 18:45:03 [auto1.de] INFO: Saving data for WK48382: {'auction_closing_time': 1774885711.0, 'created_time': 1774032265.601091, 'last_price_update_time': 1774809903.733097}
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK48382') HTTP/1.1" 204 0
2026-03-29 18:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b with identifier: RY75144
2026-03-29 18:45:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b with identifier: RY75144
2026-03-29 18:45:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b with identifier: RY75144 to the API
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:32:57Z',
'fuel_type': 'petrol',
'id': '8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY75144',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 224496,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-16',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2008}
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY75144%27 HTTP/1.1" 200 None
2026-03-29 18:45:04 [auto1.de] INFO: Saving data for RY75144: {'auction_closing_time': 1774884777.0, 'created_time': 1773467166.825408, 'last_price_update_time': 1774809904.14689}
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY75144') HTTP/1.1" 204 0
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: AN23805
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN23805%27 HTTP/1.1" 200 None
2026-03-29 18:45:04 [auto1.de] INFO: Scrape type for AN23805: 2
2026-03-29 18:45:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5683f740-4a0f-5859-978a-0a45bc7bc823 with identifier: AN23805
2026-03-29 18:45:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5683f740-4a0f-5859-978a-0a45bc7bc823 with scrape type 2
2026-03-29 18:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5683f740-4a0f-5859-978a-0a45bc7bc823 with scrape type 2
2026-03-29 18:45:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5683f740-4a0f-5859-978a-0a45bc7bc823, identifier: AN23805
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: BX11542
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11542%27 HTTP/1.1" 200 None
2026-03-29 18:45:04 [auto1.de] INFO: Scrape type for BX11542: 2
2026-03-29 18:45:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2dc50cf-e7f5-5826-b9e8-f39c7a089710 with identifier: BX11542
2026-03-29 18:45:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2dc50cf-e7f5-5826-b9e8-f39c7a089710 with scrape type 2
2026-03-29 18:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2dc50cf-e7f5-5826-b9e8-f39c7a089710 with scrape type 2
2026-03-29 18:45:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2dc50cf-e7f5-5826-b9e8-f39c7a089710, identifier: BX11542
2026-03-29 18:45:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5683f740-4a0f-5859-978a-0a45bc7bc823 with identifier: AN23805
2026-03-29 18:45:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5683f740-4a0f-5859-978a-0a45bc7bc823 with identifier: AN23805
2026-03-29 18:45:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5683f740-4a0f-5859-978a-0a45bc7bc823 with identifier: AN23805 to the API
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:56:44Z',
'fuel_type': 'petrol',
'id': '5683f740-4a0f-5859-978a-0a45bc7bc823',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN23805',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 32093,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-03',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2020}
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN23805%27 HTTP/1.1" 200 None
2026-03-29 18:45:04 [auto1.de] INFO: Saving data for AN23805: {'auction_closing_time': 1774886204.0, 'created_time': 1774002418.362973, 'last_price_update_time': 1774809904.692466}
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN23805') HTTP/1.1" 204 0
2026-03-29 18:45:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2dc50cf-e7f5-5826-b9e8-f39c7a089710 with identifier: BX11542
2026-03-29 18:45:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2dc50cf-e7f5-5826-b9e8-f39c7a089710 with identifier: BX11542
2026-03-29 18:45:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2dc50cf-e7f5-5826-b9e8-f39c7a089710 with identifier: BX11542 to the API
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:36:13Z',
'fuel_type': 'diesel',
'id': 'f2dc50cf-e7f5-5826-b9e8-f39c7a089710',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX11542',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 124705,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-25',
'seller_name': None,
'title': 'BMW 3er 320d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2018}
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11542%27 HTTP/1.1" 200 None
2026-03-29 18:45:05 [auto1.de] INFO: Saving data for BX11542: {'auction_closing_time': 1774884973.0, 'created_time': 1774089290.329934, 'last_price_update_time': 1774809905.010959}
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX11542') HTTP/1.1" 204 0
2026-03-29 18:45:05 [auto1.de] INFO: Found listing with ID: VL97674
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL97674%27 HTTP/1.1" 200 None
2026-03-29 18:45:05 [auto1.de] INFO: Scrape type for VL97674: 2
2026-03-29 18:45:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 105db2dd-cf74-5108-900a-6bc078914458 with identifier: VL97674
2026-03-29 18:45:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 105db2dd-cf74-5108-900a-6bc078914458 with scrape type 2
2026-03-29 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 105db2dd-cf74-5108-900a-6bc078914458 with scrape type 2
2026-03-29 18:45:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 105db2dd-cf74-5108-900a-6bc078914458, identifier: VL97674
2026-03-29 18:45:05 [auto1.de] INFO: Found listing with ID: FL40114
2026-03-29 18:45:05 [auto1.de] INFO: Found listing with ID: DN27813
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN27813%27 HTTP/1.1" 200 None
2026-03-29 18:45:05 [auto1.de] INFO: Scrape type for DN27813: 2
2026-03-29 18:45:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d634bd74-c1f6-5fe3-b1e2-142c8b353073 with identifier: DN27813
2026-03-29 18:45:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d634bd74-c1f6-5fe3-b1e2-142c8b353073 with scrape type 2
2026-03-29 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d634bd74-c1f6-5fe3-b1e2-142c8b353073 with scrape type 2
2026-03-29 18:45:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d634bd74-c1f6-5fe3-b1e2-142c8b353073, identifier: DN27813
2026-03-29 18:45:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 105db2dd-cf74-5108-900a-6bc078914458 with identifier: VL97674
2026-03-29 18:45:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 105db2dd-cf74-5108-900a-6bc078914458 with identifier: VL97674
2026-03-29 18:45:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 105db2dd-cf74-5108-900a-6bc078914458 with identifier: VL97674 to the API
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:19:46Z',
'fuel_type': 'diesel',
'id': '105db2dd-cf74-5108-900a-6bc078914458',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL97674',
'listing': 'auction',
'make': 'Mazda',
'model': '6',
'odometer': 344337,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-22',
'seller_name': None,
'title': 'Mazda 6 2.2 Turbodiesel CRDT Dynamic',
'transmission': 'manual',
'trim': 'CRDT Dynamic',
'year': 2009}
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL97674%27 HTTP/1.1" 200 None
2026-03-29 18:45:05 [auto1.de] INFO: Saving data for VL97674: {'auction_closing_time': 1774883986.0, 'created_time': 1774723152.375741, 'last_price_update_time': 1774809905.518655}
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL97674') HTTP/1.1" 204 0
2026-03-29 18:45:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d634bd74-c1f6-5fe3-b1e2-142c8b353073 with identifier: DN27813
2026-03-29 18:45:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d634bd74-c1f6-5fe3-b1e2-142c8b353073 with identifier: DN27813
2026-03-29 18:45:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d634bd74-c1f6-5fe3-b1e2-142c8b353073 with identifier: DN27813 to the API
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:44:07Z',
'fuel_type': 'petrol',
'id': 'd634bd74-c1f6-5fe3-b1e2-142c8b353073',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN27813',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 162149,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-03',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Allstar BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Allstar BlueMotion Tech',
'year': 2016}
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN27813%27 HTTP/1.1" 200 None
2026-03-29 18:45:05 [auto1.de] INFO: Saving data for DN27813: {'auction_closing_time': 1774885447.0, 'created_time': 1773467068.601377, 'last_price_update_time': 1774809905.800157}
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN27813') HTTP/1.1" 204 0
2026-03-29 18:45:05 [auto1.de] INFO: Found listing with ID: UT78656
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT78656%27 HTTP/1.1" 200 None
2026-03-29 18:45:05 [auto1.de] INFO: Scrape type for UT78656: 2
2026-03-29 18:45:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b714401e-9962-5387-8e81-7592c2f2aa1b with identifier: UT78656
2026-03-29 18:45:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b714401e-9962-5387-8e81-7592c2f2aa1b with scrape type 2
2026-03-29 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b714401e-9962-5387-8e81-7592c2f2aa1b with scrape type 2
2026-03-29 18:45:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b714401e-9962-5387-8e81-7592c2f2aa1b, identifier: UT78656
2026-03-29 18:45:05 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b714401e-9962-5387-8e81-7592c2f2aa1b with identifier: UT78656
2026-03-29 18:45:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b714401e-9962-5387-8e81-7592c2f2aa1b with identifier: UT78656
2026-03-29 18:45:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b714401e-9962-5387-8e81-7592c2f2aa1b with identifier: UT78656 to the API
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:37:24Z',
'fuel_type': 'diesel',
'id': 'b714401e-9962-5387-8e81-7592c2f2aa1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT78656',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 149353,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-23',
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2016}
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT78656%27 HTTP/1.1" 200 None
2026-03-29 18:45:06 [auto1.de] INFO: Saving data for UT78656: {'auction_closing_time': 1774885044.0, 'created_time': 1774033870.139506, 'last_price_update_time': 1774809906.229003}
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT78656') HTTP/1.1" 204 0
2026-03-29 18:45:06 [auto1.de] INFO: Found listing with ID: JE05181
2026-03-29 18:45:06 [auto1.de] INFO: Found listing with ID: LZ68363
2026-03-29 18:45:06 [auto1.de] INFO: Found listing with ID: RT81127
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT81127%27 HTTP/1.1" 200 None
2026-03-29 18:45:06 [auto1.de] INFO: Scrape type for RT81127: 2
2026-03-29 18:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41602036-a196-58ac-a10a-b835e715b5c2 with identifier: RT81127
2026-03-29 18:45:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41602036-a196-58ac-a10a-b835e715b5c2 with scrape type 2
2026-03-29 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41602036-a196-58ac-a10a-b835e715b5c2 with scrape type 2
2026-03-29 18:45:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41602036-a196-58ac-a10a-b835e715b5c2, identifier: RT81127
2026-03-29 18:45:06 [auto1.de] INFO: Found listing with ID: NR79425
2026-03-29 18:45:06 [auto1.de] INFO: Found listing with ID: CY46145
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY46145%27 HTTP/1.1" 200 None
2026-03-29 18:45:06 [auto1.de] INFO: Scrape type for CY46145: 2
2026-03-29 18:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c24ca72-b933-536f-8cbd-b6c26b1561e4 with identifier: CY46145
2026-03-29 18:45:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4 with scrape type 2
2026-03-29 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4 with scrape type 2
2026-03-29 18:45:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c24ca72-b933-536f-8cbd-b6c26b1561e4, identifier: CY46145
2026-03-29 18:45:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41602036-a196-58ac-a10a-b835e715b5c2 with identifier: RT81127
2026-03-29 18:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41602036-a196-58ac-a10a-b835e715b5c2 with identifier: RT81127
2026-03-29 18:45:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41602036-a196-58ac-a10a-b835e715b5c2 with identifier: RT81127 to the API
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:13:28Z',
'fuel_type': 'petrol',
'id': '41602036-a196-58ac-a10a-b835e715b5c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT81127',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 28327,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-06',
'seller_name': None,
'title': 'Audi A4 35 TFSI Mild-Hybrid S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2022}
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT81127%27 HTTP/1.1" 200 None
2026-03-29 18:45:06 [auto1.de] INFO: Saving data for RT81127: {'auction_closing_time': 1774883608.0, 'created_time': 1774118462.290301, 'last_price_update_time': 1774809906.752152}
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT81127') HTTP/1.1" 204 0
2026-03-29 18:45:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c24ca72-b933-536f-8cbd-b6c26b1561e4 with identifier: CY46145
2026-03-29 18:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c24ca72-b933-536f-8cbd-b6c26b1561e4 with identifier: CY46145
2026-03-29 18:45:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c24ca72-b933-536f-8cbd-b6c26b1561e4 with identifier: CY46145 to the API
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:59:08Z',
'fuel_type': 'diesel',
'id': '9c24ca72-b933-536f-8cbd-b6c26b1561e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY46145',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 128169,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-17',
'seller_name': None,
'title': 'Mazda CX-3 1.5 Diesel Sports-Line',
'transmission': 'manual',
'trim': 'Sports-Line',
'year': 2017}
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY46145%27 HTTP/1.1" 200 None
2026-03-29 18:45:07 [auto1.de] INFO: Saving data for CY46145: {'auction_closing_time': 1774886348.0, 'created_time': 1774723166.112485, 'last_price_update_time': 1774809907.21548}
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY46145') HTTP/1.1" 204 0
2026-03-29 18:45:07 [scrapy.extensions.logstats] INFO: Crawled 158 pages (at 7 pages/min), scraped 1387 items (at 127 items/min)
2026-03-29 18:45:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: XL66615
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: KK21790
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK21790%27 HTTP/1.1" 200 None
2026-03-29 18:45:07 [auto1.de] INFO: Scrape type for KK21790: 2
2026-03-29 18:45:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbe07466-0fc4-5269-9979-5ea0279ff55d with identifier: KK21790
2026-03-29 18:45:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbe07466-0fc4-5269-9979-5ea0279ff55d with scrape type 2
2026-03-29 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbe07466-0fc4-5269-9979-5ea0279ff55d with scrape type 2
2026-03-29 18:45:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbe07466-0fc4-5269-9979-5ea0279ff55d, identifier: KK21790
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: UF03546
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: NC58057
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC58057%27 HTTP/1.1" 200 None
2026-03-29 18:45:07 [auto1.de] INFO: Scrape type for NC58057: 2
2026-03-29 18:45:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a36fa4d-7c8d-571d-97c1-c9eed649ec61 with identifier: NC58057
2026-03-29 18:45:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61 with scrape type 2
2026-03-29 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61 with scrape type 2
2026-03-29 18:45:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a36fa4d-7c8d-571d-97c1-c9eed649ec61, identifier: NC58057
2026-03-29 18:45:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbe07466-0fc4-5269-9979-5ea0279ff55d with identifier: KK21790
2026-03-29 18:45:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbe07466-0fc4-5269-9979-5ea0279ff55d with identifier: KK21790
2026-03-29 18:45:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbe07466-0fc4-5269-9979-5ea0279ff55d with identifier: KK21790 to the API
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:20:34Z',
'fuel_type': 'diesel',
'id': 'bbe07466-0fc4-5269-9979-5ea0279ff55d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK21790',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 198769,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-19',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI SportLine',
'transmission': 'automatic',
'trim': 'SportLine',
'year': 2017}
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK21790%27 HTTP/1.1" 200 None
2026-03-29 18:45:07 [auto1.de] INFO: Saving data for KK21790: {'auction_closing_time': 1774884034.0, 'created_time': 1774723164.788591, 'last_price_update_time': 1774809907.740722}
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK21790') HTTP/1.1" 204 0
2026-03-29 18:45:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a36fa4d-7c8d-571d-97c1-c9eed649ec61 with identifier: NC58057
2026-03-29 18:45:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a36fa4d-7c8d-571d-97c1-c9eed649ec61 with identifier: NC58057
2026-03-29 18:45:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a36fa4d-7c8d-571d-97c1-c9eed649ec61 with identifier: NC58057 to the API
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:00:59Z',
'fuel_type': 'diesel',
'id': '9a36fa4d-7c8d-571d-97c1-c9eed649ec61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC58057',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 86541,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-29',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI GSi 4x4',
'transmission': 'automatic',
'trim': 'GSi 4x4',
'year': 2019}
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC58057%27 HTTP/1.1" 200 None
2026-03-29 18:45:08 [auto1.de] INFO: Saving data for NC58057: {'auction_closing_time': 1774882859.0, 'created_time': 1774723161.314941, 'last_price_update_time': 1774809908.070969}
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC58057') HTTP/1.1" 204 0
2026-03-29 18:45:08 [auto1.de] INFO: Found listing with ID: TV45930
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV45930%27 HTTP/1.1" 200 None
2026-03-29 18:45:08 [auto1.de] INFO: Scrape type for TV45930: 2
2026-03-29 18:45:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4046d8ea-80e9-52f3-8d98-06dca29c5a7a with identifier: TV45930
2026-03-29 18:45:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4046d8ea-80e9-52f3-8d98-06dca29c5a7a with scrape type 2
2026-03-29 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4046d8ea-80e9-52f3-8d98-06dca29c5a7a with scrape type 2
2026-03-29 18:45:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4046d8ea-80e9-52f3-8d98-06dca29c5a7a, identifier: TV45930
2026-03-29 18:45:08 [auto1.de] INFO: Found listing with ID: TF03370
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF03370%27 HTTP/1.1" 200 None
2026-03-29 18:45:08 [auto1.de] INFO: Scrape type for TF03370: 2
2026-03-29 18:45:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4312e30-df26-5dbf-99de-c14e960b5fc2 with identifier: TF03370
2026-03-29 18:45:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4312e30-df26-5dbf-99de-c14e960b5fc2 with scrape type 2
2026-03-29 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4312e30-df26-5dbf-99de-c14e960b5fc2 with scrape type 2
2026-03-29 18:45:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4312e30-df26-5dbf-99de-c14e960b5fc2, identifier: TF03370
2026-03-29 18:45:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4046d8ea-80e9-52f3-8d98-06dca29c5a7a with identifier: TV45930
2026-03-29 18:45:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4046d8ea-80e9-52f3-8d98-06dca29c5a7a with identifier: TV45930
2026-03-29 18:45:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4046d8ea-80e9-52f3-8d98-06dca29c5a7a with identifier: TV45930 to the API
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:13:56Z',
'fuel_type': 'diesel',
'id': '4046d8ea-80e9-52f3-8d98-06dca29c5a7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV45930',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 158458,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-26',
'seller_name': None,
'title': 'BMW 1er 116d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV45930%27 HTTP/1.1" 200 None
2026-03-29 18:45:08 [auto1.de] INFO: Saving data for TV45930: {'auction_closing_time': 1774883636.0, 'created_time': 1774723173.107617, 'last_price_update_time': 1774809908.616886}
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV45930') HTTP/1.1" 204 0
2026-03-29 18:45:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4312e30-df26-5dbf-99de-c14e960b5fc2 with identifier: TF03370
2026-03-29 18:45:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4312e30-df26-5dbf-99de-c14e960b5fc2 with identifier: TF03370
2026-03-29 18:45:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4312e30-df26-5dbf-99de-c14e960b5fc2 with identifier: TF03370 to the API
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:12:01Z',
'fuel_type': 'petrol',
'id': 'a4312e30-df26-5dbf-99de-c14e960b5fc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF03370',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 138435,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-04',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2019}
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF03370%27 HTTP/1.1" 200 None
2026-03-29 18:45:08 [auto1.de] INFO: Saving data for TF03370: {'auction_closing_time': 1774883521.0, 'created_time': 1774089260.114088, 'last_price_update_time': 1774809908.932519}
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF03370') HTTP/1.1" 204 0
2026-03-29 18:45:08 [auto1.de] INFO: Found listing with ID: DZ20117
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ20117%27 HTTP/1.1" 200 None
2026-03-29 18:45:08 [auto1.de] INFO: Scrape type for DZ20117: 2
2026-03-29 18:45:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5cbd75d-099e-5368-8b3e-6c08a3ce15e7 with identifier: DZ20117
2026-03-29 18:45:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7 with scrape type 2
2026-03-29 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7 with scrape type 2
2026-03-29 18:45:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5cbd75d-099e-5368-8b3e-6c08a3ce15e7, identifier: DZ20117
2026-03-29 18:45:09 [auto1.de] INFO: Found listing with ID: WU29396
2026-03-29 18:45:09 [auto1.de] INFO: Found listing with ID: FF37262
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF37262%27 HTTP/1.1" 200 None
2026-03-29 18:45:09 [auto1.de] INFO: Scrape type for FF37262: 2
2026-03-29 18:45:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69123462-e44f-57c2-9892-304418727428 with identifier: FF37262
2026-03-29 18:45:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69123462-e44f-57c2-9892-304418727428 with scrape type 2
2026-03-29 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69123462-e44f-57c2-9892-304418727428 with scrape type 2
2026-03-29 18:45:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69123462-e44f-57c2-9892-304418727428, identifier: FF37262
2026-03-29 18:45:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5cbd75d-099e-5368-8b3e-6c08a3ce15e7 with identifier: DZ20117
2026-03-29 18:45:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5cbd75d-099e-5368-8b3e-6c08a3ce15e7 with identifier: DZ20117
2026-03-29 18:45:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5cbd75d-099e-5368-8b3e-6c08a3ce15e7 with identifier: DZ20117 to the API
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:56:53Z',
'fuel_type': 'petrol',
'id': 'c5cbd75d-099e-5368-8b3e-6c08a3ce15e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ20117',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 96552,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-17',
'seller_name': None,
'title': 'Opel Corsa 1.2 Turbo Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2020}
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ20117%27 HTTP/1.1" 200 None
2026-03-29 18:45:09 [auto1.de] INFO: Saving data for DZ20117: {'auction_closing_time': 1774886213.0, 'created_time': 1774723181.23303, 'last_price_update_time': 1774809909.44884}
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ20117') HTTP/1.1" 204 0
2026-03-29 18:45:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69123462-e44f-57c2-9892-304418727428 with identifier: FF37262
2026-03-29 18:45:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69123462-e44f-57c2-9892-304418727428 with identifier: FF37262
2026-03-29 18:45:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69123462-e44f-57c2-9892-304418727428 with identifier: FF37262 to the API
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:22:47Z',
'fuel_type': 'diesel',
'id': '69123462-e44f-57c2-9892-304418727428',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF37262',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 242728,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-29',
'seller_name': None,
'title': 'Audi Q3 35 TDI Advanced',
'transmission': 'automatic',
'trim': 'Advanced',
'year': 2020}
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF37262%27 HTTP/1.1" 200 None
2026-03-29 18:45:09 [auto1.de] INFO: Saving data for FF37262: {'auction_closing_time': 1774884167.0, 'created_time': 1773467615.460534, 'last_price_update_time': 1774809909.735097}
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF37262') HTTP/1.1" 204 0
2026-03-29 18:45:09 [auto1.de] INFO: Found listing with ID: BR60141
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR60141%27 HTTP/1.1" 200 None
2026-03-29 18:45:09 [auto1.de] INFO: Scrape type for BR60141: 2
2026-03-29 18:45:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b57e57e-74f2-5cfb-9a85-b4e9244a55e2 with identifier: BR60141
2026-03-29 18:45:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b57e57e-74f2-5cfb-9a85-b4e9244a55e2 with scrape type 2
2026-03-29 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b57e57e-74f2-5cfb-9a85-b4e9244a55e2 with scrape type 2
2026-03-29 18:45:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b57e57e-74f2-5cfb-9a85-b4e9244a55e2, identifier: BR60141
2026-03-29 18:45:09 [auto1.de] INFO: Found listing with ID: UL28707
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL28707%27 HTTP/1.1" 200 None
2026-03-29 18:45:09 [auto1.de] INFO: Scrape type for UL28707: 2
2026-03-29 18:45:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a with identifier: UL28707
2026-03-29 18:45:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a with scrape type 2
2026-03-29 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a with scrape type 2
2026-03-29 18:45:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a, identifier: UL28707
2026-03-29 18:45:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b57e57e-74f2-5cfb-9a85-b4e9244a55e2 with identifier: BR60141
2026-03-29 18:45:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b57e57e-74f2-5cfb-9a85-b4e9244a55e2 with identifier: BR60141
2026-03-29 18:45:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b57e57e-74f2-5cfb-9a85-b4e9244a55e2 with identifier: BR60141 to the API
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:58:58Z',
'fuel_type': 'diesel',
'id': '2b57e57e-74f2-5cfb-9a85-b4e9244a55e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR60141',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 204753,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-19',
'seller_name': None,
'title': 'Peugeot 5008 1.6 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2017}
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR60141%27 HTTP/1.1" 200 None
2026-03-29 18:45:10 [auto1.de] INFO: Saving data for BR60141: {'auction_closing_time': 1774886338.0, 'created_time': 1774118789.272518, 'last_price_update_time': 1774809910.544882}
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR60141') HTTP/1.1" 204 0
2026-03-29 18:45:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a with identifier: UL28707
2026-03-29 18:45:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a with identifier: UL28707
2026-03-29 18:45:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a with identifier: UL28707 to the API
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:39:32Z',
'fuel_type': 'petrol',
'id': '9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL28707',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 160452,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-08-23',
'seller_name': None,
'title': 'Smart fortwo 1.0 Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2007}
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL28707%27 HTTP/1.1" 200 None
2026-03-29 18:45:10 [auto1.de] INFO: Saving data for UL28707: {'auction_closing_time': 1774885172.0, 'created_time': 1774723155.467399, 'last_price_update_time': 1774809910.943114}
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL28707') HTTP/1.1" 204 0
2026-03-29 18:45:10 [auto1.de] INFO: Found listing with ID: UA53111
2026-03-29 18:45:10 [auto1.de] INFO: Found listing with ID: YA36470
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA36470%27 HTTP/1.1" 200 None
2026-03-29 18:45:10 [auto1.de] INFO: Scrape type for YA36470: 2
2026-03-29 18:45:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a64e03ec-259b-5e4c-a17f-ec74d14ffb64 with identifier: YA36470
2026-03-29 18:45:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64 with scrape type 2
2026-03-29 18:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64 with scrape type 2
2026-03-29 18:45:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a64e03ec-259b-5e4c-a17f-ec74d14ffb64, identifier: YA36470
2026-03-29 18:45:11 [auto1.de] INFO: Found listing with ID: LM47126
2026-03-29 18:45:11 [auto1.de] INFO: Found listing with ID: FR17679
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR17679%27 HTTP/1.1" 200 None
2026-03-29 18:45:11 [auto1.de] INFO: Scrape type for FR17679: 2
2026-03-29 18:45:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78c7c86b-7048-5056-8bc6-3becd66be11c with identifier: FR17679
2026-03-29 18:45:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c7c86b-7048-5056-8bc6-3becd66be11c with scrape type 2
2026-03-29 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78c7c86b-7048-5056-8bc6-3becd66be11c with scrape type 2
2026-03-29 18:45:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78c7c86b-7048-5056-8bc6-3becd66be11c, identifier: FR17679
2026-03-29 18:45:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a64e03ec-259b-5e4c-a17f-ec74d14ffb64 with identifier: YA36470
2026-03-29 18:45:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a64e03ec-259b-5e4c-a17f-ec74d14ffb64 with identifier: YA36470
2026-03-29 18:45:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a64e03ec-259b-5e4c-a17f-ec74d14ffb64 with identifier: YA36470 to the API
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:59:16Z',
'fuel_type': 'petrol',
'id': 'a64e03ec-259b-5e4c-a17f-ec74d14ffb64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA36470',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 159869,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-17',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trend & Fun BlueMotion Tech',
'year': 2013}
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA36470%27 HTTP/1.1" 200 None
2026-03-29 18:45:11 [auto1.de] INFO: Saving data for YA36470: {'auction_closing_time': 1774886356.0, 'created_time': 1774723184.573017, 'last_price_update_time': 1774809911.48257}
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA36470') HTTP/1.1" 204 0
2026-03-29 18:45:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78c7c86b-7048-5056-8bc6-3becd66be11c with identifier: FR17679
2026-03-29 18:45:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78c7c86b-7048-5056-8bc6-3becd66be11c with identifier: FR17679
2026-03-29 18:45:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78c7c86b-7048-5056-8bc6-3becd66be11c with identifier: FR17679 to the API
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:59:50Z',
'fuel_type': 'diesel',
'id': '78c7c86b-7048-5056-8bc6-3becd66be11c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR17679',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 51539,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-21',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TDI GTD',
'transmission': 'automatic',
'trim': 'GTD',
'year': 2020}
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR17679%27 HTTP/1.1" 200 None
2026-03-29 18:45:11 [auto1.de] INFO: Saving data for FR17679: {'auction_closing_time': 1774886390.0, 'created_time': 1774723149.559941, 'last_price_update_time': 1774809911.769505}
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR17679') HTTP/1.1" 204 0
2026-03-29 18:45:11 [auto1.de] INFO: Found listing with ID: VR29597
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR29597%27 HTTP/1.1" 200 None
2026-03-29 18:45:11 [auto1.de] INFO: Scrape type for VR29597: 2
2026-03-29 18:45:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bfce597-aa07-525a-9379-4a3e07dff8cd with identifier: VR29597
2026-03-29 18:45:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bfce597-aa07-525a-9379-4a3e07dff8cd with scrape type 2
2026-03-29 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bfce597-aa07-525a-9379-4a3e07dff8cd with scrape type 2
2026-03-29 18:45:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bfce597-aa07-525a-9379-4a3e07dff8cd, identifier: VR29597
2026-03-29 18:45:11 [auto1.de] INFO: Found listing with ID: XG50299
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG50299%27 HTTP/1.1" 200 None
2026-03-29 18:45:11 [auto1.de] INFO: Scrape type for XG50299: 2
2026-03-29 18:45:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3e68cb3-820c-594d-9249-2b401bfad698 with identifier: XG50299
2026-03-29 18:45:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3e68cb3-820c-594d-9249-2b401bfad698 with scrape type 2
2026-03-29 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3e68cb3-820c-594d-9249-2b401bfad698 with scrape type 2
2026-03-29 18:45:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3e68cb3-820c-594d-9249-2b401bfad698, identifier: XG50299
2026-03-29 18:45:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bfce597-aa07-525a-9379-4a3e07dff8cd with identifier: VR29597
2026-03-29 18:45:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bfce597-aa07-525a-9379-4a3e07dff8cd with identifier: VR29597
2026-03-29 18:45:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bfce597-aa07-525a-9379-4a3e07dff8cd with identifier: VR29597 to the API
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:25:30Z',
'fuel_type': 'petrol',
'id': '2bfce597-aa07-525a-9379-4a3e07dff8cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR29597',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 49968,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-21',
'seller_name': None,
'title': 'Ford Ka 1.2 Champions Edition',
'transmission': 'manual',
'trim': 'Champions Edition',
'year': 2013}
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR29597%27 HTTP/1.1" 200 None
2026-03-29 18:45:12 [auto1.de] INFO: Saving data for VR29597: {'auction_closing_time': 1774884330.0, 'created_time': 1774723180.19054, 'last_price_update_time': 1774809912.29472}
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR29597') HTTP/1.1" 204 0
2026-03-29 18:45:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3e68cb3-820c-594d-9249-2b401bfad698 with identifier: XG50299
2026-03-29 18:45:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3e68cb3-820c-594d-9249-2b401bfad698 with identifier: XG50299
2026-03-29 18:45:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3e68cb3-820c-594d-9249-2b401bfad698 with identifier: XG50299 to the API
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 286,
'expiration_date': '2026-03-30T15:24:45Z',
'fuel_type': 'diesel',
'id': 'b3e68cb3-820c-594d-9249-2b401bfad698',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG50299',
'listing': 'auction',
'make': 'Audi',
'model': 'A7 Sportback',
'odometer': 114863,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-13',
'seller_name': None,
'title': 'Audi A7 Sportback 50 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2019}
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG50299%27 HTTP/1.1" 200 None
2026-03-29 18:45:12 [auto1.de] INFO: Saving data for XG50299: {'auction_closing_time': 1774884285.0, 'created_time': 1773468492.104845, 'last_price_update_time': 1774809912.606914}
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG50299') HTTP/1.1" 204 0
2026-03-29 18:45:12 [auto1.de] INFO: Found listing with ID: LT01381
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01381%27 HTTP/1.1" 200 None
2026-03-29 18:45:12 [auto1.de] INFO: Scrape type for LT01381: 2
2026-03-29 18:45:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bd0cde0-9912-584d-a0ae-f7dadeb5a3be with identifier: LT01381
2026-03-29 18:45:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bd0cde0-9912-584d-a0ae-f7dadeb5a3be with scrape type 2
2026-03-29 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bd0cde0-9912-584d-a0ae-f7dadeb5a3be with scrape type 2
2026-03-29 18:45:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9bd0cde0-9912-584d-a0ae-f7dadeb5a3be, identifier: LT01381
2026-03-29 18:45:12 [auto1.de] INFO: Found listing with ID: MU09493
2026-03-29 18:45:12 [auto1.de] INFO: Found listing with ID: VR85555
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85555%27 HTTP/1.1" 200 None
2026-03-29 18:45:12 [auto1.de] INFO: Scrape type for VR85555: 2
2026-03-29 18:45:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6bca207-63b8-554a-8933-8b1bfba7fd39 with identifier: VR85555
2026-03-29 18:45:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6bca207-63b8-554a-8933-8b1bfba7fd39 with scrape type 2
2026-03-29 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6bca207-63b8-554a-8933-8b1bfba7fd39 with scrape type 2
2026-03-29 18:45:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6bca207-63b8-554a-8933-8b1bfba7fd39, identifier: VR85555
2026-03-29 18:45:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9bd0cde0-9912-584d-a0ae-f7dadeb5a3be with identifier: LT01381
2026-03-29 18:45:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9bd0cde0-9912-584d-a0ae-f7dadeb5a3be with identifier: LT01381
2026-03-29 18:45:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9bd0cde0-9912-584d-a0ae-f7dadeb5a3be with identifier: LT01381 to the API
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:21:51Z',
'fuel_type': 'petrol',
'id': '9bd0cde0-9912-584d-a0ae-f7dadeb5a3be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT01381',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 120667,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-18',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01381%27 HTTP/1.1" 200 None
2026-03-29 18:45:13 [auto1.de] INFO: Saving data for LT01381: {'auction_closing_time': 1774884111.0, 'created_time': 1774723172.362027, 'last_price_update_time': 1774809913.149107}
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT01381') HTTP/1.1" 204 0
2026-03-29 18:45:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6bca207-63b8-554a-8933-8b1bfba7fd39 with identifier: VR85555
2026-03-29 18:45:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6bca207-63b8-554a-8933-8b1bfba7fd39 with identifier: VR85555
2026-03-29 18:45:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6bca207-63b8-554a-8933-8b1bfba7fd39 with identifier: VR85555 to the API
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:08:03Z',
'fuel_type': 'diesel',
'id': 'e6bca207-63b8-554a-8933-8b1bfba7fd39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR85555',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 95347,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-20',
'seller_name': None,
'title': 'BMW 1er 116d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85555%27 HTTP/1.1" 200 None
2026-03-29 18:45:13 [auto1.de] INFO: Saving data for VR85555: {'auction_closing_time': 1774883283.0, 'created_time': 1773467938.208149, 'last_price_update_time': 1774809913.437177}
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR85555') HTTP/1.1" 204 0
2026-03-29 18:45:13 [auto1.de] INFO: Found listing with ID: ZX19467
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX19467%27 HTTP/1.1" 200 None
2026-03-29 18:45:13 [auto1.de] INFO: Scrape type for ZX19467: 2
2026-03-29 18:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f26ae16-61d2-5d69-954e-8761dd2ee8c8 with identifier: ZX19467
2026-03-29 18:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f26ae16-61d2-5d69-954e-8761dd2ee8c8 with scrape type 2
2026-03-29 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f26ae16-61d2-5d69-954e-8761dd2ee8c8 with scrape type 2
2026-03-29 18:45:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f26ae16-61d2-5d69-954e-8761dd2ee8c8, identifier: ZX19467
2026-03-29 18:45:13 [auto1.de] INFO: Found listing with ID: VB32886
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB32886%27 HTTP/1.1" 200 None
2026-03-29 18:45:13 [auto1.de] INFO: Scrape type for VB32886: 2
2026-03-29 18:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02e8f92c-b115-5f86-b279-49633f2404c7 with identifier: VB32886
2026-03-29 18:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02e8f92c-b115-5f86-b279-49633f2404c7 with scrape type 2
2026-03-29 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02e8f92c-b115-5f86-b279-49633f2404c7 with scrape type 2
2026-03-29 18:45:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02e8f92c-b115-5f86-b279-49633f2404c7, identifier: VB32886
2026-03-29 18:45:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f26ae16-61d2-5d69-954e-8761dd2ee8c8 with identifier: ZX19467
2026-03-29 18:45:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f26ae16-61d2-5d69-954e-8761dd2ee8c8 with identifier: ZX19467
2026-03-29 18:45:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f26ae16-61d2-5d69-954e-8761dd2ee8c8 with identifier: ZX19467 to the API
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:45:47Z',
'fuel_type': 'diesel',
'id': '3f26ae16-61d2-5d69-954e-8761dd2ee8c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX19467',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 288606,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-29',
'seller_name': None,
'title': 'Opel Astra 1.7 CDTI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2012}
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX19467%27 HTTP/1.1" 200 None
2026-03-29 18:45:13 [auto1.de] INFO: Saving data for ZX19467: {'auction_closing_time': 1774885547.0, 'created_time': 1774723170.556902, 'last_price_update_time': 1774809913.973134}
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX19467') HTTP/1.1" 204 0
2026-03-29 18:45:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02e8f92c-b115-5f86-b279-49633f2404c7 with identifier: VB32886
2026-03-29 18:45:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02e8f92c-b115-5f86-b279-49633f2404c7 with identifier: VB32886
2026-03-29 18:45:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02e8f92c-b115-5f86-b279-49633f2404c7 with identifier: VB32886 to the API
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:43:35Z',
'fuel_type': 'petrol',
'id': '02e8f92c-b115-5f86-b279-49633f2404c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB32886',
'listing': 'auction',
'make': 'Opel',
'model': 'Agila',
'odometer': 117017,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-28',
'seller_name': None,
'title': 'Opel Agila 1.2 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2009}
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB32886%27 HTTP/1.1" 200 None
2026-03-29 18:45:14 [auto1.de] INFO: Saving data for VB32886: {'auction_closing_time': 1774885415.0, 'created_time': 1774723155.997376, 'last_price_update_time': 1774809914.374783}
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB32886') HTTP/1.1" 204 0
2026-03-29 18:45:14 [auto1.de] INFO: Found listing with ID: PL33602
2026-03-29 18:45:14 [auto1.de] INFO: Found listing with ID: BC54503
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC54503%27 HTTP/1.1" 200 None
2026-03-29 18:45:14 [auto1.de] INFO: Scrape type for BC54503: 2
2026-03-29 18:45:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81c07080-90bd-522c-ae92-4bf5d8519092 with identifier: BC54503
2026-03-29 18:45:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81c07080-90bd-522c-ae92-4bf5d8519092 with scrape type 2
2026-03-29 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81c07080-90bd-522c-ae92-4bf5d8519092 with scrape type 2
2026-03-29 18:45:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81c07080-90bd-522c-ae92-4bf5d8519092, identifier: BC54503
2026-03-29 18:45:14 [auto1.de] INFO: Found listing with ID: EF60589
2026-03-29 18:45:14 [auto1.de] INFO: Found listing with ID: MR72428
2026-03-29 18:45:14 [auto1.de] INFO: Found listing with ID: UT14776
2026-03-29 18:45:14 [auto1.de] INFO: Found listing with ID: DC55349
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC55349%27 HTTP/1.1" 200 None
2026-03-29 18:45:14 [auto1.de] INFO: Scrape type for DC55349: 2
2026-03-29 18:45:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79c5939e-6fe7-50c8-92bf-ab87d5a83779 with identifier: DC55349
2026-03-29 18:45:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779 with scrape type 2
2026-03-29 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779 with scrape type 2
2026-03-29 18:45:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79c5939e-6fe7-50c8-92bf-ab87d5a83779, identifier: DC55349
2026-03-29 18:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81c07080-90bd-522c-ae92-4bf5d8519092 with identifier: BC54503
2026-03-29 18:45:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81c07080-90bd-522c-ae92-4bf5d8519092 with identifier: BC54503
2026-03-29 18:45:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81c07080-90bd-522c-ae92-4bf5d8519092 with identifier: BC54503 to the API
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 475,
'expiration_date': '2026-03-30T15:26:44Z',
'fuel_type': 'petrol',
'id': '81c07080-90bd-522c-ae92-4bf5d8519092',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC54503',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 79633,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-04',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 63 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2020}
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC54503%27 HTTP/1.1" 200 None
2026-03-29 18:45:14 [auto1.de] INFO: Saving data for BC54503: {'auction_closing_time': 1774884404.0, 'created_time': 1774349626.958854, 'last_price_update_time': 1774809914.898084}
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC54503') HTTP/1.1" 204 0
2026-03-29 18:45:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79c5939e-6fe7-50c8-92bf-ab87d5a83779 with identifier: DC55349
2026-03-29 18:45:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79c5939e-6fe7-50c8-92bf-ab87d5a83779 with identifier: DC55349
2026-03-29 18:45:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79c5939e-6fe7-50c8-92bf-ab87d5a83779 with identifier: DC55349 to the API
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:10:40Z',
'fuel_type': 'diesel',
'id': '79c5939e-6fe7-50c8-92bf-ab87d5a83779',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC55349',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 168074,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-19',
'seller_name': None,
'title': 'Audi A5 Sportback 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC55349%27 HTTP/1.1" 200 None
2026-03-29 18:45:15 [auto1.de] INFO: Saving data for DC55349: {'auction_closing_time': 1774883440.0, 'created_time': 1774723160.237654, 'last_price_update_time': 1774809915.222001}
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC55349') HTTP/1.1" 204 0
2026-03-29 18:45:15 [auto1.de] INFO: Found listing with ID: SN24216
2026-03-29 18:45:15 [auto1.de] INFO: Found listing with ID: PR44802
2026-03-29 18:45:15 [auto1.de] INFO: Found listing with ID: YR75150
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75150%27 HTTP/1.1" 200 None
2026-03-29 18:45:15 [auto1.de] INFO: Scrape type for YR75150: 2
2026-03-29 18:45:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e18fad0-1376-5345-ac5b-7c55b77ccb77 with identifier: YR75150
2026-03-29 18:45:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77 with scrape type 2
2026-03-29 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77 with scrape type 2
2026-03-29 18:45:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e18fad0-1376-5345-ac5b-7c55b77ccb77, identifier: YR75150
2026-03-29 18:45:15 [auto1.de] INFO: Found listing with ID: LR58414
2026-03-29 18:45:15 [auto1.de] INFO: Found listing with ID: HM04559
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04559%27 HTTP/1.1" 200 None
2026-03-29 18:45:15 [auto1.de] INFO: Scrape type for HM04559: 2
2026-03-29 18:45:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4714717b-f17e-5bb4-9324-9add99afcd07 with identifier: HM04559
2026-03-29 18:45:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4714717b-f17e-5bb4-9324-9add99afcd07 with scrape type 2
2026-03-29 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4714717b-f17e-5bb4-9324-9add99afcd07 with scrape type 2
2026-03-29 18:45:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4714717b-f17e-5bb4-9324-9add99afcd07, identifier: HM04559
2026-03-29 18:45:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e18fad0-1376-5345-ac5b-7c55b77ccb77 with identifier: YR75150
2026-03-29 18:45:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e18fad0-1376-5345-ac5b-7c55b77ccb77 with identifier: YR75150
2026-03-29 18:45:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e18fad0-1376-5345-ac5b-7c55b77ccb77 with identifier: YR75150 to the API
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:38:21Z',
'fuel_type': 'petrol',
'id': '8e18fad0-1376-5345-ac5b-7c55b77ccb77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR75150',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 153087,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-27',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2011}
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75150%27 HTTP/1.1" 200 None
2026-03-29 18:45:15 [auto1.de] INFO: Saving data for YR75150: {'auction_closing_time': 1774885101.0, 'created_time': 1774723163.279956, 'last_price_update_time': 1774809915.77669}
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR75150') HTTP/1.1" 204 0
2026-03-29 18:45:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4714717b-f17e-5bb4-9324-9add99afcd07 with identifier: HM04559
2026-03-29 18:45:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4714717b-f17e-5bb4-9324-9add99afcd07 with identifier: HM04559
2026-03-29 18:45:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4714717b-f17e-5bb4-9324-9add99afcd07 with identifier: HM04559 to the API
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:33:58Z',
'fuel_type': 'petrol',
'id': '4714717b-f17e-5bb4-9324-9add99afcd07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM04559',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 28870,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-06-30',
'seller_name': None,
'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2024}
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04559%27 HTTP/1.1" 200 None
2026-03-29 18:45:16 [auto1.de] INFO: Saving data for HM04559: {'auction_closing_time': 1774884838.0, 'created_time': 1773469049.303585, 'last_price_update_time': 1774809916.224771}
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM04559') HTTP/1.1" 204 0
2026-03-29 18:45:16 [auto1.de] INFO: Found listing with ID: TP97389
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP97389%27 HTTP/1.1" 200 None
2026-03-29 18:45:16 [auto1.de] INFO: Scrape type for TP97389: 2
2026-03-29 18:45:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2532fc7-7fd5-587b-9ddd-7a98a8e5a503 with identifier: TP97389
2026-03-29 18:45:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503 with scrape type 2
2026-03-29 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503 with scrape type 2
2026-03-29 18:45:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2532fc7-7fd5-587b-9ddd-7a98a8e5a503, identifier: TP97389
2026-03-29 18:45:16 [auto1.de] INFO: Found listing with ID: EN17555
2026-03-29 18:45:16 [auto1.de] INFO: Found listing with ID: HN29475
2026-03-29 18:45:16 [auto1.de] INFO: Found listing with ID: UY60901
2026-03-29 18:45:16 [auto1.de] INFO: Found listing with ID: BE81625
2026-03-29 18:45:16 [auto1.de] INFO: Found listing with ID: CE21106
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE21106%27 HTTP/1.1" 200 None
2026-03-29 18:45:16 [auto1.de] INFO: Scrape type for CE21106: 2
2026-03-29 18:45:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3534d46-2d46-50dd-bb70-8f487d14215f with identifier: CE21106
2026-03-29 18:45:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3534d46-2d46-50dd-bb70-8f487d14215f with scrape type 2
2026-03-29 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3534d46-2d46-50dd-bb70-8f487d14215f with scrape type 2
2026-03-29 18:45:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3534d46-2d46-50dd-bb70-8f487d14215f, identifier: CE21106
2026-03-29 18:45:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2532fc7-7fd5-587b-9ddd-7a98a8e5a503 with identifier: TP97389
2026-03-29 18:45:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2532fc7-7fd5-587b-9ddd-7a98a8e5a503 with identifier: TP97389
2026-03-29 18:45:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2532fc7-7fd5-587b-9ddd-7a98a8e5a503 with identifier: TP97389 to the API
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:34:04Z',
'fuel_type': 'petrol',
'id': 'd2532fc7-7fd5-587b-9ddd-7a98a8e5a503',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP97389',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 88866,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-20',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Lounge BlueMotion Tech',
'transmission': 'manual',
'trim': 'Lounge BlueMotion Tech',
'year': 2015}
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP97389%27 HTTP/1.1" 200 None
2026-03-29 18:45:16 [auto1.de] INFO: Saving data for TP97389: {'auction_closing_time': 1774884844.0, 'created_time': 1774723166.517097, 'last_price_update_time': 1774809916.743649}
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP97389') HTTP/1.1" 204 0
2026-03-29 18:45:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3534d46-2d46-50dd-bb70-8f487d14215f with identifier: CE21106
2026-03-29 18:45:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3534d46-2d46-50dd-bb70-8f487d14215f with identifier: CE21106
2026-03-29 18:45:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3534d46-2d46-50dd-bb70-8f487d14215f with identifier: CE21106 to the API
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:10:29Z',
'fuel_type': 'diesel',
'id': 'e3534d46-2d46-50dd-bb70-8f487d14215f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE21106',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 170905,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-12',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 Blue-HDi Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2017}
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE21106%27 HTTP/1.1" 200 None
2026-03-29 18:45:17 [auto1.de] INFO: Saving data for CE21106: {'auction_closing_time': 1774883429.0, 'created_time': 1774723407.606451, 'last_price_update_time': 1774809917.05459}
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE21106') HTTP/1.1" 204 0
2026-03-29 18:45:17 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:17 [auto1.de] INFO: Found listing with ID: EC10607
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC10607%27 HTTP/1.1" 200 None
2026-03-29 18:45:17 [auto1.de] INFO: Scrape type for EC10607: 2
2026-03-29 18:45:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ef9c13f-7e8c-58eb-a2b0-748fc39963ac with identifier: EC10607
2026-03-29 18:45:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ef9c13f-7e8c-58eb-a2b0-748fc39963ac with scrape type 2
2026-03-29 18:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ef9c13f-7e8c-58eb-a2b0-748fc39963ac with scrape type 2
2026-03-29 18:45:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ef9c13f-7e8c-58eb-a2b0-748fc39963ac, identifier: EC10607
2026-03-29 18:45:17 [auto1.de] INFO: Found listing with ID: GY94515
2026-03-29 18:45:17 [auto1.de] INFO: Found listing with ID: LM12575
2026-03-29 18:45:17 [auto1.de] INFO: Found listing with ID: CV44457
2026-03-29 18:45:17 [auto1.de] INFO: Found listing with ID: BN42758
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN42758%27 HTTP/1.1" 200 None
2026-03-29 18:45:17 [auto1.de] INFO: Scrape type for BN42758: 2
2026-03-29 18:45:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baa4af07-90cc-55c5-bb21-0632b7863ac9 with identifier: BN42758
2026-03-29 18:45:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baa4af07-90cc-55c5-bb21-0632b7863ac9 with scrape type 2
2026-03-29 18:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item baa4af07-90cc-55c5-bb21-0632b7863ac9 with scrape type 2
2026-03-29 18:45:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: baa4af07-90cc-55c5-bb21-0632b7863ac9, identifier: BN42758
2026-03-29 18:45:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ef9c13f-7e8c-58eb-a2b0-748fc39963ac with identifier: EC10607
2026-03-29 18:45:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ef9c13f-7e8c-58eb-a2b0-748fc39963ac with identifier: EC10607
2026-03-29 18:45:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ef9c13f-7e8c-58eb-a2b0-748fc39963ac with identifier: EC10607 to the API
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 325,
'expiration_date': '2026-03-30T15:13:30Z',
'fuel_type': 'petrol',
'id': '3ef9c13f-7e8c-58eb-a2b0-748fc39963ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC10607',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 170917,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-06',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.8 V6 Turbo OPC 4x4',
'transmission': 'automatic',
'trim': 'OPC 4x4',
'year': 2015}
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC10607%27 HTTP/1.1" 200 None
2026-03-29 18:45:17 [auto1.de] INFO: Saving data for EC10607: {'auction_closing_time': 1774883610.0, 'created_time': 1774034210.665272, 'last_price_update_time': 1774809917.593396}
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC10607') HTTP/1.1" 204 0
2026-03-29 18:45:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: baa4af07-90cc-55c5-bb21-0632b7863ac9 with identifier: BN42758
2026-03-29 18:45:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: baa4af07-90cc-55c5-bb21-0632b7863ac9 with identifier: BN42758
2026-03-29 18:45:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: baa4af07-90cc-55c5-bb21-0632b7863ac9 with identifier: BN42758 to the API
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:53:10Z',
'fuel_type': 'petrol',
'id': 'baa4af07-90cc-55c5-bb21-0632b7863ac9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN42758',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 58840,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-11-25',
'seller_name': None,
'title': 'Opel Meriva 1.6 Enjoy',
'transmission': 'automatic',
'trim': 'Enjoy',
'year': 2003}
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN42758%27 HTTP/1.1" 200 None
2026-03-29 18:45:18 [auto1.de] INFO: Saving data for BN42758: {'auction_closing_time': 1774885990.0, 'created_time': 1774723210.517506, 'last_price_update_time': 1774809918.018623}
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN42758') HTTP/1.1" 204 0
2026-03-29 18:45:18 [auto1.de] INFO: Found listing with ID: GE75594
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE75594%27 HTTP/1.1" 200 None
2026-03-29 18:45:18 [auto1.de] INFO: Scrape type for GE75594: 2
2026-03-29 18:45:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 617edb04-356d-5359-8573-64b9d3cb0609 with identifier: GE75594
2026-03-29 18:45:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 617edb04-356d-5359-8573-64b9d3cb0609 with scrape type 2
2026-03-29 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 617edb04-356d-5359-8573-64b9d3cb0609 with scrape type 2
2026-03-29 18:45:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 617edb04-356d-5359-8573-64b9d3cb0609, identifier: GE75594
2026-03-29 18:45:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:18 [auto1.de] INFO: Found listing with ID: LE99206
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE99206%27 HTTP/1.1" 200 None
2026-03-29 18:45:18 [auto1.de] INFO: Scrape type for LE99206: 2
2026-03-29 18:45:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 408557db-da41-508d-823b-fb759e5f5138 with identifier: LE99206
2026-03-29 18:45:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 408557db-da41-508d-823b-fb759e5f5138 with scrape type 2
2026-03-29 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 408557db-da41-508d-823b-fb759e5f5138 with scrape type 2
2026-03-29 18:45:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 408557db-da41-508d-823b-fb759e5f5138, identifier: LE99206
2026-03-29 18:45:18 [auto1.de] INFO: Found listing with ID: ZH67756
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH67756%27 HTTP/1.1" 200 None
2026-03-29 18:45:18 [auto1.de] INFO: Scrape type for ZH67756: 2
2026-03-29 18:45:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54125cbd-1a1a-51e8-9047-2b9ff5abd685 with identifier: ZH67756
2026-03-29 18:45:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685 with scrape type 2
2026-03-29 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685 with scrape type 2
2026-03-29 18:45:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54125cbd-1a1a-51e8-9047-2b9ff5abd685, identifier: ZH67756
2026-03-29 18:45:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 617edb04-356d-5359-8573-64b9d3cb0609 with identifier: GE75594
2026-03-29 18:45:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 617edb04-356d-5359-8573-64b9d3cb0609 with identifier: GE75594
2026-03-29 18:45:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 617edb04-356d-5359-8573-64b9d3cb0609 with identifier: GE75594 to the API
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:10:28Z',
'fuel_type': 'diesel',
'id': '617edb04-356d-5359-8573-64b9d3cb0609',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE75594',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand C-Max',
'odometer': 139797,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-14',
'seller_name': None,
'title': 'Ford Grand C-Max 2.0 TDCi Business Edition',
'transmission': 'automatic',
'trim': 'Business Edition',
'year': 2016}
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE75594%27 HTTP/1.1" 200 None
2026-03-29 18:45:18 [auto1.de] INFO: Saving data for GE75594: {'auction_closing_time': 1774883428.0, 'created_time': 1774723239.788042, 'last_price_update_time': 1774809918.665798}
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE75594') HTTP/1.1" 204 0
2026-03-29 18:45:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 408557db-da41-508d-823b-fb759e5f5138 with identifier: LE99206
2026-03-29 18:45:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 408557db-da41-508d-823b-fb759e5f5138 with identifier: LE99206
2026-03-29 18:45:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 408557db-da41-508d-823b-fb759e5f5138 with identifier: LE99206 to the API
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:45:42Z',
'fuel_type': 'diesel',
'id': '408557db-da41-508d-823b-fb759e5f5138',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE99206',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 89145,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-19',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TDI R-Line 4Motion',
'transmission': 'automatic',
'trim': 'R-Line 4Motion',
'year': 2022}
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE99206%27 HTTP/1.1" 200 None
2026-03-29 18:45:18 [auto1.de] INFO: Saving data for LE99206: {'auction_closing_time': 1774885542.0, 'created_time': 1774723151.665547, 'last_price_update_time': 1774809918.967424}
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE99206') HTTP/1.1" 204 0
2026-03-29 18:45:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54125cbd-1a1a-51e8-9047-2b9ff5abd685 with identifier: ZH67756
2026-03-29 18:45:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54125cbd-1a1a-51e8-9047-2b9ff5abd685 with identifier: ZH67756
2026-03-29 18:45:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54125cbd-1a1a-51e8-9047-2b9ff5abd685 with identifier: ZH67756 to the API
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:15:55Z',
'fuel_type': 'diesel',
'id': '54125cbd-1a1a-51e8-9047-2b9ff5abd685',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH67756',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 230044,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-07',
'seller_name': None,
'title': 'Renault Captur 1.5 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2016}
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH67756%27 HTTP/1.1" 200 None
2026-03-29 18:45:19 [auto1.de] INFO: Saving data for ZH67756: {'auction_closing_time': 1774883755.0, 'created_time': 1774723258.479898, 'last_price_update_time': 1774809919.258683}
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH67756') HTTP/1.1" 204 0
2026-03-29 18:45:19 [auto1.de] INFO: Found listing with ID: BH61935
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH61935%27 HTTP/1.1" 200 None
2026-03-29 18:45:19 [auto1.de] INFO: Scrape type for BH61935: 2
2026-03-29 18:45:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4166df80-56af-5b93-9dbd-2fae34c82122 with identifier: BH61935
2026-03-29 18:45:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4166df80-56af-5b93-9dbd-2fae34c82122 with scrape type 2
2026-03-29 18:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4166df80-56af-5b93-9dbd-2fae34c82122 with scrape type 2
2026-03-29 18:45:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4166df80-56af-5b93-9dbd-2fae34c82122, identifier: BH61935
2026-03-29 18:45:19 [auto1.de] INFO: Found listing with ID: KJ49270
2026-03-29 18:45:19 [auto1.de] INFO: Found listing with ID: ZD15058
2026-03-29 18:45:19 [auto1.de] INFO: Found listing with ID: PH13735
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH13735%27 HTTP/1.1" 200 None
2026-03-29 18:45:19 [auto1.de] INFO: Scrape type for PH13735: 2
2026-03-29 18:45:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 428508bb-e434-5f60-8e59-c2789ab3a1ab with identifier: PH13735
2026-03-29 18:45:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 428508bb-e434-5f60-8e59-c2789ab3a1ab with scrape type 2
2026-03-29 18:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 428508bb-e434-5f60-8e59-c2789ab3a1ab with scrape type 2
2026-03-29 18:45:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 428508bb-e434-5f60-8e59-c2789ab3a1ab, identifier: PH13735
2026-03-29 18:45:19 [auto1.de] INFO: Found listing with ID: PN96283
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN96283%27 HTTP/1.1" 200 None
2026-03-29 18:45:19 [auto1.de] INFO: Scrape type for PN96283: 2
2026-03-29 18:45:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b with identifier: PN96283
2026-03-29 18:45:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b with scrape type 2
2026-03-29 18:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b with scrape type 2
2026-03-29 18:45:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b, identifier: PN96283
2026-03-29 18:45:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4166df80-56af-5b93-9dbd-2fae34c82122 with identifier: BH61935
2026-03-29 18:45:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4166df80-56af-5b93-9dbd-2fae34c82122 with identifier: BH61935
2026-03-29 18:45:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4166df80-56af-5b93-9dbd-2fae34c82122 with identifier: BH61935 to the API
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:24:52Z',
'fuel_type': 'diesel',
'id': '4166df80-56af-5b93-9dbd-2fae34c82122',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH61935',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 260085,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-11',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Champions Edition',
'transmission': 'manual',
'trim': 'Champions Edition',
'year': 2012}
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH61935%27 HTTP/1.1" 200 None
2026-03-29 18:45:19 [auto1.de] INFO: Saving data for BH61935: {'auction_closing_time': 1774884292.0, 'created_time': 1774723229.427217, 'last_price_update_time': 1774809919.877495}
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH61935') HTTP/1.1" 204 0
2026-03-29 18:45:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 428508bb-e434-5f60-8e59-c2789ab3a1ab with identifier: PH13735
2026-03-29 18:45:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 428508bb-e434-5f60-8e59-c2789ab3a1ab with identifier: PH13735
2026-03-29 18:45:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 428508bb-e434-5f60-8e59-c2789ab3a1ab with identifier: PH13735 to the API
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:34:29Z',
'fuel_type': 'diesel',
'id': '428508bb-e434-5f60-8e59-c2789ab3a1ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH13735',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 145505,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-16',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Highline',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2013}
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH13735%27 HTTP/1.1" 200 None
2026-03-29 18:45:20 [auto1.de] INFO: Saving data for PH13735: {'auction_closing_time': 1774884869.0, 'created_time': 1774349152.781916, 'last_price_update_time': 1774809920.174114}
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH13735') HTTP/1.1" 204 0
2026-03-29 18:45:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b with identifier: PN96283
2026-03-29 18:45:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b with identifier: PN96283
2026-03-29 18:45:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b with identifier: PN96283 to the API
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:37:42Z',
'fuel_type': 'hybrid',
'id': 'ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN96283',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 11575,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-08-29',
'seller_name': None,
'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium X',
'transmission': 'automatic',
'trim': 'Titanium X',
'year': 2024}
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN96283%27 HTTP/1.1" 200 None
2026-03-29 18:45:20 [auto1.de] INFO: Saving data for PN96283: {'auction_closing_time': 1774885062.0, 'created_time': 1774723405.329171, 'last_price_update_time': 1774809920.476577}
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN96283') HTTP/1.1" 204 0
2026-03-29 18:45:20 [auto1.de] INFO: Found listing with ID: TH50247
2026-03-29 18:45:20 [auto1.de] INFO: Found listing with ID: CV13370
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV13370%27 HTTP/1.1" 200 None
2026-03-29 18:45:20 [auto1.de] INFO: Scrape type for CV13370: 2
2026-03-29 18:45:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc with identifier: CV13370
2026-03-29 18:45:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc with scrape type 2
2026-03-29 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc with scrape type 2
2026-03-29 18:45:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc, identifier: CV13370
2026-03-29 18:45:20 [auto1.de] INFO: Found listing with ID: AZ23133
2026-03-29 18:45:20 [auto1.de] INFO: Found listing with ID: XV62286
2026-03-29 18:45:20 [auto1.de] INFO: Found listing with ID: ZS47010
2026-03-29 18:45:20 [auto1.de] INFO: Found listing with ID: KZ38664
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ38664%27 HTTP/1.1" 200 None
2026-03-29 18:45:20 [auto1.de] INFO: Scrape type for KZ38664: 2
2026-03-29 18:45:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72524a46-7194-594f-be70-a205886bb213 with identifier: KZ38664
2026-03-29 18:45:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72524a46-7194-594f-be70-a205886bb213 with scrape type 2
2026-03-29 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72524a46-7194-594f-be70-a205886bb213 with scrape type 2
2026-03-29 18:45:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72524a46-7194-594f-be70-a205886bb213, identifier: KZ38664
2026-03-29 18:45:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc with identifier: CV13370
2026-03-29 18:45:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc with identifier: CV13370
2026-03-29 18:45:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc with identifier: CV13370 to the API
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:27:09Z',
'fuel_type': 'petrol',
'id': '47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV13370',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 29992,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-24',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2017}
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV13370%27 HTTP/1.1" 200 None
2026-03-29 18:45:21 [auto1.de] INFO: Saving data for CV13370: {'auction_closing_time': 1774884429.0, 'created_time': 1773428131.817724, 'last_price_update_time': 1774809921.039411}
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV13370') HTTP/1.1" 204 0
2026-03-29 18:45:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72524a46-7194-594f-be70-a205886bb213 with identifier: KZ38664
2026-03-29 18:45:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72524a46-7194-594f-be70-a205886bb213 with identifier: KZ38664
2026-03-29 18:45:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72524a46-7194-594f-be70-a205886bb213 with identifier: KZ38664 to the API
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:54:49Z',
'fuel_type': 'petrol',
'id': '72524a46-7194-594f-be70-a205886bb213',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ38664',
'listing': 'auction',
'make': 'Volvo',
'model': 'C30',
'odometer': 284737,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-02-08',
'seller_name': None,
'title': 'Volvo C30 1.8 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2007}
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ38664%27 HTTP/1.1" 200 None
2026-03-29 18:45:21 [auto1.de] INFO: Saving data for KZ38664: {'auction_closing_time': 1774886089.0, 'created_time': 1774723228.879542, 'last_price_update_time': 1774809921.43436}
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ38664') HTTP/1.1" 204 0
2026-03-29 18:45:21 [auto1.de] INFO: Found listing with ID: GF54025
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54025%27 HTTP/1.1" 200 None
2026-03-29 18:45:21 [auto1.de] INFO: Scrape type for GF54025: 2
2026-03-29 18:45:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d03c9d5-a72a-5e8e-8899-de3555e642e7 with identifier: GF54025
2026-03-29 18:45:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d03c9d5-a72a-5e8e-8899-de3555e642e7 with scrape type 2
2026-03-29 18:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d03c9d5-a72a-5e8e-8899-de3555e642e7 with scrape type 2
2026-03-29 18:45:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d03c9d5-a72a-5e8e-8899-de3555e642e7, identifier: GF54025
2026-03-29 18:45:21 [auto1.de] INFO: Found listing with ID: MF03624
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF03624%27 HTTP/1.1" 200 None
2026-03-29 18:45:21 [auto1.de] INFO: Scrape type for MF03624: 2
2026-03-29 18:45:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44eb5f9d-6c08-5389-b999-e0ce7c6d64a0 with identifier: MF03624
2026-03-29 18:45:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44eb5f9d-6c08-5389-b999-e0ce7c6d64a0 with scrape type 2
2026-03-29 18:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44eb5f9d-6c08-5389-b999-e0ce7c6d64a0 with scrape type 2
2026-03-29 18:45:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44eb5f9d-6c08-5389-b999-e0ce7c6d64a0, identifier: MF03624
2026-03-29 18:45:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d03c9d5-a72a-5e8e-8899-de3555e642e7 with identifier: GF54025
2026-03-29 18:45:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d03c9d5-a72a-5e8e-8899-de3555e642e7 with identifier: GF54025
2026-03-29 18:45:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d03c9d5-a72a-5e8e-8899-de3555e642e7 with identifier: GF54025 to the API
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:05:02Z',
'fuel_type': 'petrol',
'id': '6d03c9d5-a72a-5e8e-8899-de3555e642e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF54025',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 181499,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-05-06',
'seller_name': None,
'title': 'Seat Leon 1.6 Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2007}
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54025%27 HTTP/1.1" 200 None
2026-03-29 18:45:21 [auto1.de] INFO: Saving data for GF54025: {'auction_closing_time': 1774883102.0, 'created_time': 1774723213.632803, 'last_price_update_time': 1774809921.946167}
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF54025') HTTP/1.1" 204 0
2026-03-29 18:45:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44eb5f9d-6c08-5389-b999-e0ce7c6d64a0 with identifier: MF03624
2026-03-29 18:45:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44eb5f9d-6c08-5389-b999-e0ce7c6d64a0 with identifier: MF03624
2026-03-29 18:45:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44eb5f9d-6c08-5389-b999-e0ce7c6d64a0 with identifier: MF03624 to the API
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:41:31Z',
'fuel_type': 'diesel',
'id': '44eb5f9d-6c08-5389-b999-e0ce7c6d64a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF03624',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Sprinter',
'odometer': 342098,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-16',
'seller_name': None,
'title': 'Mercedes-Benz Sprinter 316 CDI',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF03624%27 HTTP/1.1" 200 None
2026-03-29 18:45:22 [auto1.de] INFO: Saving data for MF03624: {'auction_closing_time': 1774885291.0, 'created_time': 1773467445.923024, 'last_price_update_time': 1774809922.259364}
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF03624') HTTP/1.1" 204 0
2026-03-29 18:45:22 [auto1.de] INFO: Found listing with ID: KK05104
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK05104%27 HTTP/1.1" 200 None
2026-03-29 18:45:22 [auto1.de] INFO: Scrape type for KK05104: 2
2026-03-29 18:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb66549c-160f-57cf-b1cd-ae1ce605bd0f with identifier: KK05104
2026-03-29 18:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb66549c-160f-57cf-b1cd-ae1ce605bd0f with scrape type 2
2026-03-29 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb66549c-160f-57cf-b1cd-ae1ce605bd0f with scrape type 2
2026-03-29 18:45:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb66549c-160f-57cf-b1cd-ae1ce605bd0f, identifier: KK05104
2026-03-29 18:45:22 [auto1.de] INFO: Found listing with ID: FX61417
2026-03-29 18:45:22 [auto1.de] INFO: Found listing with ID: EK32140
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK32140%27 HTTP/1.1" 200 None
2026-03-29 18:45:22 [auto1.de] INFO: Scrape type for EK32140: 2
2026-03-29 18:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a with identifier: EK32140
2026-03-29 18:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a with scrape type 2
2026-03-29 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a with scrape type 2
2026-03-29 18:45:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a, identifier: EK32140
2026-03-29 18:45:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb66549c-160f-57cf-b1cd-ae1ce605bd0f with identifier: KK05104
2026-03-29 18:45:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb66549c-160f-57cf-b1cd-ae1ce605bd0f with identifier: KK05104
2026-03-29 18:45:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb66549c-160f-57cf-b1cd-ae1ce605bd0f with identifier: KK05104 to the API
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:04:10Z',
'fuel_type': 'diesel',
'id': 'fb66549c-160f-57cf-b1cd-ae1ce605bd0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK05104',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 305601,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-04',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Elegance',
'transmission': 'manual',
'trim': 'T BlueEfficiency Elegance',
'year': 2014}
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK05104%27 HTTP/1.1" 200 None
2026-03-29 18:45:22 [auto1.de] INFO: Saving data for KK05104: {'auction_closing_time': 1774883050.0, 'created_time': 1774723387.982026, 'last_price_update_time': 1774809922.847147}
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK05104') HTTP/1.1" 204 0
2026-03-29 18:45:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a with identifier: EK32140
2026-03-29 18:45:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a with identifier: EK32140
2026-03-29 18:45:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a with identifier: EK32140 to the API
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:06:46Z',
'fuel_type': 'petrol',
'id': '5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK32140',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 164957,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-10',
'seller_name': None,
'title': 'Audi A3 Sportback 1.5 TSI ACT',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK32140%27 HTTP/1.1" 200 None
2026-03-29 18:45:23 [auto1.de] INFO: Saving data for EK32140: {'auction_closing_time': 1774883206.0, 'created_time': 1774723390.951827, 'last_price_update_time': 1774809923.185125}
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK32140') HTTP/1.1" 204 0
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: DT00553
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00553%27 HTTP/1.1" 200 None
2026-03-29 18:45:23 [auto1.de] INFO: Scrape type for DT00553: 2
2026-03-29 18:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae128549-0740-5806-8223-bae72e58b6c5 with identifier: DT00553
2026-03-29 18:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae128549-0740-5806-8223-bae72e58b6c5 with scrape type 2
2026-03-29 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae128549-0740-5806-8223-bae72e58b6c5 with scrape type 2
2026-03-29 18:45:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae128549-0740-5806-8223-bae72e58b6c5, identifier: DT00553
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: ZG89267
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: WW30345
2026-03-29 18:45:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae128549-0740-5806-8223-bae72e58b6c5 with identifier: DT00553
2026-03-29 18:45:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae128549-0740-5806-8223-bae72e58b6c5 with identifier: DT00553
2026-03-29 18:45:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae128549-0740-5806-8223-bae72e58b6c5 with identifier: DT00553 to the API
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:45Z',
'fuel_type': 'diesel',
'id': 'ae128549-0740-5806-8223-bae72e58b6c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT00553',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 201865,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-11',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2020}
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00553%27 HTTP/1.1" 200 None
2026-03-29 18:45:23 [auto1.de] INFO: Saving data for DT00553: {'auction_closing_time': 1774885605.0, 'created_time': 1774723211.273667, 'last_price_update_time': 1774809923.586931}
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT00553') HTTP/1.1" 204 0
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: LR61927
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: PR38296
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: MN30135
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: GM93554
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93554%27 HTTP/1.1" 200 None
2026-03-29 18:45:23 [auto1.de] INFO: Scrape type for GM93554: 2
2026-03-29 18:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb14d324-85de-5ec9-9d43-c364e28b79c6 with identifier: GM93554
2026-03-29 18:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb14d324-85de-5ec9-9d43-c364e28b79c6 with scrape type 2
2026-03-29 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb14d324-85de-5ec9-9d43-c364e28b79c6 with scrape type 2
2026-03-29 18:45:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb14d324-85de-5ec9-9d43-c364e28b79c6, identifier: GM93554
2026-03-29 18:45:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb14d324-85de-5ec9-9d43-c364e28b79c6 with identifier: GM93554
2026-03-29 18:45:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb14d324-85de-5ec9-9d43-c364e28b79c6 with identifier: GM93554
2026-03-29 18:45:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb14d324-85de-5ec9-9d43-c364e28b79c6 with identifier: GM93554 to the API
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:41:36Z',
'fuel_type': 'petrol',
'id': 'cb14d324-85de-5ec9-9d43-c364e28b79c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM93554',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 121207,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-03',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2017}
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93554%27 HTTP/1.1" 200 None
2026-03-29 18:45:24 [auto1.de] INFO: Saving data for GM93554: {'auction_closing_time': 1774885296.0, 'created_time': 1774723212.034537, 'last_price_update_time': 1774809924.005869}
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM93554') HTTP/1.1" 204 0
2026-03-29 18:45:24 [auto1.de] INFO: Found listing with ID: KC33777
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC33777%27 HTTP/1.1" 200 None
2026-03-29 18:45:24 [auto1.de] INFO: Scrape type for KC33777: 2
2026-03-29 18:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4058d925-3f8f-52fe-bbca-ff9100299fde with identifier: KC33777
2026-03-29 18:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4058d925-3f8f-52fe-bbca-ff9100299fde with scrape type 2
2026-03-29 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4058d925-3f8f-52fe-bbca-ff9100299fde with scrape type 2
2026-03-29 18:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4058d925-3f8f-52fe-bbca-ff9100299fde, identifier: KC33777
2026-03-29 18:45:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4058d925-3f8f-52fe-bbca-ff9100299fde with identifier: KC33777
2026-03-29 18:45:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4058d925-3f8f-52fe-bbca-ff9100299fde with identifier: KC33777
2026-03-29 18:45:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4058d925-3f8f-52fe-bbca-ff9100299fde with identifier: KC33777 to the API
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 195,
'expiration_date': '2026-03-30T15:12:19Z',
'fuel_type': 'diesel',
'id': '4058d925-3f8f-52fe-bbca-ff9100299fde',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC33777',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 107522,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-09',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2020}
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC33777%27 HTTP/1.1" 200 None
2026-03-29 18:45:24 [auto1.de] INFO: Saving data for KC33777: {'auction_closing_time': 1774883539.0, 'created_time': 1774723214.083164, 'last_price_update_time': 1774809924.501554}
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC33777') HTTP/1.1" 204 0
2026-03-29 18:45:24 [auto1.de] INFO: Found listing with ID: JD18961
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD18961%27 HTTP/1.1" 200 None
2026-03-29 18:45:24 [auto1.de] INFO: Scrape type for JD18961: 2
2026-03-29 18:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beda420c-e987-5fc4-a7ac-944edc08e34e with identifier: JD18961
2026-03-29 18:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beda420c-e987-5fc4-a7ac-944edc08e34e with scrape type 2
2026-03-29 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item beda420c-e987-5fc4-a7ac-944edc08e34e with scrape type 2
2026-03-29 18:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: beda420c-e987-5fc4-a7ac-944edc08e34e, identifier: JD18961
2026-03-29 18:45:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: beda420c-e987-5fc4-a7ac-944edc08e34e with identifier: JD18961
2026-03-29 18:45:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: beda420c-e987-5fc4-a7ac-944edc08e34e with identifier: JD18961
2026-03-29 18:45:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: beda420c-e987-5fc4-a7ac-944edc08e34e with identifier: JD18961 to the API
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:42:39Z',
'fuel_type': 'petrol',
'id': 'beda420c-e987-5fc4-a7ac-944edc08e34e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD18961',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 87976,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-10',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Night Edition AMG Line',
'transmission': 'automatic',
'trim': 'Night Edition AMG Line',
'year': 2017}
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD18961%27 HTTP/1.1" 200 None
2026-03-29 18:45:24 [auto1.de] INFO: Saving data for JD18961: {'auction_closing_time': 1774885359.0, 'created_time': 1774723228.220236, 'last_price_update_time': 1774809924.92522}
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD18961') HTTP/1.1" 204 0
2026-03-29 18:45:24 [auto1.de] INFO: Found listing with ID: EU91257
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU91257%27 HTTP/1.1" 200 None
2026-03-29 18:45:24 [auto1.de] INFO: Scrape type for EU91257: 2
2026-03-29 18:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84eebff7-5356-582c-a98d-defdbfe75918 with identifier: EU91257
2026-03-29 18:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84eebff7-5356-582c-a98d-defdbfe75918 with scrape type 2
2026-03-29 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84eebff7-5356-582c-a98d-defdbfe75918 with scrape type 2
2026-03-29 18:45:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84eebff7-5356-582c-a98d-defdbfe75918, identifier: EU91257
2026-03-29 18:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84eebff7-5356-582c-a98d-defdbfe75918 with identifier: EU91257
2026-03-29 18:45:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84eebff7-5356-582c-a98d-defdbfe75918 with identifier: EU91257
2026-03-29 18:45:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84eebff7-5356-582c-a98d-defdbfe75918 with identifier: EU91257 to the API
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:49:52Z',
'fuel_type': 'diesel',
'id': '84eebff7-5356-582c-a98d-defdbfe75918',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU91257',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 260092,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-17',
'seller_name': None,
'title': 'Renault Trafic 2.0 dCi Generation Evado',
'transmission': 'manual',
'trim': 'Generation Evado',
'year': 2012}
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU91257%27 HTTP/1.1" 200 None
2026-03-29 18:45:25 [auto1.de] INFO: Saving data for EU91257: {'auction_closing_time': 1774885792.0, 'created_time': 1774723230.840428, 'last_price_update_time': 1774809925.337287}
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU91257') HTTP/1.1" 204 0
2026-03-29 18:45:25 [auto1.de] INFO: Found listing with ID: YV19830
2026-03-29 18:45:25 [auto1.de] INFO: Found listing with ID: TF95367
2026-03-29 18:45:25 [auto1.de] INFO: Found listing with ID: MJ24427
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ24427%27 HTTP/1.1" 200 None
2026-03-29 18:45:25 [auto1.de] INFO: Scrape type for MJ24427: 2
2026-03-29 18:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95a52ebb-76ba-5711-a917-7df9da57d602 with identifier: MJ24427
2026-03-29 18:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95a52ebb-76ba-5711-a917-7df9da57d602 with scrape type 2
2026-03-29 18:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95a52ebb-76ba-5711-a917-7df9da57d602 with scrape type 2
2026-03-29 18:45:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95a52ebb-76ba-5711-a917-7df9da57d602, identifier: MJ24427
2026-03-29 18:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95a52ebb-76ba-5711-a917-7df9da57d602 with identifier: MJ24427
2026-03-29 18:45:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95a52ebb-76ba-5711-a917-7df9da57d602 with identifier: MJ24427
2026-03-29 18:45:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95a52ebb-76ba-5711-a917-7df9da57d602 with identifier: MJ24427 to the API
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:19:29Z',
'fuel_type': 'diesel',
'id': '95a52ebb-76ba-5711-a917-7df9da57d602',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ24427',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 344007,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-10-13',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 CDI Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2004}
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ24427%27 HTTP/1.1" 200 None
2026-03-29 18:45:25 [auto1.de] INFO: Saving data for MJ24427: {'auction_closing_time': 1774883969.0, 'created_time': 1774723390.514443, 'last_price_update_time': 1774809925.775387}
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ24427') HTTP/1.1" 204 0
2026-03-29 18:45:25 [auto1.de] INFO: Found listing with ID: WE87104
2026-03-29 18:45:25 [auto1.de] INFO: Found listing with ID: TY73105
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY73105%27 HTTP/1.1" 200 None
2026-03-29 18:45:25 [auto1.de] INFO: Scrape type for TY73105: 2
2026-03-29 18:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e800b86e-86a9-52aa-9160-aac6078e6c6d with identifier: TY73105
2026-03-29 18:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e800b86e-86a9-52aa-9160-aac6078e6c6d with scrape type 2
2026-03-29 18:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e800b86e-86a9-52aa-9160-aac6078e6c6d with scrape type 2
2026-03-29 18:45:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e800b86e-86a9-52aa-9160-aac6078e6c6d, identifier: TY73105
2026-03-29 18:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e800b86e-86a9-52aa-9160-aac6078e6c6d with identifier: TY73105
2026-03-29 18:45:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e800b86e-86a9-52aa-9160-aac6078e6c6d with identifier: TY73105
2026-03-29 18:45:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e800b86e-86a9-52aa-9160-aac6078e6c6d with identifier: TY73105 to the API
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:43:15Z',
'fuel_type': 'diesel',
'id': 'e800b86e-86a9-52aa-9160-aac6078e6c6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY73105',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T4 Transporter',
'odometer': 162087,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-09-21',
'seller_name': None,
'title': 'Volkswagen T4 Transporter 2.4 SD Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 1999}
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY73105%27 HTTP/1.1" 200 None
2026-03-29 18:45:27 [auto1.de] INFO: Saving data for TY73105: {'auction_closing_time': 1774885395.0, 'created_time': 1774723224.721703, 'last_price_update_time': 1774809927.226986}
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY73105') HTTP/1.1" 204 0
2026-03-29 18:45:27 [auto1.de] INFO: Found listing with ID: ZC07667
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC07667%27 HTTP/1.1" 200 None
2026-03-29 18:45:27 [auto1.de] INFO: Scrape type for ZC07667: 2
2026-03-29 18:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b8fdb8f-c622-5102-b2a9-2d4e1967df50 with identifier: ZC07667
2026-03-29 18:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b8fdb8f-c622-5102-b2a9-2d4e1967df50 with scrape type 2
2026-03-29 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b8fdb8f-c622-5102-b2a9-2d4e1967df50 with scrape type 2
2026-03-29 18:45:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b8fdb8f-c622-5102-b2a9-2d4e1967df50, identifier: ZC07667
2026-03-29 18:45:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b8fdb8f-c622-5102-b2a9-2d4e1967df50 with identifier: ZC07667
2026-03-29 18:45:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b8fdb8f-c622-5102-b2a9-2d4e1967df50 with identifier: ZC07667
2026-03-29 18:45:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b8fdb8f-c622-5102-b2a9-2d4e1967df50 with identifier: ZC07667 to the API
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:38:12Z',
'fuel_type': 'diesel',
'id': '4b8fdb8f-c622-5102-b2a9-2d4e1967df50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC07667',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 142968,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-08',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2009}
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC07667%27 HTTP/1.1" 200 None
2026-03-29 18:45:27 [auto1.de] INFO: Saving data for ZC07667: {'auction_closing_time': 1774885092.0, 'created_time': 1774032632.249057, 'last_price_update_time': 1774809927.604091}
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC07667') HTTP/1.1" 204 0
2026-03-29 18:45:27 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:27 [auto1.de] INFO: Found listing with ID: RY65257
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY65257%27 HTTP/1.1" 200 None
2026-03-29 18:45:27 [auto1.de] INFO: Scrape type for RY65257: 2
2026-03-29 18:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b24c05-11e5-5389-929d-d36e6041ed73 with identifier: RY65257
2026-03-29 18:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b24c05-11e5-5389-929d-d36e6041ed73 with scrape type 2
2026-03-29 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10b24c05-11e5-5389-929d-d36e6041ed73 with scrape type 2
2026-03-29 18:45:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10b24c05-11e5-5389-929d-d36e6041ed73, identifier: RY65257
2026-03-29 18:45:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10b24c05-11e5-5389-929d-d36e6041ed73 with identifier: RY65257
2026-03-29 18:45:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10b24c05-11e5-5389-929d-d36e6041ed73 with identifier: RY65257
2026-03-29 18:45:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10b24c05-11e5-5389-929d-d36e6041ed73 with identifier: RY65257 to the API
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:30:34Z',
'fuel_type': 'diesel',
'id': '10b24c05-11e5-5389-929d-d36e6041ed73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY65257',
'listing': 'auction',
'make': 'Ford',
'model': 'Galaxy',
'odometer': 324722,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-10',
'seller_name': None,
'title': 'Ford Galaxy 2.2 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2009}
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY65257%27 HTTP/1.1" 200 None
2026-03-29 18:45:28 [auto1.de] INFO: Saving data for RY65257: {'auction_closing_time': 1774884634.0, 'created_time': 1774723394.948112, 'last_price_update_time': 1774809928.04258}
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY65257') HTTP/1.1" 204 0
2026-03-29 18:45:28 [auto1.de] INFO: Found listing with ID: SC39619
2026-03-29 18:45:28 [auto1.de] INFO: Found listing with ID: HP58071
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP58071%27 HTTP/1.1" 200 None
2026-03-29 18:45:28 [auto1.de] INFO: Scrape type for HP58071: 2
2026-03-29 18:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a1829cd-6828-5e48-bebc-97518a7631cc with identifier: HP58071
2026-03-29 18:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a1829cd-6828-5e48-bebc-97518a7631cc with scrape type 2
2026-03-29 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a1829cd-6828-5e48-bebc-97518a7631cc with scrape type 2
2026-03-29 18:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a1829cd-6828-5e48-bebc-97518a7631cc, identifier: HP58071
2026-03-29 18:45:28 [auto1.de] INFO: Found listing with ID: YC98449
2026-03-29 18:45:28 [auto1.de] INFO: Found listing with ID: AN00284
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN00284%27 HTTP/1.1" 200 None
2026-03-29 18:45:28 [auto1.de] INFO: Scrape type for AN00284: 2
2026-03-29 18:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1838e078-9202-574f-a0d2-2bccab21f7bb with identifier: AN00284
2026-03-29 18:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1838e078-9202-574f-a0d2-2bccab21f7bb with scrape type 2
2026-03-29 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1838e078-9202-574f-a0d2-2bccab21f7bb with scrape type 2
2026-03-29 18:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1838e078-9202-574f-a0d2-2bccab21f7bb, identifier: AN00284
2026-03-29 18:45:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a1829cd-6828-5e48-bebc-97518a7631cc with identifier: HP58071
2026-03-29 18:45:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a1829cd-6828-5e48-bebc-97518a7631cc with identifier: HP58071
2026-03-29 18:45:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a1829cd-6828-5e48-bebc-97518a7631cc with identifier: HP58071 to the API
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:15:28Z',
'fuel_type': 'diesel',
'id': '9a1829cd-6828-5e48-bebc-97518a7631cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP58071',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Amarok',
'odometer': 170824,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-07',
'seller_name': None,
'title': 'Volkswagen Amarok 2.0 TDI Highline DoubleCab 4Motion',
'transmission': 'manual',
'trim': 'Highline DoubleCab 4Motion',
'year': 2013}
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP58071%27 HTTP/1.1" 200 None
2026-03-29 18:45:28 [auto1.de] INFO: Saving data for HP58071: {'auction_closing_time': 1774883728.0, 'created_time': 1774723226.425563, 'last_price_update_time': 1774809928.548029}
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP58071') HTTP/1.1" 204 0
2026-03-29 18:45:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1838e078-9202-574f-a0d2-2bccab21f7bb with identifier: AN00284
2026-03-29 18:45:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1838e078-9202-574f-a0d2-2bccab21f7bb with identifier: AN00284
2026-03-29 18:45:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1838e078-9202-574f-a0d2-2bccab21f7bb with identifier: AN00284 to the API
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:14:06Z',
'fuel_type': 'petrol',
'id': '1838e078-9202-574f-a0d2-2bccab21f7bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN00284',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLK-Klasse',
'odometer': 104119,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-23',
'seller_name': None,
'title': 'Mercedes-Benz GLK-Klasse GLK 280 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2008}
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN00284%27 HTTP/1.1" 200 None
2026-03-29 18:45:28 [auto1.de] INFO: Saving data for AN00284: {'auction_closing_time': 1774883646.0, 'created_time': 1774723394.493522, 'last_price_update_time': 1774809928.930988}
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN00284') HTTP/1.1" 204 0
2026-03-29 18:45:28 [auto1.de] INFO: Found listing with ID: VW03364
2026-03-29 18:45:28 [auto1.de] INFO: Found listing with ID: DN85056
2026-03-29 18:45:28 [auto1.de] INFO: Found listing with ID: DZ90314
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ90314%27 HTTP/1.1" 200 None
2026-03-29 18:45:28 [auto1.de] INFO: Scrape type for DZ90314: 2
2026-03-29 18:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25f5bd6c-8df4-5028-9f3b-bcfeb241ee29 with identifier: DZ90314
2026-03-29 18:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25f5bd6c-8df4-5028-9f3b-bcfeb241ee29 with scrape type 2
2026-03-29 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25f5bd6c-8df4-5028-9f3b-bcfeb241ee29 with scrape type 2
2026-03-29 18:45:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25f5bd6c-8df4-5028-9f3b-bcfeb241ee29, identifier: DZ90314
2026-03-29 18:45:29 [auto1.de] INFO: Found listing with ID: PW75443
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW75443%27 HTTP/1.1" 200 None
2026-03-29 18:45:29 [auto1.de] INFO: Scrape type for PW75443: 2
2026-03-29 18:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21b1df75-26f8-5284-937f-83bd974e1912 with identifier: PW75443
2026-03-29 18:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21b1df75-26f8-5284-937f-83bd974e1912 with scrape type 2
2026-03-29 18:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21b1df75-26f8-5284-937f-83bd974e1912 with scrape type 2
2026-03-29 18:45:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21b1df75-26f8-5284-937f-83bd974e1912, identifier: PW75443
2026-03-29 18:45:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25f5bd6c-8df4-5028-9f3b-bcfeb241ee29 with identifier: DZ90314
2026-03-29 18:45:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25f5bd6c-8df4-5028-9f3b-bcfeb241ee29 with identifier: DZ90314
2026-03-29 18:45:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25f5bd6c-8df4-5028-9f3b-bcfeb241ee29 with identifier: DZ90314 to the API
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:21:19Z',
'fuel_type': 'diesel',
'id': '25f5bd6c-8df4-5028-9f3b-bcfeb241ee29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ90314',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Caravelle',
'odometer': 234234,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-13',
'seller_name': None,
'title': 'Volkswagen T5 Caravelle 2.0 TDI Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2012}
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ90314%27 HTTP/1.1" 200 None
2026-03-29 18:45:29 [auto1.de] INFO: Saving data for DZ90314: {'auction_closing_time': 1774884079.0, 'created_time': 1774349900.862335, 'last_price_update_time': 1774809929.500499}
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ90314') HTTP/1.1" 204 0
2026-03-29 18:45:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21b1df75-26f8-5284-937f-83bd974e1912 with identifier: PW75443
2026-03-29 18:45:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21b1df75-26f8-5284-937f-83bd974e1912 with identifier: PW75443
2026-03-29 18:45:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21b1df75-26f8-5284-937f-83bd974e1912 with identifier: PW75443 to the API
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:45:21Z',
'fuel_type': 'diesel',
'id': '21b1df75-26f8-5284-937f-83bd974e1912',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW75443',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 196150,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-11',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2016}
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW75443%27 HTTP/1.1" 200 None
2026-03-29 18:45:29 [auto1.de] INFO: Saving data for PW75443: {'auction_closing_time': 1774885521.0, 'created_time': 1773402087.640786, 'last_price_update_time': 1774809929.819561}
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW75443') HTTP/1.1" 204 0
2026-03-29 18:45:29 [auto1.de] INFO: Found listing with ID: KV10415
2026-03-29 18:45:29 [auto1.de] INFO: Found listing with ID: SF76682
2026-03-29 18:45:29 [auto1.de] INFO: Found listing with ID: CE35567
2026-03-29 18:45:29 [auto1.de] INFO: Found listing with ID: EC92138
2026-03-29 18:45:29 [auto1.de] INFO: Found listing with ID: RN02934
2026-03-29 18:45:29 [auto1.de] INFO: Found listing with ID: UY39264
2026-03-29 18:45:29 [auto1.de] INFO: Found listing with ID: ZD05213
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD05213%27 HTTP/1.1" 200 None
2026-03-29 18:45:29 [auto1.de] INFO: Scrape type for ZD05213: 2
2026-03-29 18:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76f53c22-b752-544e-bb7f-49841a69b62b with identifier: ZD05213
2026-03-29 18:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f53c22-b752-544e-bb7f-49841a69b62b with scrape type 2
2026-03-29 18:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76f53c22-b752-544e-bb7f-49841a69b62b with scrape type 2
2026-03-29 18:45:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76f53c22-b752-544e-bb7f-49841a69b62b, identifier: ZD05213
2026-03-29 18:45:29 [auto1.de] INFO: Found listing with ID: XZ09557
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ09557%27 HTTP/1.1" 200 None
2026-03-29 18:45:29 [auto1.de] INFO: Scrape type for XZ09557: 2
2026-03-29 18:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39fec39b-f5fd-5bb8-95ea-0689841fdca4 with identifier: XZ09557
2026-03-29 18:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4 with scrape type 2
2026-03-29 18:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4 with scrape type 2
2026-03-29 18:45:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39fec39b-f5fd-5bb8-95ea-0689841fdca4, identifier: XZ09557
2026-03-29 18:45:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76f53c22-b752-544e-bb7f-49841a69b62b with identifier: ZD05213
2026-03-29 18:45:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76f53c22-b752-544e-bb7f-49841a69b62b with identifier: ZD05213
2026-03-29 18:45:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76f53c22-b752-544e-bb7f-49841a69b62b with identifier: ZD05213 to the API
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:32:54Z',
'fuel_type': 'diesel',
'id': '76f53c22-b752-544e-bb7f-49841a69b62b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD05213',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 174351,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-08-31',
'seller_name': None,
'title': 'Volkswagen Golf V 1.9 TDI Goal',
'transmission': 'automatic',
'trim': 'Goal',
'year': 2006}
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD05213%27 HTTP/1.1" 200 None
2026-03-29 18:45:30 [auto1.de] INFO: Saving data for ZD05213: {'auction_closing_time': 1774884774.0, 'created_time': 1774723223.757099, 'last_price_update_time': 1774809930.344643}
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD05213') HTTP/1.1" 204 0
2026-03-29 18:45:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39fec39b-f5fd-5bb8-95ea-0689841fdca4 with identifier: XZ09557
2026-03-29 18:45:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39fec39b-f5fd-5bb8-95ea-0689841fdca4 with identifier: XZ09557
2026-03-29 18:45:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39fec39b-f5fd-5bb8-95ea-0689841fdca4 with identifier: XZ09557 to the API
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 468,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'petrol',
'id': '39fec39b-f5fd-5bb8-95ea-0689841fdca4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ09557',
'listing': 'auction',
'make': 'Jeep',
'model': 'Grand Cherokee',
'odometer': 129719,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-12',
'seller_name': None,
'title': 'Jeep Grand Cherokee 6.4 V8 HEMI SRT',
'transmission': 'automatic',
'trim': 'HEMI SRT',
'year': 2019}
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ09557%27 HTTP/1.1" 200 None
2026-03-29 18:45:31 [auto1.de] INFO: Saving data for XZ09557: {'auction_closing_time': 1774884600.0, 'created_time': 1774723235.045054, 'last_price_update_time': 1774809931.596406}
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ09557') HTTP/1.1" 204 0
2026-03-29 18:45:31 [auto1.de] INFO: Found listing with ID: VL59163
2026-03-29 18:45:31 [auto1.de] INFO: Found listing with ID: AH54106
2026-03-29 18:45:31 [auto1.de] INFO: Found listing with ID: WC53392
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC53392%27 HTTP/1.1" 200 None
2026-03-29 18:45:31 [auto1.de] INFO: Scrape type for WC53392: 2
2026-03-29 18:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8287f57a-5e30-55bc-95d2-243e8e47ba10 with identifier: WC53392
2026-03-29 18:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8287f57a-5e30-55bc-95d2-243e8e47ba10 with scrape type 2
2026-03-29 18:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8287f57a-5e30-55bc-95d2-243e8e47ba10 with scrape type 2
2026-03-29 18:45:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8287f57a-5e30-55bc-95d2-243e8e47ba10, identifier: WC53392
2026-03-29 18:45:31 [auto1.de] INFO: Found listing with ID: ZU51849
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU51849%27 HTTP/1.1" 200 None
2026-03-29 18:45:31 [auto1.de] INFO: Scrape type for ZU51849: 2
2026-03-29 18:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 700627a8-842e-5cdc-a12a-9c4516c95d74 with identifier: ZU51849
2026-03-29 18:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 700627a8-842e-5cdc-a12a-9c4516c95d74 with scrape type 2
2026-03-29 18:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 700627a8-842e-5cdc-a12a-9c4516c95d74 with scrape type 2
2026-03-29 18:45:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 700627a8-842e-5cdc-a12a-9c4516c95d74, identifier: ZU51849
2026-03-29 18:45:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8287f57a-5e30-55bc-95d2-243e8e47ba10 with identifier: WC53392
2026-03-29 18:45:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8287f57a-5e30-55bc-95d2-243e8e47ba10 with identifier: WC53392
2026-03-29 18:45:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8287f57a-5e30-55bc-95d2-243e8e47ba10 with identifier: WC53392 to the API
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:21:02Z',
'fuel_type': 'petrol',
'id': '8287f57a-5e30-55bc-95d2-243e8e47ba10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC53392',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 111754,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-26',
'seller_name': None,
'title': 'Skoda Octavia 1.6 Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2009}
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC53392%27 HTTP/1.1" 200 None
2026-03-29 18:45:32 [auto1.de] INFO: Saving data for WC53392: {'auction_closing_time': 1774884062.0, 'created_time': 1773467164.444175, 'last_price_update_time': 1774809932.112084}
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC53392') HTTP/1.1" 204 0
2026-03-29 18:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 700627a8-842e-5cdc-a12a-9c4516c95d74 with identifier: ZU51849
2026-03-29 18:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 700627a8-842e-5cdc-a12a-9c4516c95d74 with identifier: ZU51849
2026-03-29 18:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 700627a8-842e-5cdc-a12a-9c4516c95d74 with identifier: ZU51849 to the API
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:26:18Z',
'fuel_type': 'diesel',
'id': '700627a8-842e-5cdc-a12a-9c4516c95d74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU51849',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 136797,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-28',
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU51849%27 HTTP/1.1" 200 None
2026-03-29 18:45:32 [auto1.de] INFO: Saving data for ZU51849: {'auction_closing_time': 1774884378.0, 'created_time': 1773468759.148005, 'last_price_update_time': 1774809932.414718}
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU51849') HTTP/1.1" 204 0
2026-03-29 18:45:32 [auto1.de] INFO: Found listing with ID: KB62882
2026-03-29 18:45:32 [auto1.de] INFO: Found listing with ID: JZ33625
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ33625%27 HTTP/1.1" 200 None
2026-03-29 18:45:32 [auto1.de] INFO: Scrape type for JZ33625: 2
2026-03-29 18:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa27d5cc-600d-567d-b05c-e529cd2883e2 with identifier: JZ33625
2026-03-29 18:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa27d5cc-600d-567d-b05c-e529cd2883e2 with scrape type 2
2026-03-29 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa27d5cc-600d-567d-b05c-e529cd2883e2 with scrape type 2
2026-03-29 18:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa27d5cc-600d-567d-b05c-e529cd2883e2, identifier: JZ33625
2026-03-29 18:45:32 [auto1.de] INFO: Found listing with ID: KD69831
2026-03-29 18:45:32 [auto1.de] INFO: Found listing with ID: VS08295
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS08295%27 HTTP/1.1" 200 None
2026-03-29 18:45:32 [auto1.de] INFO: Scrape type for VS08295: 2
2026-03-29 18:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c2ce450-dfed-5463-a251-95873472a8f3 with identifier: VS08295
2026-03-29 18:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c2ce450-dfed-5463-a251-95873472a8f3 with scrape type 2
2026-03-29 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c2ce450-dfed-5463-a251-95873472a8f3 with scrape type 2
2026-03-29 18:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c2ce450-dfed-5463-a251-95873472a8f3, identifier: VS08295
2026-03-29 18:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa27d5cc-600d-567d-b05c-e529cd2883e2 with identifier: JZ33625
2026-03-29 18:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa27d5cc-600d-567d-b05c-e529cd2883e2 with identifier: JZ33625
2026-03-29 18:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa27d5cc-600d-567d-b05c-e529cd2883e2 with identifier: JZ33625 to the API
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 286,
'expiration_date': '2026-03-30T15:46:25Z',
'fuel_type': 'diesel',
'id': 'aa27d5cc-600d-567d-b05c-e529cd2883e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ33625',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 138669,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 d T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2019}
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ33625%27 HTTP/1.1" 200 None
2026-03-29 18:45:32 [auto1.de] INFO: Saving data for JZ33625: {'auction_closing_time': 1774885585.0, 'created_time': 1773467098.109532, 'last_price_update_time': 1774809932.943594}
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ33625') HTTP/1.1" 204 0
2026-03-29 18:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c2ce450-dfed-5463-a251-95873472a8f3 with identifier: VS08295
2026-03-29 18:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c2ce450-dfed-5463-a251-95873472a8f3 with identifier: VS08295
2026-03-29 18:45:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c2ce450-dfed-5463-a251-95873472a8f3 with identifier: VS08295 to the API
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:13:39Z',
'fuel_type': 'petrol',
'id': '1c2ce450-dfed-5463-a251-95873472a8f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS08295',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 186486,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-07-04',
'seller_name': None,
'title': 'BMW 5er 523i',
'transmission': 'automatic',
'trim': '',
'year': 2000}
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS08295%27 HTTP/1.1" 200 None
2026-03-29 18:45:33 [auto1.de] INFO: Saving data for VS08295: {'auction_closing_time': 1774883619.0, 'created_time': 1774723225.638912, 'last_price_update_time': 1774809933.224023}
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS08295') HTTP/1.1" 204 0
2026-03-29 18:45:33 [auto1.de] INFO: Found listing with ID: SS01468
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS01468%27 HTTP/1.1" 200 None
2026-03-29 18:45:33 [auto1.de] INFO: Scrape type for SS01468: 2
2026-03-29 18:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a74e390b-610e-54b1-b986-abaacfc03fee with identifier: SS01468
2026-03-29 18:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a74e390b-610e-54b1-b986-abaacfc03fee with scrape type 2
2026-03-29 18:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a74e390b-610e-54b1-b986-abaacfc03fee with scrape type 2
2026-03-29 18:45:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a74e390b-610e-54b1-b986-abaacfc03fee, identifier: SS01468
2026-03-29 18:45:33 [auto1.de] INFO: Found listing with ID: DZ10370
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ10370%27 HTTP/1.1" 200 None
2026-03-29 18:45:33 [auto1.de] INFO: Scrape type for DZ10370: 2
2026-03-29 18:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37e7a81e-885a-58ca-b008-40a84d9e4b32 with identifier: DZ10370
2026-03-29 18:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37e7a81e-885a-58ca-b008-40a84d9e4b32 with scrape type 2
2026-03-29 18:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37e7a81e-885a-58ca-b008-40a84d9e4b32 with scrape type 2
2026-03-29 18:45:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37e7a81e-885a-58ca-b008-40a84d9e4b32, identifier: DZ10370
2026-03-29 18:45:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a74e390b-610e-54b1-b986-abaacfc03fee with identifier: SS01468
2026-03-29 18:45:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a74e390b-610e-54b1-b986-abaacfc03fee with identifier: SS01468
2026-03-29 18:45:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a74e390b-610e-54b1-b986-abaacfc03fee with identifier: SS01468 to the API
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:41:10Z',
'fuel_type': 'diesel',
'id': 'a74e390b-610e-54b1-b986-abaacfc03fee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS01468',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 189092,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-11',
'seller_name': None,
'title': 'Audi A4 3.0 V6 TDI quattro Ambiente',
'transmission': 'manual',
'trim': 'quattro Ambiente',
'year': 2012}
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS01468%27 HTTP/1.1" 200 None
2026-03-29 18:45:33 [auto1.de] INFO: Saving data for SS01468: {'auction_closing_time': 1774885270.0, 'created_time': 1774723385.701221, 'last_price_update_time': 1774809933.735627}
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS01468') HTTP/1.1" 204 0
2026-03-29 18:45:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37e7a81e-885a-58ca-b008-40a84d9e4b32 with identifier: DZ10370
2026-03-29 18:45:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37e7a81e-885a-58ca-b008-40a84d9e4b32 with identifier: DZ10370
2026-03-29 18:45:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37e7a81e-885a-58ca-b008-40a84d9e4b32 with identifier: DZ10370 to the API
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:22:37Z',
'fuel_type': 'petrol',
'id': '37e7a81e-885a-58ca-b008-40a84d9e4b32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ10370',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 47974,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-25',
'seller_name': None,
'title': 'Opel Corsa 1.4 Satellite',
'transmission': 'manual',
'trim': 'Satellite',
'year': 2012}
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ10370%27 HTTP/1.1" 200 None
2026-03-29 18:45:34 [auto1.de] INFO: Saving data for DZ10370: {'auction_closing_time': 1774884157.0, 'created_time': 1774723401.379199, 'last_price_update_time': 1774809934.064786}
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ10370') HTTP/1.1" 204 0
2026-03-29 18:45:34 [auto1.de] INFO: Found listing with ID: RX82336
2026-03-29 18:45:34 [auto1.de] INFO: Found listing with ID: VU61436
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU61436%27 HTTP/1.1" 200 None
2026-03-29 18:45:34 [auto1.de] INFO: Scrape type for VU61436: 2
2026-03-29 18:45:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aaa3b50-c399-50fd-996b-9ced9fba5ed1 with identifier: VU61436
2026-03-29 18:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aaa3b50-c399-50fd-996b-9ced9fba5ed1 with scrape type 2
2026-03-29 18:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aaa3b50-c399-50fd-996b-9ced9fba5ed1 with scrape type 2
2026-03-29 18:45:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9aaa3b50-c399-50fd-996b-9ced9fba5ed1, identifier: VU61436
2026-03-29 18:45:34 [auto1.de] INFO: Found listing with ID: YE71263
2026-03-29 18:45:34 [auto1.de] INFO: Found listing with ID: PW03502
2026-03-29 18:45:34 [auto1.de] INFO: Found listing with ID: LH85097
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH85097%27 HTTP/1.1" 200 None
2026-03-29 18:45:34 [auto1.de] INFO: Scrape type for LH85097: 2
2026-03-29 18:45:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d24f0af8-a244-5ea5-b6ac-830616b12c25 with identifier: LH85097
2026-03-29 18:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d24f0af8-a244-5ea5-b6ac-830616b12c25 with scrape type 2
2026-03-29 18:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d24f0af8-a244-5ea5-b6ac-830616b12c25 with scrape type 2
2026-03-29 18:45:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d24f0af8-a244-5ea5-b6ac-830616b12c25, identifier: LH85097
2026-03-29 18:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9aaa3b50-c399-50fd-996b-9ced9fba5ed1 with identifier: VU61436
2026-03-29 18:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9aaa3b50-c399-50fd-996b-9ced9fba5ed1 with identifier: VU61436
2026-03-29 18:45:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9aaa3b50-c399-50fd-996b-9ced9fba5ed1 with identifier: VU61436 to the API
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:46:26Z',
'fuel_type': 'petrol',
'id': '9aaa3b50-c399-50fd-996b-9ced9fba5ed1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU61436',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 80573,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-19',
'seller_name': None,
'title': 'BMW 3er 316i',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU61436%27 HTTP/1.1" 200 None
2026-03-29 18:45:34 [auto1.de] INFO: Saving data for VU61436: {'auction_closing_time': 1774885586.0, 'created_time': 1774723236.12446, 'last_price_update_time': 1774809934.616462}
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU61436') HTTP/1.1" 204 0
2026-03-29 18:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d24f0af8-a244-5ea5-b6ac-830616b12c25 with identifier: LH85097
2026-03-29 18:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d24f0af8-a244-5ea5-b6ac-830616b12c25 with identifier: LH85097
2026-03-29 18:45:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d24f0af8-a244-5ea5-b6ac-830616b12c25 with identifier: LH85097 to the API
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:06:30Z',
'fuel_type': 'petrol',
'id': 'd24f0af8-a244-5ea5-b6ac-830616b12c25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH85097',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 82698,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-19',
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH85097%27 HTTP/1.1" 200 None
2026-03-29 18:45:35 [auto1.de] INFO: Saving data for LH85097: {'auction_closing_time': 1774883190.0, 'created_time': 1774723400.461867, 'last_price_update_time': 1774809935.018857}
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH85097') HTTP/1.1" 204 0
2026-03-29 18:45:35 [auto1.de] INFO: Found listing with ID: KE07703
2026-03-29 18:45:35 [auto1.de] INFO: Found listing with ID: EW87662
2026-03-29 18:45:35 [auto1.de] INFO: Found listing with ID: YD79813
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD79813%27 HTTP/1.1" 200 None
2026-03-29 18:45:35 [auto1.de] INFO: Scrape type for YD79813: 2
2026-03-29 18:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2a508ed-99bf-546f-94d2-377440141fdc with identifier: YD79813
2026-03-29 18:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2a508ed-99bf-546f-94d2-377440141fdc with scrape type 2
2026-03-29 18:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2a508ed-99bf-546f-94d2-377440141fdc with scrape type 2
2026-03-29 18:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2a508ed-99bf-546f-94d2-377440141fdc, identifier: YD79813
2026-03-29 18:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:35 [auto1.de] INFO: Found listing with ID: TZ90544
2026-03-29 18:45:35 [auto1.de] INFO: Found listing with ID: ZM06899
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM06899%27 HTTP/1.1" 200 None
2026-03-29 18:45:35 [auto1.de] INFO: Scrape type for ZM06899: 2
2026-03-29 18:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b423cfae-7005-5f07-b731-6e9c53046033 with identifier: ZM06899
2026-03-29 18:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b423cfae-7005-5f07-b731-6e9c53046033 with scrape type 2
2026-03-29 18:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b423cfae-7005-5f07-b731-6e9c53046033 with scrape type 2
2026-03-29 18:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b423cfae-7005-5f07-b731-6e9c53046033, identifier: ZM06899
2026-03-29 18:45:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2a508ed-99bf-546f-94d2-377440141fdc with identifier: YD79813
2026-03-29 18:45:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2a508ed-99bf-546f-94d2-377440141fdc with identifier: YD79813
2026-03-29 18:45:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2a508ed-99bf-546f-94d2-377440141fdc with identifier: YD79813 to the API
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:39:56Z',
'fuel_type': 'diesel',
'id': 'a2a508ed-99bf-546f-94d2-377440141fdc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD79813',
'listing': 'auction',
'make': 'Fiat',
'model': 'Talento',
'odometer': 134866,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-05',
'seller_name': None,
'title': 'Fiat Talento 1.6 TwinTurbo Diesel Ecojet L2H1 1,2t SX',
'transmission': 'manual',
'trim': 'L2H1 1,2t SX',
'year': 2019}
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD79813%27 HTTP/1.1" 200 None
2026-03-29 18:45:35 [auto1.de] INFO: Saving data for YD79813: {'auction_closing_time': 1774885196.0, 'created_time': 1774723253.027544, 'last_price_update_time': 1774809935.522243}
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD79813') HTTP/1.1" 204 0
2026-03-29 18:45:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b423cfae-7005-5f07-b731-6e9c53046033 with identifier: ZM06899
2026-03-29 18:45:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b423cfae-7005-5f07-b731-6e9c53046033 with identifier: ZM06899
2026-03-29 18:45:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b423cfae-7005-5f07-b731-6e9c53046033 with identifier: ZM06899 to the API
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 411,
'expiration_date': '2026-03-30T15:00:07Z',
'fuel_type': 'petrol',
'id': 'b423cfae-7005-5f07-b731-6e9c53046033',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM06899',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 56824,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-20',
'seller_name': None,
'title': 'BMW 2er M2 Competition',
'transmission': 'automatic',
'trim': 'Competition',
'year': 2019}
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM06899%27 HTTP/1.1" 200 None
2026-03-29 18:45:35 [auto1.de] INFO: Saving data for ZM06899: {'auction_closing_time': 1774882807.0, 'created_time': 1774723404.473181, 'last_price_update_time': 1774809935.79225}
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM06899') HTTP/1.1" 204 0
2026-03-29 18:45:35 [auto1.de] INFO: Found listing with ID: WS06165
2026-03-29 18:45:35 [auto1.de] INFO: Found listing with ID: XE70546
2026-03-29 18:45:35 [auto1.de] INFO: Found listing with ID: JR23306
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR23306%27 HTTP/1.1" 200 None
2026-03-29 18:45:35 [auto1.de] INFO: Scrape type for JR23306: 2
2026-03-29 18:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f166f91-aded-5f14-95b0-f1568ac05574 with identifier: JR23306
2026-03-29 18:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f166f91-aded-5f14-95b0-f1568ac05574 with scrape type 2
2026-03-29 18:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f166f91-aded-5f14-95b0-f1568ac05574 with scrape type 2
2026-03-29 18:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f166f91-aded-5f14-95b0-f1568ac05574, identifier: JR23306
2026-03-29 18:45:35 [auto1.de] INFO: Found listing with ID: MW28967
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW28967%27 HTTP/1.1" 200 None
2026-03-29 18:45:35 [auto1.de] INFO: Scrape type for MW28967: 2
2026-03-29 18:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2b8b493-d5d3-526c-9c44-5b4e339bd048 with identifier: MW28967
2026-03-29 18:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2b8b493-d5d3-526c-9c44-5b4e339bd048 with scrape type 2
2026-03-29 18:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2b8b493-d5d3-526c-9c44-5b4e339bd048 with scrape type 2
2026-03-29 18:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2b8b493-d5d3-526c-9c44-5b4e339bd048, identifier: MW28967
2026-03-29 18:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f166f91-aded-5f14-95b0-f1568ac05574 with identifier: JR23306
2026-03-29 18:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f166f91-aded-5f14-95b0-f1568ac05574 with identifier: JR23306
2026-03-29 18:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f166f91-aded-5f14-95b0-f1568ac05574 with identifier: JR23306 to the API
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:56:34Z',
'fuel_type': 'petrol',
'id': '1f166f91-aded-5f14-95b0-f1568ac05574',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR23306',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 315776,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-10-31',
'seller_name': None,
'title': 'Volkswagen Passat 1.8 Turbo Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 1998}
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR23306%27 HTTP/1.1" 200 None
2026-03-29 18:45:36 [auto1.de] INFO: Saving data for JR23306: {'auction_closing_time': 1774886194.0, 'created_time': 1774723223.053502, 'last_price_update_time': 1774809936.293968}
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR23306') HTTP/1.1" 204 0
2026-03-29 18:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2b8b493-d5d3-526c-9c44-5b4e339bd048 with identifier: MW28967
2026-03-29 18:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2b8b493-d5d3-526c-9c44-5b4e339bd048 with identifier: MW28967
2026-03-29 18:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2b8b493-d5d3-526c-9c44-5b4e339bd048 with identifier: MW28967 to the API
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:34:16Z',
'fuel_type': 'electro',
'id': 'b2b8b493-d5d3-526c-9c44-5b4e339bd048',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW28967',
'listing': 'auction',
'make': 'Cupra',
'model': 'Born',
'odometer': 49377,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-30',
'seller_name': None,
'title': 'Cupra Born electric drive 150 kW',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW28967%27 HTTP/1.1" 200 None
2026-03-29 18:45:36 [auto1.de] INFO: Saving data for MW28967: {'auction_closing_time': 1774884856.0, 'created_time': 1774723407.132639, 'last_price_update_time': 1774809936.591639}
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW28967') HTTP/1.1" 204 0
2026-03-29 18:45:36 [auto1.de] INFO: Found listing with ID: FK29510
2026-03-29 18:45:36 [auto1.de] INFO: Found listing with ID: YN71631
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN71631%27 HTTP/1.1" 200 None
2026-03-29 18:45:36 [auto1.de] INFO: Scrape type for YN71631: 2
2026-03-29 18:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7128c69-799b-556a-b055-9e35aac7279e with identifier: YN71631
2026-03-29 18:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7128c69-799b-556a-b055-9e35aac7279e with scrape type 2
2026-03-29 18:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7128c69-799b-556a-b055-9e35aac7279e with scrape type 2
2026-03-29 18:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7128c69-799b-556a-b055-9e35aac7279e, identifier: YN71631
2026-03-29 18:45:36 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:36 [auto1.de] INFO: Found listing with ID: ZB32219
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB32219%27 HTTP/1.1" 200 None
2026-03-29 18:45:36 [auto1.de] INFO: Scrape type for ZB32219: 2
2026-03-29 18:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b with identifier: ZB32219
2026-03-29 18:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b with scrape type 2
2026-03-29 18:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b with scrape type 2
2026-03-29 18:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b, identifier: ZB32219
2026-03-29 18:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7128c69-799b-556a-b055-9e35aac7279e with identifier: YN71631
2026-03-29 18:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7128c69-799b-556a-b055-9e35aac7279e with identifier: YN71631
2026-03-29 18:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7128c69-799b-556a-b055-9e35aac7279e with identifier: YN71631 to the API
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:32:40Z',
'fuel_type': 'diesel',
'id': 'f7128c69-799b-556a-b055-9e35aac7279e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN71631',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 163192,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-08',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2014}
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN71631%27 HTTP/1.1" 200 None
2026-03-29 18:45:37 [auto1.de] INFO: Saving data for YN71631: {'auction_closing_time': 1774884760.0, 'created_time': 1774349947.094648, 'last_price_update_time': 1774809937.119875}
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN71631') HTTP/1.1" 204 0
2026-03-29 18:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b with identifier: ZB32219
2026-03-29 18:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b with identifier: ZB32219
2026-03-29 18:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b with identifier: ZB32219 to the API
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:44:51Z',
'fuel_type': 'petrol',
'id': '0c7bf403-3dad-56ce-9a2f-a08a5e4a308b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB32219',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 71966,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-17',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2016}
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB32219%27 HTTP/1.1" 200 None
2026-03-29 18:45:37 [auto1.de] INFO: Saving data for ZB32219: {'auction_closing_time': 1774885491.0, 'created_time': 1774723402.847193, 'last_price_update_time': 1774809937.496966}
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB32219') HTTP/1.1" 204 0
2026-03-29 18:45:37 [auto1.de] INFO: Found listing with ID: AP27322
2026-03-29 18:45:37 [auto1.de] INFO: Found listing with ID: NW52708
2026-03-29 18:45:37 [auto1.de] INFO: Found listing with ID: NH18171
2026-03-29 18:45:37 [auto1.de] INFO: Found listing with ID: EM86154
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM86154%27 HTTP/1.1" 200 None
2026-03-29 18:45:37 [auto1.de] INFO: Scrape type for EM86154: 2
2026-03-29 18:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62c22d0e-d358-5971-b733-d291ee7957e1 with identifier: EM86154
2026-03-29 18:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62c22d0e-d358-5971-b733-d291ee7957e1 with scrape type 2
2026-03-29 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62c22d0e-d358-5971-b733-d291ee7957e1 with scrape type 2
2026-03-29 18:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62c22d0e-d358-5971-b733-d291ee7957e1, identifier: EM86154
2026-03-29 18:45:37 [auto1.de] INFO: Found listing with ID: BM68891
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM68891%27 HTTP/1.1" 200 None
2026-03-29 18:45:37 [auto1.de] INFO: Scrape type for BM68891: 2
2026-03-29 18:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3c28e30-faf7-55b7-b813-db14b82311a8 with identifier: BM68891
2026-03-29 18:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3c28e30-faf7-55b7-b813-db14b82311a8 with scrape type 2
2026-03-29 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3c28e30-faf7-55b7-b813-db14b82311a8 with scrape type 2
2026-03-29 18:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3c28e30-faf7-55b7-b813-db14b82311a8, identifier: BM68891
2026-03-29 18:45:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:37 [auto1.de] INFO: Found listing with ID: HL71303
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71303%27 HTTP/1.1" 200 None
2026-03-29 18:45:37 [auto1.de] INFO: Scrape type for HL71303: 2
2026-03-29 18:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b80f9cdf-17ba-5b20-9dd5-834b1003a5ae with identifier: HL71303
2026-03-29 18:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b80f9cdf-17ba-5b20-9dd5-834b1003a5ae with scrape type 2
2026-03-29 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b80f9cdf-17ba-5b20-9dd5-834b1003a5ae with scrape type 2
2026-03-29 18:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b80f9cdf-17ba-5b20-9dd5-834b1003a5ae, identifier: HL71303
2026-03-29 18:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62c22d0e-d358-5971-b733-d291ee7957e1 with identifier: EM86154
2026-03-29 18:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62c22d0e-d358-5971-b733-d291ee7957e1 with identifier: EM86154
2026-03-29 18:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62c22d0e-d358-5971-b733-d291ee7957e1 with identifier: EM86154 to the API
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:56:37Z',
'fuel_type': 'diesel',
'id': '62c22d0e-d358-5971-b733-d291ee7957e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM86154',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 117028,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-09',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Style',
'transmission': 'manual',
'trim': 'BlueEfficiency Style',
'year': 2014}
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM86154%27 HTTP/1.1" 200 None
2026-03-29 18:45:38 [auto1.de] INFO: Saving data for EM86154: {'auction_closing_time': 1774886197.0, 'created_time': 1774118458.548449, 'last_price_update_time': 1774809938.124651}
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM86154') HTTP/1.1" 204 0
2026-03-29 18:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3c28e30-faf7-55b7-b813-db14b82311a8 with identifier: BM68891
2026-03-29 18:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3c28e30-faf7-55b7-b813-db14b82311a8 with identifier: BM68891
2026-03-29 18:45:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3c28e30-faf7-55b7-b813-db14b82311a8 with identifier: BM68891 to the API
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:19:49Z',
'fuel_type': 'petrol',
'id': 'a3c28e30-faf7-55b7-b813-db14b82311a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM68891',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 145637,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-18',
'seller_name': None,
'title': 'Mazda 3 2.0 Nakama',
'transmission': 'manual',
'trim': 'Nakama',
'year': 2016}
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM68891%27 HTTP/1.1" 200 None
2026-03-29 18:45:38 [auto1.de] INFO: Saving data for BM68891: {'auction_closing_time': 1774883989.0, 'created_time': 1774723246.093138, 'last_price_update_time': 1774809938.412189}
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM68891') HTTP/1.1" 204 0
2026-03-29 18:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b80f9cdf-17ba-5b20-9dd5-834b1003a5ae with identifier: HL71303
2026-03-29 18:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b80f9cdf-17ba-5b20-9dd5-834b1003a5ae with identifier: HL71303
2026-03-29 18:45:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b80f9cdf-17ba-5b20-9dd5-834b1003a5ae with identifier: HL71303 to the API
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:59:09Z',
'fuel_type': 'petrol',
'id': 'b80f9cdf-17ba-5b20-9dd5-834b1003a5ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL71303',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 82647,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-24',
'seller_name': None,
'title': 'BMW 3er 320i',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71303%27 HTTP/1.1" 200 None
2026-03-29 18:45:38 [auto1.de] INFO: Saving data for HL71303: {'auction_closing_time': 1774886349.0, 'created_time': 1774349889.843832, 'last_price_update_time': 1774809938.715872}
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL71303') HTTP/1.1" 204 0
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: JN22818
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: SK06184
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK06184%27 HTTP/1.1" 200 None
2026-03-29 18:45:38 [auto1.de] INFO: Scrape type for SK06184: 2
2026-03-29 18:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26a95270-4439-5e1d-be6a-dab6dee4ecd1 with identifier: SK06184
2026-03-29 18:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26a95270-4439-5e1d-be6a-dab6dee4ecd1 with scrape type 2
2026-03-29 18:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26a95270-4439-5e1d-be6a-dab6dee4ecd1 with scrape type 2
2026-03-29 18:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26a95270-4439-5e1d-be6a-dab6dee4ecd1, identifier: SK06184
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: AN35443
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN35443%27 HTTP/1.1" 200 None
2026-03-29 18:45:38 [auto1.de] INFO: Scrape type for AN35443: 2
2026-03-29 18:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1410e6a-f26f-5e32-8e29-680ee9ec5e7c with identifier: AN35443
2026-03-29 18:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1410e6a-f26f-5e32-8e29-680ee9ec5e7c with scrape type 2
2026-03-29 18:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1410e6a-f26f-5e32-8e29-680ee9ec5e7c with scrape type 2
2026-03-29 18:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1410e6a-f26f-5e32-8e29-680ee9ec5e7c, identifier: AN35443
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: BU00937
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: CB58662
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: WN13628
2026-03-29 18:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26a95270-4439-5e1d-be6a-dab6dee4ecd1 with identifier: SK06184
2026-03-29 18:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26a95270-4439-5e1d-be6a-dab6dee4ecd1 with identifier: SK06184
2026-03-29 18:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26a95270-4439-5e1d-be6a-dab6dee4ecd1 with identifier: SK06184 to the API
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:10:22Z',
'fuel_type': 'petrol',
'id': '26a95270-4439-5e1d-be6a-dab6dee4ecd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK06184',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 87906,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-13',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2011}
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK06184%27 HTTP/1.1" 200 None
2026-03-29 18:45:39 [auto1.de] INFO: Saving data for SK06184: {'auction_closing_time': 1774883422.0, 'created_time': 1774089213.168807, 'last_price_update_time': 1774809939.22247}
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK06184') HTTP/1.1" 204 0
2026-03-29 18:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1410e6a-f26f-5e32-8e29-680ee9ec5e7c with identifier: AN35443
2026-03-29 18:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1410e6a-f26f-5e32-8e29-680ee9ec5e7c with identifier: AN35443
2026-03-29 18:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1410e6a-f26f-5e32-8e29-680ee9ec5e7c with identifier: AN35443 to the API
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:29:20Z',
'fuel_type': 'petrol',
'id': 'c1410e6a-f26f-5e32-8e29-680ee9ec5e7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN35443',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 74784,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-14',
'seller_name': None,
'title': 'Hyundai ix35 2.0 GDI Trend 2WD',
'transmission': 'automatic',
'trim': 'Trend 2WD',
'year': 2014}
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN35443%27 HTTP/1.1" 200 None
2026-03-29 18:45:39 [auto1.de] INFO: Saving data for AN35443: {'auction_closing_time': 1774884560.0, 'created_time': 1773466610.282873, 'last_price_update_time': 1774809939.610589}
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN35443') HTTP/1.1" 204 0
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: SZ07968
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ07968%27 HTTP/1.1" 200 None
2026-03-29 18:45:39 [auto1.de] INFO: Scrape type for SZ07968: 2
2026-03-29 18:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71d3247a-6966-5772-a47d-7b7133156e5a with identifier: SZ07968
2026-03-29 18:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71d3247a-6966-5772-a47d-7b7133156e5a with scrape type 2
2026-03-29 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71d3247a-6966-5772-a47d-7b7133156e5a with scrape type 2
2026-03-29 18:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71d3247a-6966-5772-a47d-7b7133156e5a, identifier: SZ07968
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: XA64298
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: FU18032
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: RT07537
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: CP64572
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP64572%27 HTTP/1.1" 200 None
2026-03-29 18:45:39 [auto1.de] INFO: Scrape type for CP64572: 2
2026-03-29 18:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fca7d07-84c8-5dd8-841b-8453e71f0f00 with identifier: CP64572
2026-03-29 18:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fca7d07-84c8-5dd8-841b-8453e71f0f00 with scrape type 2
2026-03-29 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fca7d07-84c8-5dd8-841b-8453e71f0f00 with scrape type 2
2026-03-29 18:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fca7d07-84c8-5dd8-841b-8453e71f0f00, identifier: CP64572
2026-03-29 18:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71d3247a-6966-5772-a47d-7b7133156e5a with identifier: SZ07968
2026-03-29 18:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71d3247a-6966-5772-a47d-7b7133156e5a with identifier: SZ07968
2026-03-29 18:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71d3247a-6966-5772-a47d-7b7133156e5a with identifier: SZ07968 to the API
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:30:53Z',
'fuel_type': 'petrol',
'id': '71d3247a-6966-5772-a47d-7b7133156e5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ07968',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 63431,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-07',
'seller_name': None,
'title': 'Skoda Fabia 1.4 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2009}
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ07968%27 HTTP/1.1" 200 None
2026-03-29 18:45:40 [auto1.de] INFO: Saving data for SZ07968: {'auction_closing_time': 1774884653.0, 'created_time': 1774723238.571464, 'last_price_update_time': 1774809940.123014}
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ07968') HTTP/1.1" 204 0
2026-03-29 18:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fca7d07-84c8-5dd8-841b-8453e71f0f00 with identifier: CP64572
2026-03-29 18:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fca7d07-84c8-5dd8-841b-8453e71f0f00 with identifier: CP64572
2026-03-29 18:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fca7d07-84c8-5dd8-841b-8453e71f0f00 with identifier: CP64572 to the API
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:51:02Z',
'fuel_type': 'diesel',
'id': '9fca7d07-84c8-5dd8-841b-8453e71f0f00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP64572',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 146720,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-03',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2016}
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP64572%27 HTTP/1.1" 200 None
2026-03-29 18:45:40 [auto1.de] INFO: Saving data for CP64572: {'auction_closing_time': 1774885862.0, 'created_time': 1774034372.274482, 'last_price_update_time': 1774809940.412603}
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP64572') HTTP/1.1" 204 0
2026-03-29 18:45:40 [auto1.de] INFO: Found listing with ID: RT44513
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT44513%27 HTTP/1.1" 200 None
2026-03-29 18:45:40 [auto1.de] INFO: Scrape type for RT44513: 2
2026-03-29 18:45:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5012c90b-e10f-53cb-a3ff-213be3b99907 with identifier: RT44513
2026-03-29 18:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5012c90b-e10f-53cb-a3ff-213be3b99907 with scrape type 2
2026-03-29 18:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5012c90b-e10f-53cb-a3ff-213be3b99907 with scrape type 2
2026-03-29 18:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5012c90b-e10f-53cb-a3ff-213be3b99907, identifier: RT44513
2026-03-29 18:45:40 [auto1.de] INFO: Found listing with ID: CA31284
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA31284%27 HTTP/1.1" 200 None
2026-03-29 18:45:40 [auto1.de] INFO: Scrape type for CA31284: 2
2026-03-29 18:45:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7 with identifier: CA31284
2026-03-29 18:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7 with scrape type 2
2026-03-29 18:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7 with scrape type 2
2026-03-29 18:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7, identifier: CA31284
2026-03-29 18:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5012c90b-e10f-53cb-a3ff-213be3b99907 with identifier: RT44513
2026-03-29 18:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5012c90b-e10f-53cb-a3ff-213be3b99907 with identifier: RT44513
2026-03-29 18:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5012c90b-e10f-53cb-a3ff-213be3b99907 with identifier: RT44513 to the API
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:30:07Z',
'fuel_type': 'petrol',
'id': '5012c90b-e10f-53cb-a3ff-213be3b99907',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT44513',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 128753,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-13',
'seller_name': None,
'title': 'Volkswagen Polo 1.8 TSI GTI BlueMotion Tech',
'transmission': 'manual',
'trim': 'GTI BlueMotion Tech',
'year': 2016}
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT44513%27 HTTP/1.1" 200 None
2026-03-29 18:45:40 [auto1.de] INFO: Saving data for RT44513: {'auction_closing_time': 1774884607.0, 'created_time': 1774031920.098798, 'last_price_update_time': 1774809940.919445}
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT44513') HTTP/1.1" 204 0
2026-03-29 18:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7 with identifier: CA31284
2026-03-29 18:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7 with identifier: CA31284
2026-03-29 18:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7 with identifier: CA31284 to the API
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:57:41Z',
'fuel_type': 'diesel',
'id': '5b754b43-6b64-533a-aa24-6d7f6fcaf3d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA31284',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 130762,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-12',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Join',
'transmission': 'automatic',
'trim': 'Join',
'year': 2019}
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA31284%27 HTTP/1.1" 200 None
2026-03-29 18:45:41 [auto1.de] INFO: Saving data for CA31284: {'auction_closing_time': 1774886261.0, 'created_time': 1774723262.415994, 'last_price_update_time': 1774809941.25733}
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA31284') HTTP/1.1" 204 0
2026-03-29 18:45:41 [auto1.de] INFO: Found listing with ID: JB74543
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB74543%27 HTTP/1.1" 200 None
2026-03-29 18:45:41 [auto1.de] INFO: Scrape type for JB74543: 2
2026-03-29 18:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb4f4302-d420-5fbc-aa8a-2f4d0105d862 with identifier: JB74543
2026-03-29 18:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862 with scrape type 2
2026-03-29 18:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862 with scrape type 2
2026-03-29 18:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb4f4302-d420-5fbc-aa8a-2f4d0105d862, identifier: JB74543
2026-03-29 18:45:41 [auto1.de] INFO: Found listing with ID: JE64211
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE64211%27 HTTP/1.1" 200 None
2026-03-29 18:45:41 [auto1.de] INFO: Scrape type for JE64211: 2
2026-03-29 18:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1f60918-6a4c-5cf8-8279-b37853096524 with identifier: JE64211
2026-03-29 18:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1f60918-6a4c-5cf8-8279-b37853096524 with scrape type 2
2026-03-29 18:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1f60918-6a4c-5cf8-8279-b37853096524 with scrape type 2
2026-03-29 18:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1f60918-6a4c-5cf8-8279-b37853096524, identifier: JE64211
2026-03-29 18:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb4f4302-d420-5fbc-aa8a-2f4d0105d862 with identifier: JB74543
2026-03-29 18:45:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb4f4302-d420-5fbc-aa8a-2f4d0105d862 with identifier: JB74543
2026-03-29 18:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb4f4302-d420-5fbc-aa8a-2f4d0105d862 with identifier: JB74543 to the API
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:03:18Z',
'fuel_type': 'petrol',
'id': 'bb4f4302-d420-5fbc-aa8a-2f4d0105d862',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB74543',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 106429,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-04',
'seller_name': None,
'title': 'Mazda 3 2.0 Center-Line',
'transmission': 'manual',
'trim': 'Center-Line',
'year': 2015}
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB74543%27 HTTP/1.1" 200 None
2026-03-29 18:45:41 [auto1.de] INFO: Saving data for JB74543: {'auction_closing_time': 1774882998.0, 'created_time': 1774723257.74799, 'last_price_update_time': 1774809941.797424}
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB74543') HTTP/1.1" 204 0
2026-03-29 18:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1f60918-6a4c-5cf8-8279-b37853096524 with identifier: JE64211
2026-03-29 18:45:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1f60918-6a4c-5cf8-8279-b37853096524 with identifier: JE64211
2026-03-29 18:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1f60918-6a4c-5cf8-8279-b37853096524 with identifier: JE64211 to the API
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:53:17Z',
'fuel_type': 'diesel',
'id': 'd1f60918-6a4c-5cf8-8279-b37853096524',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE64211',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 256562,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-05',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'manual',
'trim': 'RS',
'year': 2015}
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE64211%27 HTTP/1.1" 200 None
2026-03-29 18:45:42 [auto1.de] INFO: Saving data for JE64211: {'auction_closing_time': 1774885997.0, 'created_time': 1773400637.376709, 'last_price_update_time': 1774809942.103418}
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE64211') HTTP/1.1" 204 0
2026-03-29 18:45:42 [auto1.de] INFO: Found listing with ID: HX73394
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX73394%27 HTTP/1.1" 200 None
2026-03-29 18:45:42 [auto1.de] INFO: Scrape type for HX73394: 2
2026-03-29 18:45:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42e4d640-e247-5413-87d3-1dd2d1038c7e with identifier: HX73394
2026-03-29 18:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42e4d640-e247-5413-87d3-1dd2d1038c7e with scrape type 2
2026-03-29 18:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42e4d640-e247-5413-87d3-1dd2d1038c7e with scrape type 2
2026-03-29 18:45:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42e4d640-e247-5413-87d3-1dd2d1038c7e, identifier: HX73394
2026-03-29 18:45:42 [auto1.de] INFO: Found listing with ID: FJ20192
2026-03-29 18:45:42 [auto1.de] INFO: Found listing with ID: ZV42561
2026-03-29 18:45:42 [auto1.de] INFO: Found listing with ID: YZ24956
2026-03-29 18:45:42 [auto1.de] INFO: Found listing with ID: RU51924
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51924%27 HTTP/1.1" 200 None
2026-03-29 18:45:42 [auto1.de] INFO: Scrape type for RU51924: 2
2026-03-29 18:45:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bddfc405-b46d-575c-8a36-feebeed8d7c0 with identifier: RU51924
2026-03-29 18:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bddfc405-b46d-575c-8a36-feebeed8d7c0 with scrape type 2
2026-03-29 18:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bddfc405-b46d-575c-8a36-feebeed8d7c0 with scrape type 2
2026-03-29 18:45:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bddfc405-b46d-575c-8a36-feebeed8d7c0, identifier: RU51924
2026-03-29 18:45:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42e4d640-e247-5413-87d3-1dd2d1038c7e with identifier: HX73394
2026-03-29 18:45:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42e4d640-e247-5413-87d3-1dd2d1038c7e with identifier: HX73394
2026-03-29 18:45:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42e4d640-e247-5413-87d3-1dd2d1038c7e with identifier: HX73394 to the API
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:14:31Z',
'fuel_type': 'petrol',
'id': '42e4d640-e247-5413-87d3-1dd2d1038c7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX73394',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 156764,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-18',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.4 TSI BlueMotion Tech',
'transmission': 'manual',
'trim': 'BlueMotion Tech',
'year': 2015}
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX73394%27 HTTP/1.1" 200 None
2026-03-29 18:45:42 [auto1.de] INFO: Saving data for HX73394: {'auction_closing_time': 1774883671.0, 'created_time': 1774723231.37604, 'last_price_update_time': 1774809942.661378}
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX73394') HTTP/1.1" 204 0
2026-03-29 18:45:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bddfc405-b46d-575c-8a36-feebeed8d7c0 with identifier: RU51924
2026-03-29 18:45:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bddfc405-b46d-575c-8a36-feebeed8d7c0 with identifier: RU51924
2026-03-29 18:45:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bddfc405-b46d-575c-8a36-feebeed8d7c0 with identifier: RU51924 to the API
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:03:49Z',
'fuel_type': 'hybrid',
'id': 'bddfc405-b46d-575c-8a36-feebeed8d7c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU51924',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 73632,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-19',
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI iV First Edition',
'transmission': 'automatic',
'trim': 'First Edition',
'year': 2020}
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51924%27 HTTP/1.1" 200 None
2026-03-29 18:45:43 [auto1.de] INFO: Saving data for RU51924: {'auction_closing_time': 1774883029.0, 'created_time': 1773427147.953351, 'last_price_update_time': 1774809943.05035}
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU51924') HTTP/1.1" 204 0
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: ES38254
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES38254%27 HTTP/1.1" 200 None
2026-03-29 18:45:43 [auto1.de] INFO: Scrape type for ES38254: 2
2026-03-29 18:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b170c2e8-9050-5572-aa7d-bc391fa23168 with identifier: ES38254
2026-03-29 18:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b170c2e8-9050-5572-aa7d-bc391fa23168 with scrape type 2
2026-03-29 18:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b170c2e8-9050-5572-aa7d-bc391fa23168 with scrape type 2
2026-03-29 18:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b170c2e8-9050-5572-aa7d-bc391fa23168, identifier: ES38254
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: UM98970
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM98970%27 HTTP/1.1" 200 None
2026-03-29 18:45:43 [auto1.de] INFO: Scrape type for UM98970: 2
2026-03-29 18:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ac80fd7-8b47-5edc-9d9e-e476ef270bd1 with identifier: UM98970
2026-03-29 18:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ac80fd7-8b47-5edc-9d9e-e476ef270bd1 with scrape type 2
2026-03-29 18:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ac80fd7-8b47-5edc-9d9e-e476ef270bd1 with scrape type 2
2026-03-29 18:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ac80fd7-8b47-5edc-9d9e-e476ef270bd1, identifier: UM98970
2026-03-29 18:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b170c2e8-9050-5572-aa7d-bc391fa23168 with identifier: ES38254
2026-03-29 18:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b170c2e8-9050-5572-aa7d-bc391fa23168 with identifier: ES38254
2026-03-29 18:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b170c2e8-9050-5572-aa7d-bc391fa23168 with identifier: ES38254 to the API
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:43:36Z',
'fuel_type': 'diesel',
'id': 'b170c2e8-9050-5572-aa7d-bc391fa23168',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES38254',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 281239,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-04',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi Vision 4WD',
'transmission': 'automatic',
'trim': 'Vision 4WD',
'year': 2011}
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES38254%27 HTTP/1.1" 200 None
2026-03-29 18:45:43 [auto1.de] INFO: Saving data for ES38254: {'auction_closing_time': 1774885416.0, 'created_time': 1773467782.385786, 'last_price_update_time': 1774809943.590753}
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES38254') HTTP/1.1" 204 0
2026-03-29 18:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ac80fd7-8b47-5edc-9d9e-e476ef270bd1 with identifier: UM98970
2026-03-29 18:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ac80fd7-8b47-5edc-9d9e-e476ef270bd1 with identifier: UM98970
2026-03-29 18:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ac80fd7-8b47-5edc-9d9e-e476ef270bd1 with identifier: UM98970 to the API
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:46:14Z',
'fuel_type': 'petrol',
'id': '5ac80fd7-8b47-5edc-9d9e-e476ef270bd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM98970',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 151495,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-03',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.0 TSI Join',
'transmission': 'manual',
'trim': 'Join',
'year': 2018}
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM98970%27 HTTP/1.1" 200 None
2026-03-29 18:45:43 [auto1.de] INFO: Saving data for UM98970: {'auction_closing_time': 1774885574.0, 'created_time': 1774723231.725388, 'last_price_update_time': 1774809943.892047}
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM98970') HTTP/1.1" 204 0
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: PU69799
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU69799%27 HTTP/1.1" 200 None
2026-03-29 18:45:43 [auto1.de] INFO: Scrape type for PU69799: 2
2026-03-29 18:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e080d537-bfc3-5ed6-897c-09a66c99f7ae with identifier: PU69799
2026-03-29 18:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e080d537-bfc3-5ed6-897c-09a66c99f7ae with scrape type 2
2026-03-29 18:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e080d537-bfc3-5ed6-897c-09a66c99f7ae with scrape type 2
2026-03-29 18:45:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e080d537-bfc3-5ed6-897c-09a66c99f7ae, identifier: PU69799
2026-03-29 18:45:44 [auto1.de] INFO: Found listing with ID: PP81333
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP81333%27 HTTP/1.1" 200 None
2026-03-29 18:45:44 [auto1.de] INFO: Scrape type for PP81333: 2
2026-03-29 18:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4118baf-ede4-5953-9306-346e6bc8ce17 with identifier: PP81333
2026-03-29 18:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4118baf-ede4-5953-9306-346e6bc8ce17 with scrape type 2
2026-03-29 18:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4118baf-ede4-5953-9306-346e6bc8ce17 with scrape type 2
2026-03-29 18:45:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4118baf-ede4-5953-9306-346e6bc8ce17, identifier: PP81333
2026-03-29 18:45:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e080d537-bfc3-5ed6-897c-09a66c99f7ae with identifier: PU69799
2026-03-29 18:45:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e080d537-bfc3-5ed6-897c-09a66c99f7ae with identifier: PU69799
2026-03-29 18:45:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e080d537-bfc3-5ed6-897c-09a66c99f7ae with identifier: PU69799 to the API
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:51:14Z',
'fuel_type': 'petrol',
'id': 'e080d537-bfc3-5ed6-897c-09a66c99f7ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU69799',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 30094,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-17',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2022}
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU69799%27 HTTP/1.1" 200 None
2026-03-29 18:45:44 [auto1.de] INFO: Saving data for PU69799: {'auction_closing_time': 1774885874.0, 'created_time': 1774723225.063268, 'last_price_update_time': 1774809944.446748}
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU69799') HTTP/1.1" 204 0
2026-03-29 18:45:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4118baf-ede4-5953-9306-346e6bc8ce17 with identifier: PP81333
2026-03-29 18:45:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4118baf-ede4-5953-9306-346e6bc8ce17 with identifier: PP81333
2026-03-29 18:45:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4118baf-ede4-5953-9306-346e6bc8ce17 with identifier: PP81333 to the API
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:58:53Z',
'fuel_type': 'diesel',
'id': 'c4118baf-ede4-5953-9306-346e6bc8ce17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP81333',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 217338,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-21',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2014}
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP81333%27 HTTP/1.1" 200 None
2026-03-29 18:45:44 [auto1.de] INFO: Saving data for PP81333: {'auction_closing_time': 1774886333.0, 'created_time': 1774723232.110278, 'last_price_update_time': 1774809944.739319}
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP81333') HTTP/1.1" 204 0
2026-03-29 18:45:44 [auto1.de] INFO: Found listing with ID: DG65550
2026-03-29 18:45:44 [auto1.de] INFO: Found listing with ID: SW06849
2026-03-29 18:45:44 [auto1.de] INFO: Found listing with ID: GZ70356
2026-03-29 18:45:44 [auto1.de] INFO: Found listing with ID: RS29828
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS29828%27 HTTP/1.1" 200 None
2026-03-29 18:45:44 [auto1.de] INFO: Scrape type for RS29828: 2
2026-03-29 18:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 452d4ce6-60d2-54c4-969e-220d7d63db57 with identifier: RS29828
2026-03-29 18:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 452d4ce6-60d2-54c4-969e-220d7d63db57 with scrape type 2
2026-03-29 18:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 452d4ce6-60d2-54c4-969e-220d7d63db57 with scrape type 2
2026-03-29 18:45:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 452d4ce6-60d2-54c4-969e-220d7d63db57, identifier: RS29828
2026-03-29 18:45:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 452d4ce6-60d2-54c4-969e-220d7d63db57 with identifier: RS29828
2026-03-29 18:45:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 452d4ce6-60d2-54c4-969e-220d7d63db57 with identifier: RS29828
2026-03-29 18:45:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 452d4ce6-60d2-54c4-969e-220d7d63db57 with identifier: RS29828 to the API
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:36:21Z',
'fuel_type': 'hybrid',
'id': '452d4ce6-60d2-54c4-969e-220d7d63db57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS29828',
'listing': 'auction',
'make': 'Toyota',
'model': 'Prius',
'odometer': 88582,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-21',
'seller_name': None,
'title': 'Toyota Prius 1.8 Comfort',
'transmission': 'automatic',
'trim': 'Comfort',
'year': 2016}
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS29828%27 HTTP/1.1" 200 None
2026-03-29 18:45:45 [auto1.de] INFO: Saving data for RS29828: {'auction_closing_time': 1774884981.0, 'created_time': 1774723372.834844, 'last_price_update_time': 1774809945.189784}
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS29828') HTTP/1.1" 204 0
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: WB65429
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB65429%27 HTTP/1.1" 200 None
2026-03-29 18:45:45 [auto1.de] INFO: Scrape type for WB65429: 2
2026-03-29 18:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24609bfe-3e13-53ba-9969-0efe212a8482 with identifier: WB65429
2026-03-29 18:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24609bfe-3e13-53ba-9969-0efe212a8482 with scrape type 2
2026-03-29 18:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24609bfe-3e13-53ba-9969-0efe212a8482 with scrape type 2
2026-03-29 18:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24609bfe-3e13-53ba-9969-0efe212a8482, identifier: WB65429
2026-03-29 18:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24609bfe-3e13-53ba-9969-0efe212a8482 with identifier: WB65429
2026-03-29 18:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24609bfe-3e13-53ba-9969-0efe212a8482 with identifier: WB65429
2026-03-29 18:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24609bfe-3e13-53ba-9969-0efe212a8482 with identifier: WB65429 to the API
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:32:06Z',
'fuel_type': 'petrol',
'id': '24609bfe-3e13-53ba-9969-0efe212a8482',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB65429',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 219830,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-02',
'seller_name': None,
'title': 'Hyundai i30 1.6 GDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2012}
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB65429%27 HTTP/1.1" 200 None
2026-03-29 18:45:45 [auto1.de] INFO: Saving data for WB65429: {'auction_closing_time': 1774884726.0, 'created_time': 1774033097.931131, 'last_price_update_time': 1774809945.58561}
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB65429') HTTP/1.1" 204 0
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: BV82977
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV82977%27 HTTP/1.1" 200 None
2026-03-29 18:45:45 [auto1.de] INFO: Scrape type for BV82977: 2
2026-03-29 18:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52d22574-6129-5137-af37-016dabcc8093 with identifier: BV82977
2026-03-29 18:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52d22574-6129-5137-af37-016dabcc8093 with scrape type 2
2026-03-29 18:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52d22574-6129-5137-af37-016dabcc8093 with scrape type 2
2026-03-29 18:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52d22574-6129-5137-af37-016dabcc8093, identifier: BV82977
2026-03-29 18:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52d22574-6129-5137-af37-016dabcc8093 with identifier: BV82977
2026-03-29 18:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52d22574-6129-5137-af37-016dabcc8093 with identifier: BV82977
2026-03-29 18:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52d22574-6129-5137-af37-016dabcc8093 with identifier: BV82977 to the API
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:58:32Z',
'fuel_type': 'petrol',
'id': '52d22574-6129-5137-af37-016dabcc8093',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV82977',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 141433,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-28',
'seller_name': None,
'title': 'Ford Focus 1.6 Concept',
'transmission': 'manual',
'trim': 'Concept',
'year': 2011}
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV82977%27 HTTP/1.1" 200 None
2026-03-29 18:45:45 [auto1.de] INFO: Saving data for BV82977: {'auction_closing_time': 1774886312.0, 'created_time': 1774723261.137475, 'last_price_update_time': 1774809945.977812}
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV82977') HTTP/1.1" 204 0
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: XM98153
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: ZV11386
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV11386%27 HTTP/1.1" 200 None
2026-03-29 18:45:46 [auto1.de] INFO: Scrape type for ZV11386: 2
2026-03-29 18:45:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7b793bd-a69a-530d-b3eb-627cf50be2c4 with identifier: ZV11386
2026-03-29 18:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7b793bd-a69a-530d-b3eb-627cf50be2c4 with scrape type 2
2026-03-29 18:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7b793bd-a69a-530d-b3eb-627cf50be2c4 with scrape type 2
2026-03-29 18:45:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7b793bd-a69a-530d-b3eb-627cf50be2c4, identifier: ZV11386
2026-03-29 18:45:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7b793bd-a69a-530d-b3eb-627cf50be2c4 with identifier: ZV11386
2026-03-29 18:45:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7b793bd-a69a-530d-b3eb-627cf50be2c4 with identifier: ZV11386
2026-03-29 18:45:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7b793bd-a69a-530d-b3eb-627cf50be2c4 with identifier: ZV11386 to the API
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:38:19Z',
'fuel_type': 'petrol',
'id': 'c7b793bd-a69a-530d-b3eb-627cf50be2c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV11386',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 172931,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-29',
'seller_name': None,
'title': 'Opel Astra 1.4 Turbo Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2016}
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV11386%27 HTTP/1.1" 200 None
2026-03-29 18:45:46 [auto1.de] INFO: Saving data for ZV11386: {'auction_closing_time': 1774885099.0, 'created_time': 1774723254.744946, 'last_price_update_time': 1774809946.426861}
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV11386') HTTP/1.1" 204 0
2026-03-29 18:45:46 [auto1.de] INFO: Found listing with ID: TM97127
2026-03-29 18:45:46 [auto1.de] INFO: Found listing with ID: FW24707
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW24707%27 HTTP/1.1" 200 None
2026-03-29 18:45:46 [auto1.de] INFO: Scrape type for FW24707: 2
2026-03-29 18:45:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6690f607-4957-555e-a051-306c79479799 with identifier: FW24707
2026-03-29 18:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6690f607-4957-555e-a051-306c79479799 with scrape type 2
2026-03-29 18:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6690f607-4957-555e-a051-306c79479799 with scrape type 2
2026-03-29 18:45:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6690f607-4957-555e-a051-306c79479799, identifier: FW24707
2026-03-29 18:45:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6690f607-4957-555e-a051-306c79479799 with identifier: FW24707
2026-03-29 18:45:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6690f607-4957-555e-a051-306c79479799 with identifier: FW24707
2026-03-29 18:45:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6690f607-4957-555e-a051-306c79479799 with identifier: FW24707 to the API
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 182,
'expiration_date': '2026-03-30T15:13:01Z',
'fuel_type': 'petrol',
'id': '6690f607-4957-555e-a051-306c79479799',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW24707',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 81934,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-13',
'seller_name': None,
'title': 'Ford Focus 1.5 EcoBoost ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2018}
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW24707%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Saving data for FW24707: {'auction_closing_time': 1774883581.0, 'created_time': 1774723255.082264, 'last_price_update_time': 1774809947.07001}
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW24707') HTTP/1.1" 204 0
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: ZB09378
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: NE29415
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE29415%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Scrape type for NE29415: 2
2026-03-29 18:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7170bc35-b369-51fe-9853-ccc3996dc328 with identifier: NE29415
2026-03-29 18:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7170bc35-b369-51fe-9853-ccc3996dc328 with scrape type 2
2026-03-29 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7170bc35-b369-51fe-9853-ccc3996dc328 with scrape type 2
2026-03-29 18:45:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7170bc35-b369-51fe-9853-ccc3996dc328, identifier: NE29415
2026-03-29 18:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7170bc35-b369-51fe-9853-ccc3996dc328 with identifier: NE29415
2026-03-29 18:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7170bc35-b369-51fe-9853-ccc3996dc328 with identifier: NE29415
2026-03-29 18:45:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7170bc35-b369-51fe-9853-ccc3996dc328 with identifier: NE29415 to the API
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:01:46Z',
'fuel_type': 'diesel',
'id': '7170bc35-b369-51fe-9853-ccc3996dc328',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE29415',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 161037,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-20',
'seller_name': None,
'title': 'Hyundai i30 1.6 CRDi Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2011}
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE29415%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Saving data for NE29415: {'auction_closing_time': 1774882906.0, 'created_time': 1774723369.950217, 'last_price_update_time': 1774809947.481679}
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE29415') HTTP/1.1" 204 0
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: ES97586
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: LF31183
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF31183%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Scrape type for LF31183: 2
2026-03-29 18:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33854af1-85d2-5344-bd2e-713c7848f050 with identifier: LF31183
2026-03-29 18:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33854af1-85d2-5344-bd2e-713c7848f050 with scrape type 2
2026-03-29 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33854af1-85d2-5344-bd2e-713c7848f050 with scrape type 2
2026-03-29 18:45:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33854af1-85d2-5344-bd2e-713c7848f050, identifier: LF31183
2026-03-29 18:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33854af1-85d2-5344-bd2e-713c7848f050 with identifier: LF31183
2026-03-29 18:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33854af1-85d2-5344-bd2e-713c7848f050 with identifier: LF31183
2026-03-29 18:45:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33854af1-85d2-5344-bd2e-713c7848f050 with identifier: LF31183 to the API
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:04:26Z',
'fuel_type': 'petrol',
'id': '33854af1-85d2-5344-bd2e-713c7848f050',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF31183',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 142053,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-09',
'seller_name': None,
'title': 'Audi A1 Sportback 1.4 TFSI Design',
'transmission': 'manual',
'trim': 'Design',
'year': 2017}
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF31183%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Saving data for LF31183: {'auction_closing_time': 1774883066.0, 'created_time': 1774031963.181135, 'last_price_update_time': 1774809947.885402}
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF31183') HTTP/1.1" 204 0
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: RU06209
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU06209%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Scrape type for RU06209: 2
2026-03-29 18:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d99e518-32d2-54f7-8214-843c927807e6 with identifier: RU06209
2026-03-29 18:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d99e518-32d2-54f7-8214-843c927807e6 with scrape type 2
2026-03-29 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d99e518-32d2-54f7-8214-843c927807e6 with scrape type 2
2026-03-29 18:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d99e518-32d2-54f7-8214-843c927807e6, identifier: RU06209
2026-03-29 18:45:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d99e518-32d2-54f7-8214-843c927807e6 with identifier: RU06209
2026-03-29 18:45:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d99e518-32d2-54f7-8214-843c927807e6 with identifier: RU06209
2026-03-29 18:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d99e518-32d2-54f7-8214-843c927807e6 with identifier: RU06209 to the API
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:28:28Z',
'fuel_type': 'petrol',
'id': '3d99e518-32d2-54f7-8214-843c927807e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU06209',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 171976,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-17',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.2 TSI Team BlueMotion',
'transmission': 'manual',
'trim': 'Team BlueMotion',
'year': 2010}
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU06209%27 HTTP/1.1" 200 None
2026-03-29 18:45:48 [auto1.de] INFO: Saving data for RU06209: {'auction_closing_time': 1774884508.0, 'created_time': 1774118439.748529, 'last_price_update_time': 1774809948.290666}
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU06209') HTTP/1.1" 204 0
2026-03-29 18:45:48 [auto1.de] INFO: Found listing with ID: MW27042
2026-03-29 18:45:48 [auto1.de] INFO: Found listing with ID: CN30644
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN30644%27 HTTP/1.1" 200 None
2026-03-29 18:45:48 [auto1.de] INFO: Scrape type for CN30644: 2
2026-03-29 18:45:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec55ff04-986b-5e4a-94b6-108635ae56f5 with identifier: CN30644
2026-03-29 18:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec55ff04-986b-5e4a-94b6-108635ae56f5 with scrape type 2
2026-03-29 18:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec55ff04-986b-5e4a-94b6-108635ae56f5 with scrape type 2
2026-03-29 18:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec55ff04-986b-5e4a-94b6-108635ae56f5, identifier: CN30644
2026-03-29 18:45:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec55ff04-986b-5e4a-94b6-108635ae56f5 with identifier: CN30644
2026-03-29 18:45:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec55ff04-986b-5e4a-94b6-108635ae56f5 with identifier: CN30644
2026-03-29 18:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec55ff04-986b-5e4a-94b6-108635ae56f5 with identifier: CN30644 to the API
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:33:00Z',
'fuel_type': 'petrol',
'id': 'ec55ff04-986b-5e4a-94b6-108635ae56f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN30644',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 195092,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-09',
'seller_name': None,
'title': 'BMW 3er 320i',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN30644%27 HTTP/1.1" 200 None
2026-03-29 18:45:48 [auto1.de] INFO: Saving data for CN30644: {'auction_closing_time': 1774884780.0, 'created_time': 1774349002.792702, 'last_price_update_time': 1774809948.68507}
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN30644') HTTP/1.1" 204 0
2026-03-29 18:45:48 [auto1.de] INFO: Found listing with ID: VF79484
2026-03-29 18:45:48 [auto1.de] INFO: Found listing with ID: PC42361
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42361%27 HTTP/1.1" 200 None
2026-03-29 18:45:48 [auto1.de] INFO: Scrape type for PC42361: 2
2026-03-29 18:45:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 427b8ddd-0248-5690-ae33-5af20c306874 with identifier: PC42361
2026-03-29 18:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 427b8ddd-0248-5690-ae33-5af20c306874 with scrape type 2
2026-03-29 18:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 427b8ddd-0248-5690-ae33-5af20c306874 with scrape type 2
2026-03-29 18:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 427b8ddd-0248-5690-ae33-5af20c306874, identifier: PC42361
2026-03-29 18:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 427b8ddd-0248-5690-ae33-5af20c306874 with identifier: PC42361
2026-03-29 18:45:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 427b8ddd-0248-5690-ae33-5af20c306874 with identifier: PC42361
2026-03-29 18:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 427b8ddd-0248-5690-ae33-5af20c306874 with identifier: PC42361 to the API
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:34:04Z',
'fuel_type': 'petrol',
'id': '427b8ddd-0248-5690-ae33-5af20c306874',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC42361',
'listing': 'auction',
'make': 'Kia',
'model': 'Venga',
'odometer': 137972,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-09',
'seller_name': None,
'title': 'Kia Venga 1.6 FIFA World Cup Edition',
'transmission': 'manual',
'trim': 'FIFA World Cup Edition',
'year': 2013}
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42361%27 HTTP/1.1" 200 None
2026-03-29 18:45:49 [auto1.de] INFO: Saving data for PC42361: {'auction_closing_time': 1774884844.0, 'created_time': 1773467153.59693, 'last_price_update_time': 1774809949.099636}
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC42361') HTTP/1.1" 204 0
2026-03-29 18:45:49 [auto1.de] INFO: Found listing with ID: ZD03679
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD03679%27 HTTP/1.1" 200 None
2026-03-29 18:45:49 [auto1.de] INFO: Scrape type for ZD03679: 2
2026-03-29 18:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 405d8db0-717e-542e-a79f-040449742afa with identifier: ZD03679
2026-03-29 18:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 405d8db0-717e-542e-a79f-040449742afa with scrape type 2
2026-03-29 18:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 405d8db0-717e-542e-a79f-040449742afa with scrape type 2
2026-03-29 18:45:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 405d8db0-717e-542e-a79f-040449742afa, identifier: ZD03679
2026-03-29 18:45:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 405d8db0-717e-542e-a79f-040449742afa with identifier: ZD03679
2026-03-29 18:45:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 405d8db0-717e-542e-a79f-040449742afa with identifier: ZD03679
2026-03-29 18:45:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 405d8db0-717e-542e-a79f-040449742afa with identifier: ZD03679 to the API
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:19:57Z',
'fuel_type': 'petrol',
'id': '405d8db0-717e-542e-a79f-040449742afa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD03679',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 130847,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-11-06',
'seller_name': None,
'title': 'Volkswagen Polo 1.4',
'transmission': 'automatic',
'trim': '',
'year': 2000}
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD03679%27 HTTP/1.1" 200 None
2026-03-29 18:45:49 [auto1.de] INFO: Saving data for ZD03679: {'auction_closing_time': 1774883997.0, 'created_time': 1774723368.628663, 'last_price_update_time': 1774809949.620886}
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD03679') HTTP/1.1" 204 0
2026-03-29 18:45:49 [auto1.de] INFO: Found listing with ID: AJ68338
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ68338%27 HTTP/1.1" 200 None
2026-03-29 18:45:49 [auto1.de] INFO: Scrape type for AJ68338: 2
2026-03-29 18:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a0e53df-9864-56d9-afa2-2a8740ea3d36 with identifier: AJ68338
2026-03-29 18:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a0e53df-9864-56d9-afa2-2a8740ea3d36 with scrape type 2
2026-03-29 18:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a0e53df-9864-56d9-afa2-2a8740ea3d36 with scrape type 2
2026-03-29 18:45:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a0e53df-9864-56d9-afa2-2a8740ea3d36, identifier: AJ68338
2026-03-29 18:45:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a0e53df-9864-56d9-afa2-2a8740ea3d36 with identifier: AJ68338
2026-03-29 18:45:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a0e53df-9864-56d9-afa2-2a8740ea3d36 with identifier: AJ68338
2026-03-29 18:45:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a0e53df-9864-56d9-afa2-2a8740ea3d36 with identifier: AJ68338 to the API
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:57:26Z',
'fuel_type': 'diesel',
'id': '8a0e53df-9864-56d9-afa2-2a8740ea3d36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ68338',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 228832,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-08',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2015}
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ68338%27 HTTP/1.1" 200 None
2026-03-29 18:45:50 [auto1.de] INFO: Saving data for AJ68338: {'auction_closing_time': 1774886246.0, 'created_time': 1774349240.409744, 'last_price_update_time': 1774809950.04749}
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ68338') HTTP/1.1" 204 0
2026-03-29 18:45:50 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:50 [auto1.de] INFO: Found listing with ID: XY91311
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91311%27 HTTP/1.1" 200 None
2026-03-29 18:45:50 [auto1.de] INFO: Scrape type for XY91311: 2
2026-03-29 18:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f84baffb-0e13-5ad0-a1a4-2ef597649472 with identifier: XY91311
2026-03-29 18:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f84baffb-0e13-5ad0-a1a4-2ef597649472 with scrape type 2
2026-03-29 18:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f84baffb-0e13-5ad0-a1a4-2ef597649472 with scrape type 2
2026-03-29 18:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f84baffb-0e13-5ad0-a1a4-2ef597649472, identifier: XY91311
2026-03-29 18:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f84baffb-0e13-5ad0-a1a4-2ef597649472 with identifier: XY91311
2026-03-29 18:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f84baffb-0e13-5ad0-a1a4-2ef597649472 with identifier: XY91311
2026-03-29 18:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f84baffb-0e13-5ad0-a1a4-2ef597649472 with identifier: XY91311 to the API
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:41:54Z',
'fuel_type': 'petrol',
'id': 'f84baffb-0e13-5ad0-a1a4-2ef597649472',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY91311',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 127668,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-16',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2013}
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91311%27 HTTP/1.1" 200 None
2026-03-29 18:45:50 [auto1.de] INFO: Saving data for XY91311: {'auction_closing_time': 1774885314.0, 'created_time': 1773466972.307928, 'last_price_update_time': 1774809950.480841}
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY91311') HTTP/1.1" 204 0
2026-03-29 18:45:50 [auto1.de] INFO: Found listing with ID: VX51529
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX51529%27 HTTP/1.1" 200 None
2026-03-29 18:45:50 [auto1.de] INFO: Scrape type for VX51529: 2
2026-03-29 18:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8820817c-b125-54c0-a95f-1d9485e8fbcb with identifier: VX51529
2026-03-29 18:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8820817c-b125-54c0-a95f-1d9485e8fbcb with scrape type 2
2026-03-29 18:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8820817c-b125-54c0-a95f-1d9485e8fbcb with scrape type 2
2026-03-29 18:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8820817c-b125-54c0-a95f-1d9485e8fbcb, identifier: VX51529
2026-03-29 18:45:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:50 [auto1.de] INFO: Found listing with ID: YS53721
2026-03-29 18:45:50 [auto1.de] INFO: Found listing with ID: NX07210
2026-03-29 18:45:50 [auto1.de] INFO: Found listing with ID: UJ32060
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ32060%27 HTTP/1.1" 200 None
2026-03-29 18:45:50 [auto1.de] INFO: Scrape type for UJ32060: 2
2026-03-29 18:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cff3e59-06db-5597-95ba-c222955270a2 with identifier: UJ32060
2026-03-29 18:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cff3e59-06db-5597-95ba-c222955270a2 with scrape type 2
2026-03-29 18:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cff3e59-06db-5597-95ba-c222955270a2 with scrape type 2
2026-03-29 18:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cff3e59-06db-5597-95ba-c222955270a2, identifier: UJ32060
2026-03-29 18:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8820817c-b125-54c0-a95f-1d9485e8fbcb with identifier: VX51529
2026-03-29 18:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8820817c-b125-54c0-a95f-1d9485e8fbcb with identifier: VX51529
2026-03-29 18:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8820817c-b125-54c0-a95f-1d9485e8fbcb with identifier: VX51529 to the API
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:29:47Z',
'fuel_type': 'petrol',
'id': '8820817c-b125-54c0-a95f-1d9485e8fbcb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX51529',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 64095,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-20',
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2021}
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX51529%27 HTTP/1.1" 200 None
2026-03-29 18:45:50 [auto1.de] INFO: Saving data for VX51529: {'auction_closing_time': 1774884587.0, 'created_time': 1774723386.110846, 'last_price_update_time': 1774809950.971484}
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX51529') HTTP/1.1" 204 0
2026-03-29 18:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cff3e59-06db-5597-95ba-c222955270a2 with identifier: UJ32060
2026-03-29 18:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cff3e59-06db-5597-95ba-c222955270a2 with identifier: UJ32060
2026-03-29 18:45:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cff3e59-06db-5597-95ba-c222955270a2 with identifier: UJ32060 to the API
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:58:31Z',
'fuel_type': 'diesel',
'id': '3cff3e59-06db-5597-95ba-c222955270a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ32060',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Range Rover Velar',
'odometer': 42357,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-03',
'seller_name': None,
'title': 'Land Rover Range Rover Velar 3.0 V6 Diesel S',
'transmission': 'automatic',
'trim': 'S',
'year': 2019}
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ32060%27 HTTP/1.1" 200 None
2026-03-29 18:45:51 [auto1.de] INFO: Saving data for UJ32060: {'auction_closing_time': 1774886311.0, 'created_time': 1774350144.259673, 'last_price_update_time': 1774809951.276749}
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ32060') HTTP/1.1" 204 0
2026-03-29 18:45:51 [auto1.de] INFO: Found listing with ID: ZX35580
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX35580%27 HTTP/1.1" 200 None
2026-03-29 18:45:51 [auto1.de] INFO: Scrape type for ZX35580: 2
2026-03-29 18:45:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fde70115-3e56-5bf9-82e0-fce4acf2b7ab with identifier: ZX35580
2026-03-29 18:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab with scrape type 2
2026-03-29 18:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab with scrape type 2
2026-03-29 18:45:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fde70115-3e56-5bf9-82e0-fce4acf2b7ab, identifier: ZX35580
2026-03-29 18:45:51 [auto1.de] INFO: Found listing with ID: LR70378
2026-03-29 18:45:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fde70115-3e56-5bf9-82e0-fce4acf2b7ab with identifier: ZX35580
2026-03-29 18:45:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fde70115-3e56-5bf9-82e0-fce4acf2b7ab with identifier: ZX35580
2026-03-29 18:45:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fde70115-3e56-5bf9-82e0-fce4acf2b7ab with identifier: ZX35580 to the API
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:39:48Z',
'fuel_type': 'diesel',
'id': 'fde70115-3e56-5bf9-82e0-fce4acf2b7ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX35580',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 141116,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-13',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line 2WD',
'transmission': 'manual',
'trim': 'Exclusive-Line 2WD',
'year': 2016}
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX35580%27 HTTP/1.1" 200 None
2026-03-29 18:45:51 [auto1.de] INFO: Saving data for ZX35580: {'auction_closing_time': 1774885188.0, 'created_time': 1774723282.255512, 'last_price_update_time': 1774809951.682618}
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX35580') HTTP/1.1" 204 0
2026-03-29 18:45:51 [auto1.de] INFO: Found listing with ID: MB10012
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB10012%27 HTTP/1.1" 200 None
2026-03-29 18:45:51 [auto1.de] INFO: Scrape type for MB10012: 2
2026-03-29 18:45:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 923d59ba-f624-5d17-b8e7-2e2dbbb44a75 with identifier: MB10012
2026-03-29 18:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 923d59ba-f624-5d17-b8e7-2e2dbbb44a75 with scrape type 2
2026-03-29 18:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 923d59ba-f624-5d17-b8e7-2e2dbbb44a75 with scrape type 2
2026-03-29 18:45:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 923d59ba-f624-5d17-b8e7-2e2dbbb44a75, identifier: MB10012
2026-03-29 18:45:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 923d59ba-f624-5d17-b8e7-2e2dbbb44a75 with identifier: MB10012
2026-03-29 18:45:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 923d59ba-f624-5d17-b8e7-2e2dbbb44a75 with identifier: MB10012
2026-03-29 18:45:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 923d59ba-f624-5d17-b8e7-2e2dbbb44a75 with identifier: MB10012 to the API
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:00:44Z',
'fuel_type': 'petrol',
'id': '923d59ba-f624-5d17-b8e7-2e2dbbb44a75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB10012',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 27610,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-30',
'seller_name': None,
'title': 'BMW 1er M135i xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2022}
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB10012%27 HTTP/1.1" 200 None
2026-03-29 18:45:52 [auto1.de] INFO: Saving data for MB10012: {'auction_closing_time': 1774882844.0, 'created_time': 1774350115.697237, 'last_price_update_time': 1774809952.115465}
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB10012') HTTP/1.1" 204 0
2026-03-29 18:45:52 [auto1.de] INFO: Found listing with ID: JB16135
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB16135%27 HTTP/1.1" 200 None
2026-03-29 18:45:52 [auto1.de] INFO: Scrape type for JB16135: 2
2026-03-29 18:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b22321c4-a09d-5a78-9987-c4a825a27d1e with identifier: JB16135
2026-03-29 18:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b22321c4-a09d-5a78-9987-c4a825a27d1e with scrape type 2
2026-03-29 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b22321c4-a09d-5a78-9987-c4a825a27d1e with scrape type 2
2026-03-29 18:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b22321c4-a09d-5a78-9987-c4a825a27d1e, identifier: JB16135
2026-03-29 18:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b22321c4-a09d-5a78-9987-c4a825a27d1e with identifier: JB16135
2026-03-29 18:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b22321c4-a09d-5a78-9987-c4a825a27d1e with identifier: JB16135
2026-03-29 18:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b22321c4-a09d-5a78-9987-c4a825a27d1e with identifier: JB16135 to the API
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:02:29Z',
'fuel_type': 'petrol',
'id': 'b22321c4-a09d-5a78-9987-c4a825a27d1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB16135',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 64802,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-04',
'seller_name': None,
'title': 'Volkswagen Beetle 1.2 TSI Design',
'transmission': 'manual',
'trim': 'Design',
'year': 2013}
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB16135%27 HTTP/1.1" 200 None
2026-03-29 18:45:52 [auto1.de] INFO: Saving data for JB16135: {'auction_closing_time': 1774882949.0, 'created_time': 1774723286.834484, 'last_price_update_time': 1774809952.512606}
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB16135') HTTP/1.1" 204 0
2026-03-29 18:45:52 [auto1.de] INFO: Found listing with ID: WX88880
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX88880%27 HTTP/1.1" 200 None
2026-03-29 18:45:52 [auto1.de] INFO: Scrape type for WX88880: 2
2026-03-29 18:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ec38590-92b7-5435-b8dc-b8ab11c2b44f with identifier: WX88880
2026-03-29 18:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ec38590-92b7-5435-b8dc-b8ab11c2b44f with scrape type 2
2026-03-29 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ec38590-92b7-5435-b8dc-b8ab11c2b44f with scrape type 2
2026-03-29 18:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ec38590-92b7-5435-b8dc-b8ab11c2b44f, identifier: WX88880
2026-03-29 18:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ec38590-92b7-5435-b8dc-b8ab11c2b44f with identifier: WX88880
2026-03-29 18:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ec38590-92b7-5435-b8dc-b8ab11c2b44f with identifier: WX88880
2026-03-29 18:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ec38590-92b7-5435-b8dc-b8ab11c2b44f with identifier: WX88880 to the API
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:56:13Z',
'fuel_type': 'petrol',
'id': '3ec38590-92b7-5435-b8dc-b8ab11c2b44f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX88880',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 50296,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-17',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2019}
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX88880%27 HTTP/1.1" 200 None
2026-03-29 18:45:53 [auto1.de] INFO: Saving data for WX88880: {'auction_closing_time': 1774886173.0, 'created_time': 1774089033.370914, 'last_price_update_time': 1774809953.025775}
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX88880') HTTP/1.1" 204 0
2026-03-29 18:45:53 [auto1.de] INFO: Found listing with ID: VG60095
2026-03-29 18:45:53 [auto1.de] INFO: Found listing with ID: AL99999
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL99999%27 HTTP/1.1" 200 None
2026-03-29 18:45:53 [auto1.de] INFO: Scrape type for AL99999: 2
2026-03-29 18:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6553baf9-39df-598f-a999-25315b750b72 with identifier: AL99999
2026-03-29 18:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6553baf9-39df-598f-a999-25315b750b72 with scrape type 2
2026-03-29 18:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6553baf9-39df-598f-a999-25315b750b72 with scrape type 2
2026-03-29 18:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6553baf9-39df-598f-a999-25315b750b72, identifier: AL99999
2026-03-29 18:45:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6553baf9-39df-598f-a999-25315b750b72 with identifier: AL99999
2026-03-29 18:45:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6553baf9-39df-598f-a999-25315b750b72 with identifier: AL99999
2026-03-29 18:45:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6553baf9-39df-598f-a999-25315b750b72 with identifier: AL99999 to the API
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:45:27Z',
'fuel_type': 'diesel',
'id': '6553baf9-39df-598f-a999-25315b750b72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL99999',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 148161,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-26',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 CDI BlueEfficiency Avantgarde',
'transmission': 'manual',
'trim': 'BlueEfficiency Avantgarde',
'year': 2012}
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL99999%27 HTTP/1.1" 200 None
2026-03-29 18:45:53 [auto1.de] INFO: Saving data for AL99999: {'auction_closing_time': 1774885527.0, 'created_time': 1774032300.394935, 'last_price_update_time': 1774809953.439384}
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL99999') HTTP/1.1" 204 0
2026-03-29 18:45:53 [auto1.de] INFO: Found listing with ID: NW19977
2026-03-29 18:45:53 [auto1.de] INFO: Found listing with ID: LD20816
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD20816%27 HTTP/1.1" 200 None
2026-03-29 18:45:53 [auto1.de] INFO: Scrape type for LD20816: 2
2026-03-29 18:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4858f21e-76f8-5236-8fa2-264c178f1b59 with identifier: LD20816
2026-03-29 18:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4858f21e-76f8-5236-8fa2-264c178f1b59 with scrape type 2
2026-03-29 18:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4858f21e-76f8-5236-8fa2-264c178f1b59 with scrape type 2
2026-03-29 18:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4858f21e-76f8-5236-8fa2-264c178f1b59, identifier: LD20816
2026-03-29 18:45:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4858f21e-76f8-5236-8fa2-264c178f1b59 with identifier: LD20816
2026-03-29 18:45:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4858f21e-76f8-5236-8fa2-264c178f1b59 with identifier: LD20816
2026-03-29 18:45:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4858f21e-76f8-5236-8fa2-264c178f1b59 with identifier: LD20816 to the API
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:41:28Z',
'fuel_type': 'diesel',
'id': '4858f21e-76f8-5236-8fa2-264c178f1b59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD20816',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 124367,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-04',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD20816%27 HTTP/1.1" 200 None
2026-03-29 18:45:53 [auto1.de] INFO: Saving data for LD20816: {'auction_closing_time': 1774885288.0, 'created_time': 1774349727.604184, 'last_price_update_time': 1774809953.858047}
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD20816') HTTP/1.1" 204 0
2026-03-29 18:45:53 [auto1.de] INFO: Found listing with ID: FR59515
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR59515%27 HTTP/1.1" 200 None
2026-03-29 18:45:53 [auto1.de] INFO: Scrape type for FR59515: 2
2026-03-29 18:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972 with identifier: FR59515
2026-03-29 18:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972 with scrape type 2
2026-03-29 18:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972 with scrape type 2
2026-03-29 18:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972, identifier: FR59515
2026-03-29 18:45:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972 with identifier: FR59515
2026-03-29 18:45:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972 with identifier: FR59515
2026-03-29 18:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972 with identifier: FR59515 to the API
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:11:19Z',
'fuel_type': 'petrol',
'id': '64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR59515',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 161601,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-30',
'seller_name': None,
'title': 'Ford Focus 1.6 Ti-VCT Style+',
'transmission': 'manual',
'trim': 'Style+',
'year': 2010}
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR59515%27 HTTP/1.1" 200 None
2026-03-29 18:45:54 [auto1.de] INFO: Saving data for FR59515: {'auction_closing_time': 1774883479.0, 'created_time': 1773467026.638101, 'last_price_update_time': 1774809954.261041}
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR59515') HTTP/1.1" 204 0
2026-03-29 18:45:54 [auto1.de] INFO: Found listing with ID: ND45572
2026-03-29 18:45:54 [auto1.de] INFO: Found listing with ID: XK76650
2026-03-29 18:45:54 [auto1.de] INFO: Found listing with ID: CL01053
2026-03-29 18:45:54 [auto1.de] INFO: Found listing with ID: PB68045
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB68045%27 HTTP/1.1" 200 None
2026-03-29 18:45:54 [auto1.de] INFO: Scrape type for PB68045: 2
2026-03-29 18:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16a542e1-48b3-5226-965f-880ef1002860 with identifier: PB68045
2026-03-29 18:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16a542e1-48b3-5226-965f-880ef1002860 with scrape type 2
2026-03-29 18:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16a542e1-48b3-5226-965f-880ef1002860 with scrape type 2
2026-03-29 18:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16a542e1-48b3-5226-965f-880ef1002860, identifier: PB68045
2026-03-29 18:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16a542e1-48b3-5226-965f-880ef1002860 with identifier: PB68045
2026-03-29 18:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16a542e1-48b3-5226-965f-880ef1002860 with identifier: PB68045
2026-03-29 18:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16a542e1-48b3-5226-965f-880ef1002860 with identifier: PB68045 to the API
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:58:29Z',
'fuel_type': 'diesel',
'id': '16a542e1-48b3-5226-965f-880ef1002860',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB68045',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 183889,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-14',
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2015}
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB68045%27 HTTP/1.1" 200 None
2026-03-29 18:45:54 [auto1.de] INFO: Saving data for PB68045: {'auction_closing_time': 1774886309.0, 'created_time': 1774723363.188167, 'last_price_update_time': 1774809954.697045}
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB68045') HTTP/1.1" 204 0
2026-03-29 18:45:54 [auto1.de] INFO: Found listing with ID: TD36353
2026-03-29 18:45:54 [auto1.de] INFO: Found listing with ID: UX88157
2026-03-29 18:45:54 [auto1.de] INFO: Found listing with ID: PS96436
2026-03-29 18:45:54 [auto1.de] INFO: Found listing with ID: CA26041
2026-03-29 18:45:54 [auto1.de] INFO: Found listing with ID: FK87134
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87134%27 HTTP/1.1" 200 None
2026-03-29 18:45:54 [auto1.de] INFO: Scrape type for FK87134: 2
2026-03-29 18:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44a8044f-c450-5be3-b500-3bc4536b884f with identifier: FK87134
2026-03-29 18:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44a8044f-c450-5be3-b500-3bc4536b884f with scrape type 2
2026-03-29 18:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44a8044f-c450-5be3-b500-3bc4536b884f with scrape type 2
2026-03-29 18:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44a8044f-c450-5be3-b500-3bc4536b884f, identifier: FK87134
2026-03-29 18:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44a8044f-c450-5be3-b500-3bc4536b884f with identifier: FK87134
2026-03-29 18:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44a8044f-c450-5be3-b500-3bc4536b884f with identifier: FK87134
2026-03-29 18:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44a8044f-c450-5be3-b500-3bc4536b884f with identifier: FK87134 to the API
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:20:47Z',
'fuel_type': 'diesel',
'id': '44a8044f-c450-5be3-b500-3bc4536b884f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK87134',
'listing': 'auction',
'make': 'Opel',
'model': 'Combo Life',
'odometer': 178645,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-26',
'seller_name': None,
'title': 'Opel Combo Life 1.5 CDTI INNOVATION',
'transmission': 'manual',
'trim': 'INNOVATION',
'year': 2019}
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87134%27 HTTP/1.1" 200 None
2026-03-29 18:45:55 [auto1.de] INFO: Saving data for FK87134: {'auction_closing_time': 1774884047.0, 'created_time': 1773467508.568938, 'last_price_update_time': 1774809955.103263}
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK87134') HTTP/1.1" 204 0
2026-03-29 18:45:55 [auto1.de] INFO: Found listing with ID: AC64408
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC64408%27 HTTP/1.1" 200 None
2026-03-29 18:45:55 [auto1.de] INFO: Scrape type for AC64408: 2
2026-03-29 18:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e11f052-e1b2-5459-ba6d-d58afbf34fa0 with identifier: AC64408
2026-03-29 18:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0 with scrape type 2
2026-03-29 18:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0 with scrape type 2
2026-03-29 18:45:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e11f052-e1b2-5459-ba6d-d58afbf34fa0, identifier: AC64408
2026-03-29 18:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e11f052-e1b2-5459-ba6d-d58afbf34fa0 with identifier: AC64408
2026-03-29 18:45:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e11f052-e1b2-5459-ba6d-d58afbf34fa0 with identifier: AC64408
2026-03-29 18:45:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e11f052-e1b2-5459-ba6d-d58afbf34fa0 with identifier: AC64408 to the API
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:00:39Z',
'fuel_type': 'petrol',
'id': '4e11f052-e1b2-5459-ba6d-d58afbf34fa0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC64408',
'listing': 'auction',
'make': 'Peugeot',
'model': '108',
'odometer': 87272,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-29',
'seller_name': None,
'title': 'Peugeot 108 1.2 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2015}
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC64408%27 HTTP/1.1" 200 None
2026-03-29 18:45:55 [auto1.de] INFO: Saving data for AC64408: {'auction_closing_time': 1774882839.0, 'created_time': 1774723290.988465, 'last_price_update_time': 1774809955.600641}
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC64408') HTTP/1.1" 204 0
2026-03-29 18:45:55 [auto1.de] INFO: Found listing with ID: MS92853
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS92853%27 HTTP/1.1" 200 None
2026-03-29 18:45:55 [auto1.de] INFO: Scrape type for MS92853: 2
2026-03-29 18:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1aead1ca-720d-54ed-b4db-ab60e2e65f0f with identifier: MS92853
2026-03-29 18:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aead1ca-720d-54ed-b4db-ab60e2e65f0f with scrape type 2
2026-03-29 18:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1aead1ca-720d-54ed-b4db-ab60e2e65f0f with scrape type 2
2026-03-29 18:45:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1aead1ca-720d-54ed-b4db-ab60e2e65f0f, identifier: MS92853
2026-03-29 18:45:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1aead1ca-720d-54ed-b4db-ab60e2e65f0f with identifier: MS92853
2026-03-29 18:45:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1aead1ca-720d-54ed-b4db-ab60e2e65f0f with identifier: MS92853
2026-03-29 18:45:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1aead1ca-720d-54ed-b4db-ab60e2e65f0f with identifier: MS92853 to the API
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:12:07Z',
'fuel_type': 'diesel',
'id': '1aead1ca-720d-54ed-b4db-ab60e2e65f0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS92853',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 173540,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-03',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2016}
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS92853%27 HTTP/1.1" 200 None
2026-03-29 18:45:55 [auto1.de] INFO: Saving data for MS92853: {'auction_closing_time': 1774883527.0, 'created_time': 1773304455.240492, 'last_price_update_time': 1774809955.999109}
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS92853') HTTP/1.1" 204 0
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: HJ08295
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: KJ96076
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96076%27 HTTP/1.1" 200 None
2026-03-29 18:45:56 [auto1.de] INFO: Scrape type for KJ96076: 2
2026-03-29 18:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 041de9a2-fe34-5e7b-b8fe-4878cbf00c32 with identifier: KJ96076
2026-03-29 18:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32 with scrape type 2
2026-03-29 18:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32 with scrape type 2
2026-03-29 18:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 041de9a2-fe34-5e7b-b8fe-4878cbf00c32, identifier: KJ96076
2026-03-29 18:45:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 041de9a2-fe34-5e7b-b8fe-4878cbf00c32 with identifier: KJ96076
2026-03-29 18:45:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 041de9a2-fe34-5e7b-b8fe-4878cbf00c32 with identifier: KJ96076
2026-03-29 18:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 041de9a2-fe34-5e7b-b8fe-4878cbf00c32 with identifier: KJ96076 to the API
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 243,
'expiration_date': '2026-03-30T15:44:37Z',
'fuel_type': 'petrol',
'id': '041de9a2-fe34-5e7b-b8fe-4878cbf00c32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ96076',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 194218,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-06',
'seller_name': None,
'title': 'Volvo XC90 3.2 R-Design Geartronic',
'transmission': 'automatic',
'trim': 'R-Design Geartronic',
'year': 2010}
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96076%27 HTTP/1.1" 200 None
2026-03-29 18:45:56 [auto1.de] INFO: Saving data for KJ96076: {'auction_closing_time': 1774885477.0, 'created_time': 1774723378.368023, 'last_price_update_time': 1774809956.395164}
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ96076') HTTP/1.1" 204 0
2026-03-29 18:45:56 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: AL40501
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: US66744
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US66744%27 HTTP/1.1" 200 None
2026-03-29 18:45:56 [auto1.de] INFO: Scrape type for US66744: 2
2026-03-29 18:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54315052-af72-57db-b053-c7b4de7fa63d with identifier: US66744
2026-03-29 18:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54315052-af72-57db-b053-c7b4de7fa63d with scrape type 2
2026-03-29 18:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54315052-af72-57db-b053-c7b4de7fa63d with scrape type 2
2026-03-29 18:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54315052-af72-57db-b053-c7b4de7fa63d, identifier: US66744
2026-03-29 18:45:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54315052-af72-57db-b053-c7b4de7fa63d with identifier: US66744
2026-03-29 18:45:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54315052-af72-57db-b053-c7b4de7fa63d with identifier: US66744
2026-03-29 18:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54315052-af72-57db-b053-c7b4de7fa63d with identifier: US66744 to the API
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:20:12Z',
'fuel_type': 'petrol',
'id': '54315052-af72-57db-b053-c7b4de7fa63d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US66744',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 73348,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-23',
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
'transmission': 'manual',
'trim': 'Stepway Prestige',
'year': 2015}
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US66744%27 HTTP/1.1" 200 None
2026-03-29 18:45:56 [auto1.de] INFO: Saving data for US66744: {'auction_closing_time': 1774884012.0, 'created_time': 1774723289.342264, 'last_price_update_time': 1774809956.797331}
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US66744') HTTP/1.1" 204 0
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: TT73177
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: TN55271
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55271%27 HTTP/1.1" 200 None
2026-03-29 18:45:56 [auto1.de] INFO: Scrape type for TN55271: 2
2026-03-29 18:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e with identifier: TN55271
2026-03-29 18:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e with scrape type 2
2026-03-29 18:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e with scrape type 2
2026-03-29 18:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e, identifier: TN55271
2026-03-29 18:45:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: WF58596
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: HP30052
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: RT47702
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: GB90564
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB90564%27 HTTP/1.1" 200 None
2026-03-29 18:45:56 [auto1.de] INFO: Scrape type for GB90564: 2
2026-03-29 18:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f073838-314c-5126-b94c-d4da47a67f4f with identifier: GB90564
2026-03-29 18:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f073838-314c-5126-b94c-d4da47a67f4f with scrape type 2
2026-03-29 18:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f073838-314c-5126-b94c-d4da47a67f4f with scrape type 2
2026-03-29 18:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f073838-314c-5126-b94c-d4da47a67f4f, identifier: GB90564
2026-03-29 18:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e with identifier: TN55271
2026-03-29 18:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e with identifier: TN55271
2026-03-29 18:45:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e with identifier: TN55271 to the API
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 420,
'expiration_date': '2026-03-30T15:48:13Z',
'fuel_type': 'petrol',
'id': '3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN55271',
'listing': 'auction',
'make': 'Audi',
'model': 'S7 Sportback',
'odometer': 165664,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-12',
'seller_name': None,
'title': 'Audi S7 Sportback 4.0 V8 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2012}
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55271%27 HTTP/1.1" 200 None
2026-03-29 18:45:57 [auto1.de] INFO: Saving data for TN55271: {'auction_closing_time': 1774885693.0, 'created_time': 1774089348.39497, 'last_price_update_time': 1774809957.303081}
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN55271') HTTP/1.1" 204 0
2026-03-29 18:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f073838-314c-5126-b94c-d4da47a67f4f with identifier: GB90564
2026-03-29 18:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f073838-314c-5126-b94c-d4da47a67f4f with identifier: GB90564
2026-03-29 18:45:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f073838-314c-5126-b94c-d4da47a67f4f with identifier: GB90564 to the API
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:58:42Z',
'fuel_type': 'petrol',
'id': '1f073838-314c-5126-b94c-d4da47a67f4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB90564',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 195676,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-25',
'seller_name': None,
'title': 'Suzuki Swift 1.2 Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2014}
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB90564%27 HTTP/1.1" 200 None
2026-03-29 18:45:57 [auto1.de] INFO: Saving data for GB90564: {'auction_closing_time': 1774886322.0, 'created_time': 1774723375.858418, 'last_price_update_time': 1774809957.680775}
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB90564') HTTP/1.1" 204 0
2026-03-29 18:45:57 [auto1.de] INFO: Found listing with ID: DZ73228
2026-03-29 18:45:57 [auto1.de] INFO: Found listing with ID: ZA78506
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA78506%27 HTTP/1.1" 200 None
2026-03-29 18:45:57 [auto1.de] INFO: Scrape type for ZA78506: 2
2026-03-29 18:45:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65e0557a-8cdf-5bff-9598-937c1ff5035a with identifier: ZA78506
2026-03-29 18:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65e0557a-8cdf-5bff-9598-937c1ff5035a with scrape type 2
2026-03-29 18:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65e0557a-8cdf-5bff-9598-937c1ff5035a with scrape type 2
2026-03-29 18:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65e0557a-8cdf-5bff-9598-937c1ff5035a, identifier: ZA78506
2026-03-29 18:45:57 [auto1.de] INFO: Found listing with ID: RL85498
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL85498%27 HTTP/1.1" 200 None
2026-03-29 18:45:57 [auto1.de] INFO: Scrape type for RL85498: 2
2026-03-29 18:45:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52 with identifier: RL85498
2026-03-29 18:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52 with scrape type 2
2026-03-29 18:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52 with scrape type 2
2026-03-29 18:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52, identifier: RL85498
2026-03-29 18:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65e0557a-8cdf-5bff-9598-937c1ff5035a with identifier: ZA78506
2026-03-29 18:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65e0557a-8cdf-5bff-9598-937c1ff5035a with identifier: ZA78506
2026-03-29 18:45:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65e0557a-8cdf-5bff-9598-937c1ff5035a with identifier: ZA78506 to the API
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:06:49Z',
'fuel_type': 'petrol',
'id': '65e0557a-8cdf-5bff-9598-937c1ff5035a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA78506',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 273923,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-17',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
'transmission': 'manual',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2012}
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA78506%27 HTTP/1.1" 200 None
2026-03-29 18:45:58 [auto1.de] INFO: Saving data for ZA78506: {'auction_closing_time': 1774883209.0, 'created_time': 1774723285.160164, 'last_price_update_time': 1774809958.203669}
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA78506') HTTP/1.1" 204 0
2026-03-29 18:45:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52 with identifier: RL85498
2026-03-29 18:45:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52 with identifier: RL85498
2026-03-29 18:45:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52 with identifier: RL85498 to the API
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:27:52Z',
'fuel_type': 'diesel',
'id': '311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL85498',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 36995,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-05',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
'transmission': 'manual',
'trim': '350 L3 Trend',
'year': 2023}
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL85498%27 HTTP/1.1" 200 None
2026-03-29 18:45:58 [auto1.de] INFO: Saving data for RL85498: {'auction_closing_time': 1774884472.0, 'created_time': 1773305669.110521, 'last_price_update_time': 1774809958.489224}
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL85498') HTTP/1.1" 204 0
2026-03-29 18:45:58 [auto1.de] INFO: Found listing with ID: BT55955
2026-03-29 18:45:58 [auto1.de] INFO: Found listing with ID: XT21551
2026-03-29 18:45:58 [auto1.de] INFO: Found listing with ID: KB45443
2026-03-29 18:45:58 [auto1.de] INFO: Found listing with ID: XT20747
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20747%27 HTTP/1.1" 200 None
2026-03-29 18:45:58 [auto1.de] INFO: Scrape type for XT20747: 2
2026-03-29 18:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c084f4cf-3fcf-5b95-bcfe-b7f558015fd3 with identifier: XT20747
2026-03-29 18:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c084f4cf-3fcf-5b95-bcfe-b7f558015fd3 with scrape type 2
2026-03-29 18:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c084f4cf-3fcf-5b95-bcfe-b7f558015fd3 with scrape type 2
2026-03-29 18:45:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c084f4cf-3fcf-5b95-bcfe-b7f558015fd3, identifier: XT20747
2026-03-29 18:45:58 [auto1.de] INFO: Found listing with ID: NV50024
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV50024%27 HTTP/1.1" 200 None
2026-03-29 18:45:58 [auto1.de] INFO: Scrape type for NV50024: 2
2026-03-29 18:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad57ac34-49c5-5baf-b713-35976aedf3fd with identifier: NV50024
2026-03-29 18:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad57ac34-49c5-5baf-b713-35976aedf3fd with scrape type 2
2026-03-29 18:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad57ac34-49c5-5baf-b713-35976aedf3fd with scrape type 2
2026-03-29 18:45:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad57ac34-49c5-5baf-b713-35976aedf3fd, identifier: NV50024
2026-03-29 18:45:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c084f4cf-3fcf-5b95-bcfe-b7f558015fd3 with identifier: XT20747
2026-03-29 18:45:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c084f4cf-3fcf-5b95-bcfe-b7f558015fd3 with identifier: XT20747
2026-03-29 18:45:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c084f4cf-3fcf-5b95-bcfe-b7f558015fd3 with identifier: XT20747 to the API
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:49:55Z',
'fuel_type': 'diesel',
'id': 'c084f4cf-3fcf-5b95-bcfe-b7f558015fd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT20747',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 370005,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-31',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20747%27 HTTP/1.1" 200 None
2026-03-29 18:45:59 [auto1.de] INFO: Saving data for XT20747: {'auction_closing_time': 1774885795.0, 'created_time': 1773401356.18216, 'last_price_update_time': 1774809959.034877}
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT20747') HTTP/1.1" 204 0
2026-03-29 18:45:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad57ac34-49c5-5baf-b713-35976aedf3fd with identifier: NV50024
2026-03-29 18:45:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad57ac34-49c5-5baf-b713-35976aedf3fd with identifier: NV50024
2026-03-29 18:45:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad57ac34-49c5-5baf-b713-35976aedf3fd with identifier: NV50024 to the API
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-30T15:04:34Z',
'fuel_type': 'petrol',
'id': 'ad57ac34-49c5-5baf-b713-35976aedf3fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV50024',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 110706,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-14',
'seller_name': None,
'title': 'Renault Megane 1.2 TCe Energy GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2016}
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV50024%27 HTTP/1.1" 200 None
2026-03-29 18:45:59 [auto1.de] INFO: Saving data for NV50024: {'auction_closing_time': 1774883074.0, 'created_time': 1773400786.742512, 'last_price_update_time': 1774809959.360892}
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV50024') HTTP/1.1" 204 0
2026-03-29 18:45:59 [auto1.de] INFO: Found listing with ID: GF23268
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF23268%27 HTTP/1.1" 200 None
2026-03-29 18:45:59 [auto1.de] INFO: Scrape type for GF23268: 2
2026-03-29 18:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87a44eab-d965-53e9-8713-c9d1119b1bbe with identifier: GF23268
2026-03-29 18:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a44eab-d965-53e9-8713-c9d1119b1bbe with scrape type 2
2026-03-29 18:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87a44eab-d965-53e9-8713-c9d1119b1bbe with scrape type 2
2026-03-29 18:45:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87a44eab-d965-53e9-8713-c9d1119b1bbe, identifier: GF23268
2026-03-29 18:45:59 [auto1.de] INFO: Found listing with ID: WB83413
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB83413%27 HTTP/1.1" 200 None
2026-03-29 18:45:59 [auto1.de] INFO: Scrape type for WB83413: 2
2026-03-29 18:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cc7ca0d-c119-5051-8b85-bdc54b534245 with identifier: WB83413
2026-03-29 18:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cc7ca0d-c119-5051-8b85-bdc54b534245 with scrape type 2
2026-03-29 18:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cc7ca0d-c119-5051-8b85-bdc54b534245 with scrape type 2
2026-03-29 18:45:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cc7ca0d-c119-5051-8b85-bdc54b534245, identifier: WB83413
2026-03-29 18:45:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87a44eab-d965-53e9-8713-c9d1119b1bbe with identifier: GF23268
2026-03-29 18:45:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87a44eab-d965-53e9-8713-c9d1119b1bbe with identifier: GF23268
2026-03-29 18:45:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87a44eab-d965-53e9-8713-c9d1119b1bbe with identifier: GF23268 to the API
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:31:50Z',
'fuel_type': 'petrol',
'id': '87a44eab-d965-53e9-8713-c9d1119b1bbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF23268',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 105949,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-25',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF23268%27 HTTP/1.1" 200 None
2026-03-29 18:45:59 [auto1.de] INFO: Saving data for GF23268: {'auction_closing_time': 1774884710.0, 'created_time': 1774723365.263027, 'last_price_update_time': 1774809959.858558}
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF23268') HTTP/1.1" 204 0
2026-03-29 18:45:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cc7ca0d-c119-5051-8b85-bdc54b534245 with identifier: WB83413
2026-03-29 18:45:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cc7ca0d-c119-5051-8b85-bdc54b534245 with identifier: WB83413
2026-03-29 18:45:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cc7ca0d-c119-5051-8b85-bdc54b534245 with identifier: WB83413 to the API
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:45:28Z',
'fuel_type': 'diesel',
'id': '1cc7ca0d-c119-5051-8b85-bdc54b534245',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB83413',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 379178,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-24',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
'transmission': 'manual',
'trim': 'Sport & Style 4Motion',
'year': 2008}
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB83413%27 HTTP/1.1" 200 None
2026-03-29 18:46:00 [auto1.de] INFO: Saving data for WB83413: {'auction_closing_time': 1774885528.0, 'created_time': 1774723299.141938, 'last_price_update_time': 1774809960.217656}
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB83413') HTTP/1.1" 204 0
2026-03-29 18:46:00 [auto1.de] INFO: Found listing with ID: YD01023
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD01023%27 HTTP/1.1" 200 None
2026-03-29 18:46:00 [auto1.de] INFO: Scrape type for YD01023: 2
2026-03-29 18:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 200c8258-7a62-5b22-a7ef-bbff2816b7d8 with identifier: YD01023
2026-03-29 18:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200c8258-7a62-5b22-a7ef-bbff2816b7d8 with scrape type 2
2026-03-29 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 200c8258-7a62-5b22-a7ef-bbff2816b7d8 with scrape type 2
2026-03-29 18:46:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 200c8258-7a62-5b22-a7ef-bbff2816b7d8, identifier: YD01023
2026-03-29 18:46:00 [auto1.de] INFO: Found listing with ID: NX27502
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX27502%27 HTTP/1.1" 200 None
2026-03-29 18:46:00 [auto1.de] INFO: Scrape type for NX27502: 2
2026-03-29 18:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3784b105-ba52-554a-b989-ed0fe0ec618f with identifier: NX27502
2026-03-29 18:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3784b105-ba52-554a-b989-ed0fe0ec618f with scrape type 2
2026-03-29 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3784b105-ba52-554a-b989-ed0fe0ec618f with scrape type 2
2026-03-29 18:46:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3784b105-ba52-554a-b989-ed0fe0ec618f, identifier: NX27502
2026-03-29 18:46:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 200c8258-7a62-5b22-a7ef-bbff2816b7d8 with identifier: YD01023
2026-03-29 18:46:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 200c8258-7a62-5b22-a7ef-bbff2816b7d8 with identifier: YD01023
2026-03-29 18:46:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 200c8258-7a62-5b22-a7ef-bbff2816b7d8 with identifier: YD01023 to the API
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:30:38Z',
'fuel_type': 'diesel',
'id': '200c8258-7a62-5b22-a7ef-bbff2816b7d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD01023',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 252661,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-21',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2010}
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD01023%27 HTTP/1.1" 200 None
2026-03-29 18:46:00 [auto1.de] INFO: Saving data for YD01023: {'auction_closing_time': 1774884638.0, 'created_time': 1774723380.82, 'last_price_update_time': 1774809960.724086}
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD01023') HTTP/1.1" 204 0
2026-03-29 18:46:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3784b105-ba52-554a-b989-ed0fe0ec618f with identifier: NX27502
2026-03-29 18:46:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3784b105-ba52-554a-b989-ed0fe0ec618f with identifier: NX27502
2026-03-29 18:46:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3784b105-ba52-554a-b989-ed0fe0ec618f with identifier: NX27502 to the API
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:02:51Z',
'fuel_type': 'petrol',
'id': '3784b105-ba52-554a-b989-ed0fe0ec618f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX27502',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 34473,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-09',
'seller_name': None,
'title': 'BMW 2er 218i Gran Coupe Sport Line',
'transmission': 'manual',
'trim': 'Sport Line',
'year': 2024}
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX27502%27 HTTP/1.1" 200 None
2026-03-29 18:46:01 [auto1.de] INFO: Saving data for NX27502: {'auction_closing_time': 1774882971.0, 'created_time': 1774034564.635158, 'last_price_update_time': 1774809961.10391}
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX27502') HTTP/1.1" 204 0
2026-03-29 18:46:01 [auto1.de] INFO: Found listing with ID: GJ73585
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ73585%27 HTTP/1.1" 200 None
2026-03-29 18:46:01 [auto1.de] INFO: Scrape type for GJ73585: 2
2026-03-29 18:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7 with identifier: GJ73585
2026-03-29 18:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7 with scrape type 2
2026-03-29 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7 with scrape type 2
2026-03-29 18:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7, identifier: GJ73585
2026-03-29 18:46:01 [auto1.de] INFO: Found listing with ID: BY26931
2026-03-29 18:46:01 [auto1.de] INFO: Found listing with ID: MF21991
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF21991%27 HTTP/1.1" 200 None
2026-03-29 18:46:01 [auto1.de] INFO: Scrape type for MF21991: 2
2026-03-29 18:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58702e34-07fc-559d-a68b-b3cf9e7817d9 with identifier: MF21991
2026-03-29 18:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58702e34-07fc-559d-a68b-b3cf9e7817d9 with scrape type 2
2026-03-29 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58702e34-07fc-559d-a68b-b3cf9e7817d9 with scrape type 2
2026-03-29 18:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58702e34-07fc-559d-a68b-b3cf9e7817d9, identifier: MF21991
2026-03-29 18:46:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7 with identifier: GJ73585
2026-03-29 18:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7 with identifier: GJ73585
2026-03-29 18:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7 with identifier: GJ73585 to the API
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:41:12Z',
'fuel_type': 'diesel',
'id': 'e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ73585',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 217309,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-24',
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ73585%27 HTTP/1.1" 200 None
2026-03-29 18:46:01 [auto1.de] INFO: Saving data for GJ73585: {'auction_closing_time': 1774885272.0, 'created_time': 1774723288.412204, 'last_price_update_time': 1774809961.679095}
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ73585') HTTP/1.1" 204 0
2026-03-29 18:46:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58702e34-07fc-559d-a68b-b3cf9e7817d9 with identifier: MF21991
2026-03-29 18:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58702e34-07fc-559d-a68b-b3cf9e7817d9 with identifier: MF21991
2026-03-29 18:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58702e34-07fc-559d-a68b-b3cf9e7817d9 with identifier: MF21991 to the API
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:12:51Z',
'fuel_type': 'petrol',
'id': '58702e34-07fc-559d-a68b-b3cf9e7817d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF21991',
'listing': 'auction',
'make': 'Infiniti',
'model': 'EX',
'odometer': 262680,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-14',
'seller_name': None,
'title': 'Infiniti EX 3.7 V6 EX37 GT',
'transmission': 'automatic',
'trim': '37 GT',
'year': 2012}
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF21991%27 HTTP/1.1" 200 None
2026-03-29 18:46:01 [auto1.de] INFO: Saving data for MF21991: {'auction_closing_time': 1774883571.0, 'created_time': 1773304304.026468, 'last_price_update_time': 1774809961.979042}
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF21991') HTTP/1.1" 204 0
2026-03-29 18:46:01 [auto1.de] INFO: Found listing with ID: VA37364
2026-03-29 18:46:01 [auto1.de] INFO: Found listing with ID: CA66668
2026-03-29 18:46:01 [auto1.de] INFO: Found listing with ID: NZ98006
2026-03-29 18:46:01 [auto1.de] INFO: Found listing with ID: MP14986
2026-03-29 18:46:01 [auto1.de] INFO: Found listing with ID: YC95910
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC95910%27 HTTP/1.1" 200 None
2026-03-29 18:46:02 [auto1.de] INFO: Scrape type for YC95910: 2
2026-03-29 18:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8e32792-4605-5aab-bd58-73b082afd91c with identifier: YC95910
2026-03-29 18:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8e32792-4605-5aab-bd58-73b082afd91c with scrape type 2
2026-03-29 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8e32792-4605-5aab-bd58-73b082afd91c with scrape type 2
2026-03-29 18:46:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8e32792-4605-5aab-bd58-73b082afd91c, identifier: YC95910
2026-03-29 18:46:02 [auto1.de] INFO: Found listing with ID: MV86263
2026-03-29 18:46:02 [auto1.de] INFO: Found listing with ID: XR92513
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR92513%27 HTTP/1.1" 200 None
2026-03-29 18:46:02 [auto1.de] INFO: Scrape type for XR92513: 2
2026-03-29 18:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caac8930-4b5a-593c-bc72-4a39ce9f96ed with identifier: XR92513
2026-03-29 18:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caac8930-4b5a-593c-bc72-4a39ce9f96ed with scrape type 2
2026-03-29 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caac8930-4b5a-593c-bc72-4a39ce9f96ed with scrape type 2
2026-03-29 18:46:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caac8930-4b5a-593c-bc72-4a39ce9f96ed, identifier: XR92513
2026-03-29 18:46:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8e32792-4605-5aab-bd58-73b082afd91c with identifier: YC95910
2026-03-29 18:46:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8e32792-4605-5aab-bd58-73b082afd91c with identifier: YC95910
2026-03-29 18:46:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8e32792-4605-5aab-bd58-73b082afd91c with identifier: YC95910 to the API
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:52:04Z',
'fuel_type': 'petrol',
'id': 'e8e32792-4605-5aab-bd58-73b082afd91c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC95910',
'listing': 'auction',
'make': 'Fiat',
'model': 'Barchetta',
'odometer': 174135,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-03-30',
'seller_name': None,
'title': "Fiat Barchetta 1.8 Limited Edition '99",
'transmission': 'manual',
'trim': "Limited Edition '99",
'year': 1998}
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC95910%27 HTTP/1.1" 200 None
2026-03-29 18:46:02 [auto1.de] INFO: Saving data for YC95910: {'auction_closing_time': 1774885924.0, 'created_time': 1774723405.761145, 'last_price_update_time': 1774809962.490199}
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC95910') HTTP/1.1" 204 0
2026-03-29 18:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caac8930-4b5a-593c-bc72-4a39ce9f96ed with identifier: XR92513
2026-03-29 18:46:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caac8930-4b5a-593c-bc72-4a39ce9f96ed with identifier: XR92513
2026-03-29 18:46:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caac8930-4b5a-593c-bc72-4a39ce9f96ed with identifier: XR92513 to the API
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 179,
'expiration_date': '2026-03-30T15:43:43Z',
'fuel_type': 'diesel',
'id': 'caac8930-4b5a-593c-bc72-4a39ce9f96ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR92513',
'listing': 'auction',
'make': 'Opel',
'model': 'Movano',
'odometer': 65337,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-08',
'seller_name': None,
'title': 'Opel Movano 2.3 CDTI L3H2 3,5t',
'transmission': 'manual',
'trim': 'L3H2 3,5t',
'year': 2021}
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR92513%27 HTTP/1.1" 200 None
2026-03-29 18:46:02 [auto1.de] INFO: Saving data for XR92513: {'auction_closing_time': 1774885423.0, 'created_time': 1773134926.918747, 'last_price_update_time': 1774809962.812316}
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR92513') HTTP/1.1" 204 0
2026-03-29 18:46:02 [auto1.de] INFO: Found listing with ID: KU30255
2026-03-29 18:46:02 [auto1.de] INFO: Found listing with ID: HE47734
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE47734%27 HTTP/1.1" 200 None
2026-03-29 18:46:02 [auto1.de] INFO: Scrape type for HE47734: 2
2026-03-29 18:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 557c44d2-c1a5-5925-b6aa-d7430ce6716b with identifier: HE47734
2026-03-29 18:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b with scrape type 2
2026-03-29 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b with scrape type 2
2026-03-29 18:46:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 557c44d2-c1a5-5925-b6aa-d7430ce6716b, identifier: HE47734
2026-03-29 18:46:02 [auto1.de] INFO: Found listing with ID: GZ82101
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ82101%27 HTTP/1.1" 200 None
2026-03-29 18:46:02 [auto1.de] INFO: Scrape type for GZ82101: 2
2026-03-29 18:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc with identifier: GZ82101
2026-03-29 18:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc with scrape type 2
2026-03-29 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc with scrape type 2
2026-03-29 18:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc, identifier: GZ82101
2026-03-29 18:46:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 557c44d2-c1a5-5925-b6aa-d7430ce6716b with identifier: HE47734
2026-03-29 18:46:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 557c44d2-c1a5-5925-b6aa-d7430ce6716b with identifier: HE47734
2026-03-29 18:46:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 557c44d2-c1a5-5925-b6aa-d7430ce6716b with identifier: HE47734 to the API
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:00:12Z',
'fuel_type': 'diesel',
'id': '557c44d2-c1a5-5925-b6aa-d7430ce6716b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE47734',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 111873,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-17',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Join',
'transmission': 'manual',
'trim': 'Join',
'year': 2019}
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE47734%27 HTTP/1.1" 200 None
2026-03-29 18:46:03 [auto1.de] INFO: Saving data for HE47734: {'auction_closing_time': 1774882812.0, 'created_time': 1774723383.968228, 'last_price_update_time': 1774809963.324552}
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE47734') HTTP/1.1" 204 0
2026-03-29 18:46:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc with identifier: GZ82101
2026-03-29 18:46:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc with identifier: GZ82101
2026-03-29 18:46:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc with identifier: GZ82101 to the API
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:52:18Z',
'fuel_type': 'petrol',
'id': '9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ82101',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 180325,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-13',
'seller_name': None,
'title': 'Seat Ibiza 1.2 Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2009}
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ82101%27 HTTP/1.1" 200 None
2026-03-29 18:46:03 [auto1.de] INFO: Saving data for GZ82101: {'auction_closing_time': 1774885938.0, 'created_time': 1774723302.378536, 'last_price_update_time': 1774809963.72507}
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ82101') HTTP/1.1" 204 0
2026-03-29 18:46:03 [auto1.de] INFO: Found listing with ID: JR52179
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR52179%27 HTTP/1.1" 200 None
2026-03-29 18:46:03 [auto1.de] INFO: Scrape type for JR52179: 2
2026-03-29 18:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7b6a524-41ae-5436-8f96-b5e64cf2e877 with identifier: JR52179
2026-03-29 18:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7b6a524-41ae-5436-8f96-b5e64cf2e877 with scrape type 2
2026-03-29 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7b6a524-41ae-5436-8f96-b5e64cf2e877 with scrape type 2
2026-03-29 18:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7b6a524-41ae-5436-8f96-b5e64cf2e877, identifier: JR52179
2026-03-29 18:46:03 [auto1.de] INFO: Found listing with ID: MH61351
2026-03-29 18:46:03 [auto1.de] INFO: Found listing with ID: FT59815
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT59815%27 HTTP/1.1" 200 None
2026-03-29 18:46:03 [auto1.de] INFO: Scrape type for FT59815: 2
2026-03-29 18:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5ef1ffc-092c-5034-b687-f99265407c08 with identifier: FT59815
2026-03-29 18:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5ef1ffc-092c-5034-b687-f99265407c08 with scrape type 2
2026-03-29 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5ef1ffc-092c-5034-b687-f99265407c08 with scrape type 2
2026-03-29 18:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5ef1ffc-092c-5034-b687-f99265407c08, identifier: FT59815
2026-03-29 18:46:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7b6a524-41ae-5436-8f96-b5e64cf2e877 with identifier: JR52179
2026-03-29 18:46:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7b6a524-41ae-5436-8f96-b5e64cf2e877 with identifier: JR52179
2026-03-29 18:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7b6a524-41ae-5436-8f96-b5e64cf2e877 with identifier: JR52179 to the API
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:21:03Z',
'fuel_type': 'diesel',
'id': 'c7b6a524-41ae-5436-8f96-b5e64cf2e877',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR52179',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 188222,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-09',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Cup BlueMotion',
'transmission': 'automatic',
'trim': 'Cup BlueMotion',
'year': 2015}
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR52179%27 HTTP/1.1" 200 None
2026-03-29 18:46:04 [auto1.de] INFO: Saving data for JR52179: {'auction_closing_time': 1774884063.0, 'created_time': 1774723269.994414, 'last_price_update_time': 1774809964.264211}
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR52179') HTTP/1.1" 204 0
2026-03-29 18:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5ef1ffc-092c-5034-b687-f99265407c08 with identifier: FT59815
2026-03-29 18:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5ef1ffc-092c-5034-b687-f99265407c08 with identifier: FT59815
2026-03-29 18:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5ef1ffc-092c-5034-b687-f99265407c08 with identifier: FT59815 to the API
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:21:40Z',
'fuel_type': 'diesel',
'id': 'b5ef1ffc-092c-5034-b687-f99265407c08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT59815',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 211042,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-11',
'seller_name': None,
'title': 'Audi A4 2.0 TDI Attraction',
'transmission': 'automatic',
'trim': 'Attraction',
'year': 2014}
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT59815%27 HTTP/1.1" 200 None
2026-03-29 18:46:04 [auto1.de] INFO: Saving data for FT59815: {'auction_closing_time': 1774884100.0, 'created_time': 1774034627.764817, 'last_price_update_time': 1774809964.572507}
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT59815') HTTP/1.1" 204 0
2026-03-29 18:46:04 [auto1.de] INFO: Found listing with ID: LD23223
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD23223%27 HTTP/1.1" 200 None
2026-03-29 18:46:04 [auto1.de] INFO: Scrape type for LD23223: 2
2026-03-29 18:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with identifier: LD23223
2026-03-29 18:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with scrape type 2
2026-03-29 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with scrape type 2
2026-03-29 18:46:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27, identifier: LD23223
2026-03-29 18:46:04 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with identifier: LD23223
2026-03-29 18:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with identifier: LD23223
2026-03-29 18:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with identifier: LD23223 to the API
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:35:35Z',
'fuel_type': 'petrol',
'id': 'dbd2ab22-fdc4-50c3-bc3f-24b547e41b27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD23223',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 106954,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-04',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 150 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2007}
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD23223%27 HTTP/1.1" 200 None
2026-03-29 18:46:04 [auto1.de] INFO: Saving data for LD23223: {'auction_closing_time': 1774884935.0, 'created_time': 1774723383.097966, 'last_price_update_time': 1774809964.99141}
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD23223') HTTP/1.1" 204 0
2026-03-29 18:46:05 [auto1.de] INFO: Found listing with ID: LM31898
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM31898%27 HTTP/1.1" 200 None
2026-03-29 18:46:05 [auto1.de] INFO: Scrape type for LM31898: 2
2026-03-29 18:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 425fc81b-d65b-5987-8573-82251aa0380b with identifier: LM31898
2026-03-29 18:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 425fc81b-d65b-5987-8573-82251aa0380b with scrape type 2
2026-03-29 18:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 425fc81b-d65b-5987-8573-82251aa0380b with scrape type 2
2026-03-29 18:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 425fc81b-d65b-5987-8573-82251aa0380b, identifier: LM31898
2026-03-29 18:46:05 [auto1.de] INFO: Found listing with ID: FG48361
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48361%27 HTTP/1.1" 200 None
2026-03-29 18:46:05 [auto1.de] INFO: Scrape type for FG48361: 2
2026-03-29 18:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9625a7c-7e12-5fe1-b859-012458379979 with identifier: FG48361
2026-03-29 18:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9625a7c-7e12-5fe1-b859-012458379979 with scrape type 2
2026-03-29 18:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9625a7c-7e12-5fe1-b859-012458379979 with scrape type 2
2026-03-29 18:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9625a7c-7e12-5fe1-b859-012458379979, identifier: FG48361
2026-03-29 18:46:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 425fc81b-d65b-5987-8573-82251aa0380b with identifier: LM31898
2026-03-29 18:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 425fc81b-d65b-5987-8573-82251aa0380b with identifier: LM31898
2026-03-29 18:46:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 425fc81b-d65b-5987-8573-82251aa0380b with identifier: LM31898 to the API
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:51:14Z',
'fuel_type': 'petrol',
'id': '425fc81b-d65b-5987-8573-82251aa0380b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM31898',
'listing': 'auction',
'make': 'Skoda',
'model': 'Roomster',
'odometer': 235661,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-28',
'seller_name': None,
'title': 'Skoda Roomster 1.6 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2007}
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM31898%27 HTTP/1.1" 200 None
2026-03-29 18:46:05 [auto1.de] INFO: Saving data for LM31898: {'auction_closing_time': 1774885874.0, 'created_time': 1774723284.583523, 'last_price_update_time': 1774809965.492457}
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM31898') HTTP/1.1" 204 0
2026-03-29 18:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9625a7c-7e12-5fe1-b859-012458379979 with identifier: FG48361
2026-03-29 18:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9625a7c-7e12-5fe1-b859-012458379979 with identifier: FG48361
2026-03-29 18:46:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9625a7c-7e12-5fe1-b859-012458379979 with identifier: FG48361 to the API
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:25:11Z',
'fuel_type': 'petrol',
'id': 'b9625a7c-7e12-5fe1-b859-012458379979',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG48361',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 75331,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-15',
'seller_name': None,
'title': 'Seat Alhambra 1.4 TSI FR-Line',
'transmission': 'automatic',
'trim': 'FR-Line',
'year': 2020}
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48361%27 HTTP/1.1" 200 None
2026-03-29 18:46:05 [auto1.de] INFO: Saving data for FG48361: {'auction_closing_time': 1774884311.0, 'created_time': 1774349814.166741, 'last_price_update_time': 1774809965.791862}
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG48361') HTTP/1.1" 204 0
2026-03-29 18:46:05 [auto1.de] INFO: Found listing with ID: HL01555
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01555%27 HTTP/1.1" 200 None
2026-03-29 18:46:05 [auto1.de] INFO: Scrape type for HL01555: 2
2026-03-29 18:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb with identifier: HL01555
2026-03-29 18:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb with scrape type 2
2026-03-29 18:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb with scrape type 2
2026-03-29 18:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb, identifier: HL01555
2026-03-29 18:46:05 [auto1.de] INFO: Found listing with ID: VE13678
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE13678%27 HTTP/1.1" 200 None
2026-03-29 18:46:05 [auto1.de] INFO: Scrape type for VE13678: 2
2026-03-29 18:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d594647c-0e3b-5e23-9586-5da2babfe355 with identifier: VE13678
2026-03-29 18:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d594647c-0e3b-5e23-9586-5da2babfe355 with scrape type 2
2026-03-29 18:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d594647c-0e3b-5e23-9586-5da2babfe355 with scrape type 2
2026-03-29 18:46:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d594647c-0e3b-5e23-9586-5da2babfe355, identifier: VE13678
2026-03-29 18:46:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb with identifier: HL01555
2026-03-29 18:46:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb with identifier: HL01555
2026-03-29 18:46:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb with identifier: HL01555 to the API
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:17:00Z',
'fuel_type': 'diesel',
'id': '6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL01555',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 225949,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-16',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2011}
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01555%27 HTTP/1.1" 200 None
2026-03-29 18:46:06 [auto1.de] INFO: Saving data for HL01555: {'auction_closing_time': 1774883820.0, 'created_time': 1774723366.377894, 'last_price_update_time': 1774809966.326728}
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL01555') HTTP/1.1" 204 0
2026-03-29 18:46:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d594647c-0e3b-5e23-9586-5da2babfe355 with identifier: VE13678
2026-03-29 18:46:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d594647c-0e3b-5e23-9586-5da2babfe355 with identifier: VE13678
2026-03-29 18:46:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d594647c-0e3b-5e23-9586-5da2babfe355 with identifier: VE13678 to the API
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:28:56Z',
'fuel_type': 'petrol',
'id': 'd594647c-0e3b-5e23-9586-5da2babfe355',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE13678',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 124567,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-20',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2015}
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE13678%27 HTTP/1.1" 200 None
2026-03-29 18:46:06 [auto1.de] INFO: Saving data for VE13678: {'auction_closing_time': 1774884536.0, 'created_time': 1774723343.749159, 'last_price_update_time': 1774809966.629254}
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE13678') HTTP/1.1" 204 0
2026-03-29 18:46:06 [auto1.de] INFO: Found listing with ID: WJ67055
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67055%27 HTTP/1.1" 200 None
2026-03-29 18:46:06 [auto1.de] INFO: Scrape type for WJ67055: 2
2026-03-29 18:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9267e4cd-1859-50b4-9544-4eabf4720173 with identifier: WJ67055
2026-03-29 18:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9267e4cd-1859-50b4-9544-4eabf4720173 with scrape type 2
2026-03-29 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9267e4cd-1859-50b4-9544-4eabf4720173 with scrape type 2
2026-03-29 18:46:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9267e4cd-1859-50b4-9544-4eabf4720173, identifier: WJ67055
2026-03-29 18:46:06 [auto1.de] INFO: Found listing with ID: XX85358
2026-03-29 18:46:06 [auto1.de] INFO: Found listing with ID: WM91088
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91088%27 HTTP/1.1" 200 None
2026-03-29 18:46:06 [auto1.de] INFO: Scrape type for WM91088: 2
2026-03-29 18:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30adee3e-41aa-5875-9124-ac6d07a4cf1c with identifier: WM91088
2026-03-29 18:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30adee3e-41aa-5875-9124-ac6d07a4cf1c with scrape type 2
2026-03-29 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30adee3e-41aa-5875-9124-ac6d07a4cf1c with scrape type 2
2026-03-29 18:46:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30adee3e-41aa-5875-9124-ac6d07a4cf1c, identifier: WM91088
2026-03-29 18:46:06 [scrapy.extensions.logstats] INFO: Crawled 164 pages (at 6 pages/min), scraped 1520 items (at 133 items/min)
2026-03-29 18:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-29 18:46:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9267e4cd-1859-50b4-9544-4eabf4720173 with identifier: WJ67055
2026-03-29 18:46:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9267e4cd-1859-50b4-9544-4eabf4720173 with identifier: WJ67055
2026-03-29 18:46:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9267e4cd-1859-50b4-9544-4eabf4720173 with identifier: WJ67055 to the API
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 334,
'expiration_date': '2026-03-30T15:36:47Z',
'fuel_type': 'petrol',
'id': '9267e4cd-1859-50b4-9544-4eabf4720173',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ67055',
'listing': 'auction',
'make': 'Ford',
'model': 'Bronco',
'odometer': 74045,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-20',
'seller_name': None,
'title': 'Ford Bronco 2.7 EcoBoost Outer Banks 4x4',
'transmission': 'automatic',
'trim': 'Outer Banks 4x4',
'year': 2022}
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67055%27 HTTP/1.1" 200 None
2026-03-29 18:46:07 [auto1.de] INFO: Saving data for WJ67055: {'auction_closing_time': 1774885007.0, 'created_time': 1774723291.939712, 'last_price_update_time': 1774809967.146104}
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ67055') HTTP/1.1" 204 0
2026-03-29 18:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30adee3e-41aa-5875-9124-ac6d07a4cf1c with identifier: WM91088
2026-03-29 18:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30adee3e-41aa-5875-9124-ac6d07a4cf1c with identifier: WM91088
2026-03-29 18:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30adee3e-41aa-5875-9124-ac6d07a4cf1c with identifier: WM91088 to the API
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:22:43Z',
'fuel_type': 'diesel',
'id': '30adee3e-41aa-5875-9124-ac6d07a4cf1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM91088',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Kombi',
'odometer': 354472,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-24',
'seller_name': None,
'title': 'Volkswagen T6 Kombi 2.0 TDI 4Motion',
'transmission': 'manual',
'trim': '4Motion',
'year': 2018}
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91088%27 HTTP/1.1" 200 None
2026-03-29 18:46:07 [auto1.de] INFO: Saving data for WM91088: {'auction_closing_time': 1774884163.0, 'created_time': 1773467064.317962, 'last_price_update_time': 1774809967.534274}
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM91088') HTTP/1.1" 204 0
2026-03-29 18:46:07 [auto1.de] INFO: Found listing with ID: EJ09183
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ09183%27 HTTP/1.1" 200 None
2026-03-29 18:46:07 [auto1.de] INFO: Scrape type for EJ09183: 2
2026-03-29 18:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cef2007-155b-5ccf-a578-5b1b8bf9911f with identifier: EJ09183
2026-03-29 18:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cef2007-155b-5ccf-a578-5b1b8bf9911f with scrape type 2
2026-03-29 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cef2007-155b-5ccf-a578-5b1b8bf9911f with scrape type 2
2026-03-29 18:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cef2007-155b-5ccf-a578-5b1b8bf9911f, identifier: EJ09183
2026-03-29 18:46:07 [auto1.de] INFO: Found listing with ID: NY40403
2026-03-29 18:46:07 [auto1.de] INFO: Found listing with ID: JY99626
2026-03-29 18:46:07 [auto1.de] INFO: Found listing with ID: CG06120
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG06120%27 HTTP/1.1" 200 None
2026-03-29 18:46:07 [auto1.de] INFO: Scrape type for CG06120: 2
2026-03-29 18:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27a16512-56e5-5c1c-8e95-8f1f22e3b235 with identifier: CG06120
2026-03-29 18:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27a16512-56e5-5c1c-8e95-8f1f22e3b235 with scrape type 2
2026-03-29 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27a16512-56e5-5c1c-8e95-8f1f22e3b235 with scrape type 2
2026-03-29 18:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27a16512-56e5-5c1c-8e95-8f1f22e3b235, identifier: CG06120
2026-03-29 18:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cef2007-155b-5ccf-a578-5b1b8bf9911f with identifier: EJ09183
2026-03-29 18:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cef2007-155b-5ccf-a578-5b1b8bf9911f with identifier: EJ09183
2026-03-29 18:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cef2007-155b-5ccf-a578-5b1b8bf9911f with identifier: EJ09183 to the API
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:14:00Z',
'fuel_type': 'petrol',
'id': '1cef2007-155b-5ccf-a578-5b1b8bf9911f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ09183',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Alto',
'odometer': 136442,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-11',
'seller_name': None,
'title': 'Suzuki Alto 1.0 Club',
'transmission': 'manual',
'trim': 'Club',
'year': 2012}
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ09183%27 HTTP/1.1" 200 None
2026-03-29 18:46:08 [auto1.de] INFO: Saving data for EJ09183: {'auction_closing_time': 1774883640.0, 'created_time': 1773399540.483594, 'last_price_update_time': 1774809968.086261}
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ09183') HTTP/1.1" 204 0
2026-03-29 18:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27a16512-56e5-5c1c-8e95-8f1f22e3b235 with identifier: CG06120
2026-03-29 18:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27a16512-56e5-5c1c-8e95-8f1f22e3b235 with identifier: CG06120
2026-03-29 18:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27a16512-56e5-5c1c-8e95-8f1f22e3b235 with identifier: CG06120 to the API
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:16:21Z',
'fuel_type': 'petrol',
'id': '27a16512-56e5-5c1c-8e95-8f1f22e3b235',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG06120',
'listing': 'auction',
'make': 'Kia',
'model': 'Venga',
'odometer': 123564,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-26',
'seller_name': None,
'title': 'Kia Venga 1.4 Dream Team',
'transmission': 'manual',
'trim': 'Dream Team',
'year': 2015}
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG06120%27 HTTP/1.1" 200 None
2026-03-29 18:46:08 [auto1.de] INFO: Saving data for CG06120: {'auction_closing_time': 1774883781.0, 'created_time': 1774723271.922884, 'last_price_update_time': 1774809968.380776}
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG06120') HTTP/1.1" 204 0
2026-03-29 18:46:08 [auto1.de] INFO: Found listing with ID: TM08126
2026-03-29 18:46:08 [auto1.de] INFO: Found listing with ID: GZ17275
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ17275%27 HTTP/1.1" 200 None
2026-03-29 18:46:08 [auto1.de] INFO: Scrape type for GZ17275: 2
2026-03-29 18:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d with identifier: GZ17275
2026-03-29 18:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d with scrape type 2
2026-03-29 18:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d with scrape type 2
2026-03-29 18:46:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d, identifier: GZ17275
2026-03-29 18:46:08 [auto1.de] INFO: Found listing with ID: XX47236
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX47236%27 HTTP/1.1" 200 None
2026-03-29 18:46:08 [auto1.de] INFO: Scrape type for XX47236: 2
2026-03-29 18:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d464d16e-6736-5899-90fc-5887905f8eb0 with identifier: XX47236
2026-03-29 18:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d464d16e-6736-5899-90fc-5887905f8eb0 with scrape type 2
2026-03-29 18:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d464d16e-6736-5899-90fc-5887905f8eb0 with scrape type 2
2026-03-29 18:46:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d464d16e-6736-5899-90fc-5887905f8eb0, identifier: XX47236
2026-03-29 18:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d with identifier: GZ17275
2026-03-29 18:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d with identifier: GZ17275
2026-03-29 18:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d with identifier: GZ17275 to the API
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:48:52Z',
'fuel_type': 'petrol',
'id': '4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ17275',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 197053,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-28',
'seller_name': None,
'title': 'Ford Focus 1.6 Style+',
'transmission': 'manual',
'trim': 'Style+',
'year': 2010}
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ17275%27 HTTP/1.1" 200 None
2026-03-29 18:46:08 [auto1.de] INFO: Saving data for GZ17275: {'auction_closing_time': 1774885732.0, 'created_time': 1774723380.012788, 'last_price_update_time': 1774809968.893838}
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ17275') HTTP/1.1" 204 0
2026-03-29 18:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d464d16e-6736-5899-90fc-5887905f8eb0 with identifier: XX47236
2026-03-29 18:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d464d16e-6736-5899-90fc-5887905f8eb0 with identifier: XX47236
2026-03-29 18:46:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d464d16e-6736-5899-90fc-5887905f8eb0 with identifier: XX47236 to the API
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:15:33Z',
'fuel_type': 'petrol',
'id': 'd464d16e-6736-5899-90fc-5887905f8eb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX47236',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 332109,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-02-23',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
'transmission': 'manual',
'trim': '',
'year': 2003}
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX47236%27 HTTP/1.1" 200 None
2026-03-29 18:46:09 [auto1.de] INFO: Saving data for XX47236: {'auction_closing_time': 1774883733.0, 'created_time': 1774723301.994677, 'last_price_update_time': 1774809969.186036}
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX47236') HTTP/1.1" 204 0
2026-03-29 18:46:09 [auto1.de] INFO: Found listing with ID: JG89144
2026-03-29 18:46:09 [auto1.de] INFO: Found listing with ID: GY04691
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY04691%27 HTTP/1.1" 200 None
2026-03-29 18:46:09 [auto1.de] INFO: Scrape type for GY04691: 2
2026-03-29 18:46:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aa66a7a-519a-511f-8617-b343f7e246f8 with identifier: GY04691
2026-03-29 18:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aa66a7a-519a-511f-8617-b343f7e246f8 with scrape type 2
2026-03-29 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aa66a7a-519a-511f-8617-b343f7e246f8 with scrape type 2
2026-03-29 18:46:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4aa66a7a-519a-511f-8617-b343f7e246f8, identifier: GY04691
2026-03-29 18:46:09 [auto1.de] INFO: Found listing with ID: MA20139
2026-03-29 18:46:09 [auto1.de] INFO: Found listing with ID: GK17224
2026-03-29 18:46:09 [auto1.de] INFO: Found listing with ID: AY24824
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY24824%27 HTTP/1.1" 200 None
2026-03-29 18:46:09 [auto1.de] INFO: Scrape type for AY24824: 2
2026-03-29 18:46:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df7eea43-18f8-5087-98a1-ace523b77072 with identifier: AY24824
2026-03-29 18:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df7eea43-18f8-5087-98a1-ace523b77072 with scrape type 2
2026-03-29 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df7eea43-18f8-5087-98a1-ace523b77072 with scrape type 2
2026-03-29 18:46:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df7eea43-18f8-5087-98a1-ace523b77072, identifier: AY24824
2026-03-29 18:46:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4aa66a7a-519a-511f-8617-b343f7e246f8 with identifier: GY04691
2026-03-29 18:46:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4aa66a7a-519a-511f-8617-b343f7e246f8 with identifier: GY04691
2026-03-29 18:46:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4aa66a7a-519a-511f-8617-b343f7e246f8 with identifier: GY04691 to the API
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:51:48Z',
'fuel_type': 'diesel',
'id': '4aa66a7a-519a-511f-8617-b343f7e246f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY04691',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 232017,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-07',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Match BlueMotion',
'transmission': 'automatic',
'trim': 'Match BlueMotion',
'year': 2012}
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY04691%27 HTTP/1.1" 200 None
2026-03-29 18:46:09 [auto1.de] INFO: Saving data for GY04691: {'auction_closing_time': 1774885908.0, 'created_time': 1774349634.120146, 'last_price_update_time': 1774809969.726203}
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY04691') HTTP/1.1" 204 0
2026-03-29 18:46:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df7eea43-18f8-5087-98a1-ace523b77072 with identifier: AY24824
2026-03-29 18:46:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df7eea43-18f8-5087-98a1-ace523b77072 with identifier: AY24824
2026-03-29 18:46:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df7eea43-18f8-5087-98a1-ace523b77072 with identifier: AY24824 to the API
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:16:27Z',
'fuel_type': 'diesel',
'id': 'df7eea43-18f8-5087-98a1-ace523b77072',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY24824',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 41095,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-11',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Highline BlueMotion Tech',
'year': 2022}
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY24824%27 HTTP/1.1" 200 None
2026-03-29 18:46:10 [auto1.de] INFO: Saving data for AY24824: {'auction_closing_time': 1774883787.0, 'created_time': 1774723272.916644, 'last_price_update_time': 1774809970.13594}
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY24824') HTTP/1.1" 204 0
2026-03-29 18:46:10 [auto1.de] INFO: Found listing with ID: WD20973
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD20973%27 HTTP/1.1" 200 None
2026-03-29 18:46:10 [auto1.de] INFO: Scrape type for WD20973: 2
2026-03-29 18:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7297c39-e463-5d69-b5bc-bb886a43bfbe with identifier: WD20973
2026-03-29 18:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7297c39-e463-5d69-b5bc-bb886a43bfbe with scrape type 2
2026-03-29 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7297c39-e463-5d69-b5bc-bb886a43bfbe with scrape type 2
2026-03-29 18:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7297c39-e463-5d69-b5bc-bb886a43bfbe, identifier: WD20973
2026-03-29 18:46:10 [auto1.de] INFO: Found listing with ID: CE16613
2026-03-29 18:46:10 [auto1.de] INFO: Found listing with ID: AK16963
2026-03-29 18:46:10 [auto1.de] INFO: Found listing with ID: PG11291
2026-03-29 18:46:10 [auto1.de] INFO: Found listing with ID: HE64708
2026-03-29 18:46:10 [auto1.de] INFO: Found listing with ID: ZK51432
2026-03-29 18:46:10 [auto1.de] INFO: Found listing with ID: JR48888
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR48888%27 HTTP/1.1" 200 None
2026-03-29 18:46:10 [auto1.de] INFO: Scrape type for JR48888: 2
2026-03-29 18:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fed6deb-8583-5ab0-8553-27c469d4d974 with identifier: JR48888
2026-03-29 18:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fed6deb-8583-5ab0-8553-27c469d4d974 with scrape type 2
2026-03-29 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fed6deb-8583-5ab0-8553-27c469d4d974 with scrape type 2
2026-03-29 18:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fed6deb-8583-5ab0-8553-27c469d4d974, identifier: JR48888
2026-03-29 18:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7297c39-e463-5d69-b5bc-bb886a43bfbe with identifier: WD20973
2026-03-29 18:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7297c39-e463-5d69-b5bc-bb886a43bfbe with identifier: WD20973
2026-03-29 18:46:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7297c39-e463-5d69-b5bc-bb886a43bfbe with identifier: WD20973 to the API
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:26:16Z',
'fuel_type': 'petrol',
'id': 'c7297c39-e463-5d69-b5bc-bb886a43bfbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD20973',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 141810,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-23',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2013}
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD20973%27 HTTP/1.1" 200 None
2026-03-29 18:46:10 [auto1.de] INFO: Saving data for WD20973: {'auction_closing_time': 1774884376.0, 'created_time': 1774089318.523952, 'last_price_update_time': 1774809970.68243}
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD20973') HTTP/1.1" 204 0
2026-03-29 18:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fed6deb-8583-5ab0-8553-27c469d4d974 with identifier: JR48888
2026-03-29 18:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fed6deb-8583-5ab0-8553-27c469d4d974 with identifier: JR48888
2026-03-29 18:46:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fed6deb-8583-5ab0-8553-27c469d4d974 with identifier: JR48888 to the API
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:46:33Z',
'fuel_type': 'petrol',
'id': '1fed6deb-8583-5ab0-8553-27c469d4d974',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR48888',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 98341,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-29',
'seller_name': None,
'title': 'Renault Captur 0.9 Energy Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2015}
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR48888%27 HTTP/1.1" 200 None
2026-03-29 18:46:11 [auto1.de] INFO: Saving data for JR48888: {'auction_closing_time': 1774885593.0, 'created_time': 1773428009.491623, 'last_price_update_time': 1774809971.009221}
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR48888') HTTP/1.1" 204 0
2026-03-29 18:46:11 [auto1.de] INFO: Found listing with ID: RN07993
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN07993%27 HTTP/1.1" 200 None
2026-03-29 18:46:11 [auto1.de] INFO: Scrape type for RN07993: 2
2026-03-29 18:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8042c6c-14c5-53cf-b99b-24640a085134 with identifier: RN07993
2026-03-29 18:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8042c6c-14c5-53cf-b99b-24640a085134 with scrape type 2
2026-03-29 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8042c6c-14c5-53cf-b99b-24640a085134 with scrape type 2
2026-03-29 18:46:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8042c6c-14c5-53cf-b99b-24640a085134, identifier: RN07993
2026-03-29 18:46:11 [auto1.de] INFO: Found listing with ID: JU28029
2026-03-29 18:46:11 [auto1.de] INFO: Found listing with ID: WX17645
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX17645%27 HTTP/1.1" 200 None
2026-03-29 18:46:11 [auto1.de] INFO: Scrape type for WX17645: 2
2026-03-29 18:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9acdd69d-6d7e-5b5b-a082-be29a8806632 with identifier: WX17645
2026-03-29 18:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9acdd69d-6d7e-5b5b-a082-be29a8806632 with scrape type 2
2026-03-29 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9acdd69d-6d7e-5b5b-a082-be29a8806632 with scrape type 2
2026-03-29 18:46:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9acdd69d-6d7e-5b5b-a082-be29a8806632, identifier: WX17645
2026-03-29 18:46:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8042c6c-14c5-53cf-b99b-24640a085134 with identifier: RN07993
2026-03-29 18:46:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8042c6c-14c5-53cf-b99b-24640a085134 with identifier: RN07993
2026-03-29 18:46:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8042c6c-14c5-53cf-b99b-24640a085134 with identifier: RN07993 to the API
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:17:42Z',
'fuel_type': 'petrol',
'id': 'e8042c6c-14c5-53cf-b99b-24640a085134',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN07993',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 130976,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-30',
'seller_name': None,
'title': 'Suzuki Swift 1.2 X-TRA',
'transmission': 'manual',
'trim': 'X-TRA',
'year': 2017}
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN07993%27 HTTP/1.1" 200 None
2026-03-29 18:46:11 [auto1.de] INFO: Saving data for RN07993: {'auction_closing_time': 1774883862.0, 'created_time': 1774723395.758094, 'last_price_update_time': 1774809971.536831}
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN07993') HTTP/1.1" 204 0
2026-03-29 18:46:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9acdd69d-6d7e-5b5b-a082-be29a8806632 with identifier: WX17645
2026-03-29 18:46:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9acdd69d-6d7e-5b5b-a082-be29a8806632 with identifier: WX17645
2026-03-29 18:46:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9acdd69d-6d7e-5b5b-a082-be29a8806632 with identifier: WX17645 to the API
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:14:20Z',
'fuel_type': 'petrol',
'id': '9acdd69d-6d7e-5b5b-a082-be29a8806632',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX17645',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 116988,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-03-15',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 240 Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2005}
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX17645%27 HTTP/1.1" 200 None
2026-03-29 18:46:11 [auto1.de] INFO: Saving data for WX17645: {'auction_closing_time': 1774883660.0, 'created_time': 1774723288.026362, 'last_price_update_time': 1774809971.818326}
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX17645') HTTP/1.1" 204 0
2026-03-29 18:46:11 [auto1.de] INFO: Found listing with ID: NT23997
2026-03-29 18:46:11 [auto1.de] INFO: Found listing with ID: EC99072
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC99072%27 HTTP/1.1" 200 None
2026-03-29 18:46:11 [auto1.de] INFO: Scrape type for EC99072: 2
2026-03-29 18:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e0ed29c-ae28-5c5a-ae48-134d3116a8c5 with identifier: EC99072
2026-03-29 18:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e0ed29c-ae28-5c5a-ae48-134d3116a8c5 with scrape type 2
2026-03-29 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e0ed29c-ae28-5c5a-ae48-134d3116a8c5 with scrape type 2
2026-03-29 18:46:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e0ed29c-ae28-5c5a-ae48-134d3116a8c5, identifier: EC99072
2026-03-29 18:46:11 [auto1.de] INFO: Found listing with ID: BE75867
2026-03-29 18:46:11 [auto1.de] INFO: Found listing with ID: FP27721
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27721%27 HTTP/1.1" 200 None
2026-03-29 18:46:11 [auto1.de] INFO: Scrape type for FP27721: 2
2026-03-29 18:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bdd271b-1515-5276-a79e-9cd510776cd5 with identifier: FP27721
2026-03-29 18:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bdd271b-1515-5276-a79e-9cd510776cd5 with scrape type 2
2026-03-29 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bdd271b-1515-5276-a79e-9cd510776cd5 with scrape type 2
2026-03-29 18:46:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bdd271b-1515-5276-a79e-9cd510776cd5, identifier: FP27721
2026-03-29 18:46:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e0ed29c-ae28-5c5a-ae48-134d3116a8c5 with identifier: EC99072
2026-03-29 18:46:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e0ed29c-ae28-5c5a-ae48-134d3116a8c5 with identifier: EC99072
2026-03-29 18:46:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e0ed29c-ae28-5c5a-ae48-134d3116a8c5 with identifier: EC99072 to the API
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:36Z',
'fuel_type': 'petrol',
'id': '8e0ed29c-ae28-5c5a-ae48-134d3116a8c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC99072',
'listing': 'auction',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 68380,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-11',
'seller_name': None,
'title': 'Skoda Karoq 1.5 TSI ACT Clever',
'transmission': 'automatic',
'trim': 'Clever',
'year': 2022}
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC99072%27 HTTP/1.1" 200 None
2026-03-29 18:46:12 [auto1.de] INFO: Saving data for EC99072: {'auction_closing_time': 1774883016.0, 'created_time': 1774034492.231169, 'last_price_update_time': 1774809972.335829}
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC99072') HTTP/1.1" 204 0
2026-03-29 18:46:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bdd271b-1515-5276-a79e-9cd510776cd5 with identifier: FP27721
2026-03-29 18:46:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bdd271b-1515-5276-a79e-9cd510776cd5 with identifier: FP27721
2026-03-29 18:46:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bdd271b-1515-5276-a79e-9cd510776cd5 with identifier: FP27721 to the API
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:57:58Z',
'fuel_type': 'petrol',
'id': '8bdd271b-1515-5276-a79e-9cd510776cd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP27721',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 135213,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-07',
'seller_name': None,
'title': 'Jeep Compass 2.0 Sport 4x2',
'transmission': 'manual',
'trim': 'Sport 4x2',
'year': 2013}
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27721%27 HTTP/1.1" 200 None
2026-03-29 18:46:12 [auto1.de] INFO: Saving data for FP27721: {'auction_closing_time': 1774886278.0, 'created_time': 1774349711.497326, 'last_price_update_time': 1774809972.748754}
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP27721') HTTP/1.1" 204 0
2026-03-29 18:46:12 [auto1.de] INFO: Found listing with ID: EN09392
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN09392%27 HTTP/1.1" 200 None
2026-03-29 18:46:12 [auto1.de] INFO: Scrape type for EN09392: 2
2026-03-29 18:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9a2a92d-6904-56f2-bcfa-5fdb7ca08947 with identifier: EN09392
2026-03-29 18:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a2a92d-6904-56f2-bcfa-5fdb7ca08947 with scrape type 2
2026-03-29 18:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9a2a92d-6904-56f2-bcfa-5fdb7ca08947 with scrape type 2
2026-03-29 18:46:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9a2a92d-6904-56f2-bcfa-5fdb7ca08947, identifier: EN09392
2026-03-29 18:46:12 [auto1.de] INFO: Found listing with ID: KV56642
2026-03-29 18:46:12 [auto1.de] INFO: Found listing with ID: KC60426
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC60426%27 HTTP/1.1" 200 None
2026-03-29 18:46:12 [auto1.de] INFO: Scrape type for KC60426: 2
2026-03-29 18:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 983e7f23-9f5a-57ca-a7b3-8b518a2a6026 with identifier: KC60426
2026-03-29 18:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026 with scrape type 2
2026-03-29 18:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026 with scrape type 2
2026-03-29 18:46:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 983e7f23-9f5a-57ca-a7b3-8b518a2a6026, identifier: KC60426
2026-03-29 18:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9a2a92d-6904-56f2-bcfa-5fdb7ca08947 with identifier: EN09392
2026-03-29 18:46:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9a2a92d-6904-56f2-bcfa-5fdb7ca08947 with identifier: EN09392
2026-03-29 18:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9a2a92d-6904-56f2-bcfa-5fdb7ca08947 with identifier: EN09392 to the API
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:41:06Z',
'fuel_type': 'petrol',
'id': 'd9a2a92d-6904-56f2-bcfa-5fdb7ca08947',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN09392',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLK-Klasse',
'odometer': 249309,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-10-31',
'seller_name': None,
'title': 'Mercedes-Benz CLK-Klasse CLK 200 Kompressor Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 2004}
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN09392%27 HTTP/1.1" 200 None
2026-03-29 18:46:13 [auto1.de] INFO: Saving data for EN09392: {'auction_closing_time': 1774885266.0, 'created_time': 1774723385.282832, 'last_price_update_time': 1774809973.255636}
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN09392') HTTP/1.1" 204 0
2026-03-29 18:46:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 983e7f23-9f5a-57ca-a7b3-8b518a2a6026 with identifier: KC60426
2026-03-29 18:46:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 983e7f23-9f5a-57ca-a7b3-8b518a2a6026 with identifier: KC60426
2026-03-29 18:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 983e7f23-9f5a-57ca-a7b3-8b518a2a6026 with identifier: KC60426 to the API
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:03:22Z',
'fuel_type': 'petrol',
'id': '983e7f23-9f5a-57ca-a7b3-8b518a2a6026',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC60426',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 51767,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-28',
'seller_name': None,
'title': 'Mazda 3 2.0 Skyactiv-G Mild-Hybrid Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2022}
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC60426%27 HTTP/1.1" 200 None
2026-03-29 18:46:13 [auto1.de] INFO: Saving data for KC60426: {'auction_closing_time': 1774883002.0, 'created_time': 1774723361.634639, 'last_price_update_time': 1774809973.542507}
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC60426') HTTP/1.1" 204 0
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: DT06996
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT06996%27 HTTP/1.1" 200 None
2026-03-29 18:46:13 [auto1.de] INFO: Scrape type for DT06996: 2
2026-03-29 18:46:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a18af995-1367-5cd1-8126-b25ff08bf268 with identifier: DT06996
2026-03-29 18:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a18af995-1367-5cd1-8126-b25ff08bf268 with scrape type 2
2026-03-29 18:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a18af995-1367-5cd1-8126-b25ff08bf268 with scrape type 2
2026-03-29 18:46:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a18af995-1367-5cd1-8126-b25ff08bf268, identifier: DT06996
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: ZU41188
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: VD40849
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: EL78604
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL78604%27 HTTP/1.1" 200 None
2026-03-29 18:46:13 [auto1.de] INFO: Scrape type for EL78604: 2
2026-03-29 18:46:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5 with identifier: EL78604
2026-03-29 18:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5 with scrape type 2
2026-03-29 18:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5 with scrape type 2
2026-03-29 18:46:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5, identifier: EL78604
2026-03-29 18:46:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a18af995-1367-5cd1-8126-b25ff08bf268 with identifier: DT06996
2026-03-29 18:46:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a18af995-1367-5cd1-8126-b25ff08bf268 with identifier: DT06996
2026-03-29 18:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a18af995-1367-5cd1-8126-b25ff08bf268 with identifier: DT06996 to the API
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:24:10Z',
'fuel_type': 'petrol',
'id': 'a18af995-1367-5cd1-8126-b25ff08bf268',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT06996',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 202259,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-09',
'seller_name': None,
'title': 'Hyundai ix35 1.6 Comfort 2WD',
'transmission': 'manual',
'trim': 'Comfort 2WD',
'year': 2013}
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT06996%27 HTTP/1.1" 200 None
2026-03-29 18:46:14 [auto1.de] INFO: Saving data for DT06996: {'auction_closing_time': 1774884250.0, 'created_time': 1774723387.219365, 'last_price_update_time': 1774809974.066929}
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT06996') HTTP/1.1" 204 0
2026-03-29 18:46:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5 with identifier: EL78604
2026-03-29 18:46:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5 with identifier: EL78604
2026-03-29 18:46:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5 with identifier: EL78604 to the API
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:40:48Z',
'fuel_type': 'petrol',
'id': 'c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL78604',
'listing': 'auction',
'make': 'Kia',
'model': 'Rio',
'odometer': 28444,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-01',
'seller_name': None,
'title': 'Kia Rio 1.2 Edition 7',
'transmission': 'manual',
'trim': 'Edition 7',
'year': 2016}
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL78604%27 HTTP/1.1" 200 None
2026-03-29 18:46:14 [auto1.de] INFO: Saving data for EL78604: {'auction_closing_time': 1774885248.0, 'created_time': 1774723287.253133, 'last_price_update_time': 1774809974.358687}
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL78604') HTTP/1.1" 204 0
2026-03-29 18:46:14 [auto1.de] INFO: Found listing with ID: LX07481
2026-03-29 18:46:14 [auto1.de] INFO: Found listing with ID: DK35136
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK35136%27 HTTP/1.1" 200 None
2026-03-29 18:46:14 [auto1.de] INFO: Scrape type for DK35136: 2
2026-03-29 18:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0bc06f2-a1a6-5e04-823d-968e475c7f9a with identifier: DK35136
2026-03-29 18:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0bc06f2-a1a6-5e04-823d-968e475c7f9a with scrape type 2
2026-03-29 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0bc06f2-a1a6-5e04-823d-968e475c7f9a with scrape type 2
2026-03-29 18:46:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0bc06f2-a1a6-5e04-823d-968e475c7f9a, identifier: DK35136
2026-03-29 18:46:14 [auto1.de] INFO: Found listing with ID: ZA94641
2026-03-29 18:46:14 [auto1.de] INFO: Found listing with ID: YL33228
2026-03-29 18:46:14 [auto1.de] INFO: Found listing with ID: XU87047
2026-03-29 18:46:14 [auto1.de] INFO: Found listing with ID: KP52427
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP52427%27 HTTP/1.1" 200 None
2026-03-29 18:46:14 [auto1.de] INFO: Scrape type for KP52427: 2
2026-03-29 18:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a with identifier: KP52427
2026-03-29 18:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a with scrape type 2
2026-03-29 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a with scrape type 2
2026-03-29 18:46:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a, identifier: KP52427
2026-03-29 18:46:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0bc06f2-a1a6-5e04-823d-968e475c7f9a with identifier: DK35136
2026-03-29 18:46:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0bc06f2-a1a6-5e04-823d-968e475c7f9a with identifier: DK35136
2026-03-29 18:46:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0bc06f2-a1a6-5e04-823d-968e475c7f9a with identifier: DK35136 to the API
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:28:48Z',
'fuel_type': 'diesel',
'id': 'f0bc06f2-a1a6-5e04-823d-968e475c7f9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK35136',
'listing': 'auction',
'make': 'Kia',
'model': "pro_cee'd",
'odometer': 144228,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-06',
'seller_name': None,
'title': "Kia pro_cee'd 1.6 CRDi GT Line",
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2020}
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK35136%27 HTTP/1.1" 200 None
2026-03-29 18:46:14 [auto1.de] INFO: Saving data for DK35136: {'auction_closing_time': 1774884528.0, 'created_time': 1774033797.310434, 'last_price_update_time': 1774809974.876935}
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK35136') HTTP/1.1" 204 0
2026-03-29 18:46:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a with identifier: KP52427
2026-03-29 18:46:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a with identifier: KP52427
2026-03-29 18:46:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a with identifier: KP52427 to the API
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:02:27Z',
'fuel_type': 'petrol',
'id': 'b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP52427',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 141501,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-04',
'seller_name': None,
'title': 'Volkswagen Touran 1.4 TSI Comfortline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion Tech',
'year': 2017}
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP52427%27 HTTP/1.1" 200 None
2026-03-29 18:46:15 [auto1.de] INFO: Saving data for KP52427: {'auction_closing_time': 1774882947.0, 'created_time': 1774032859.680985, 'last_price_update_time': 1774809975.267955}
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP52427') HTTP/1.1" 204 0
2026-03-29 18:46:15 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:15 [auto1.de] INFO: Found listing with ID: WJ60429
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ60429%27 HTTP/1.1" 200 None
2026-03-29 18:46:15 [auto1.de] INFO: Scrape type for WJ60429: 2
2026-03-29 18:46:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c073683-26a7-5db9-ae59-5d7f2759724b with identifier: WJ60429
2026-03-29 18:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c073683-26a7-5db9-ae59-5d7f2759724b with scrape type 2
2026-03-29 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c073683-26a7-5db9-ae59-5d7f2759724b with scrape type 2
2026-03-29 18:46:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c073683-26a7-5db9-ae59-5d7f2759724b, identifier: WJ60429
2026-03-29 18:46:15 [auto1.de] INFO: Found listing with ID: GW71090
2026-03-29 18:46:15 [auto1.de] INFO: Found listing with ID: UZ60031
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ60031%27 HTTP/1.1" 200 None
2026-03-29 18:46:15 [auto1.de] INFO: Scrape type for UZ60031: 2
2026-03-29 18:46:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0414232b-43c2-550a-9bd2-d4591d9f2121 with identifier: UZ60031
2026-03-29 18:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0414232b-43c2-550a-9bd2-d4591d9f2121 with scrape type 2
2026-03-29 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0414232b-43c2-550a-9bd2-d4591d9f2121 with scrape type 2
2026-03-29 18:46:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0414232b-43c2-550a-9bd2-d4591d9f2121, identifier: UZ60031
2026-03-29 18:46:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c073683-26a7-5db9-ae59-5d7f2759724b with identifier: WJ60429
2026-03-29 18:46:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c073683-26a7-5db9-ae59-5d7f2759724b with identifier: WJ60429
2026-03-29 18:46:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c073683-26a7-5db9-ae59-5d7f2759724b with identifier: WJ60429 to the API
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:17:06Z',
'fuel_type': 'diesel',
'id': '8c073683-26a7-5db9-ae59-5d7f2759724b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ60429',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 54020,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-11',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Laurin & Klement 4x4',
'transmission': 'automatic',
'trim': 'Laurin & Klement 4x4',
'year': 2019}
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ60429%27 HTTP/1.1" 200 None
2026-03-29 18:46:15 [auto1.de] INFO: Saving data for WJ60429: {'auction_closing_time': 1774883826.0, 'created_time': 1774723283.807505, 'last_price_update_time': 1774809975.8026}
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ60429') HTTP/1.1" 204 0
2026-03-29 18:46:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0414232b-43c2-550a-9bd2-d4591d9f2121 with identifier: UZ60031
2026-03-29 18:46:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0414232b-43c2-550a-9bd2-d4591d9f2121 with identifier: UZ60031
2026-03-29 18:46:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0414232b-43c2-550a-9bd2-d4591d9f2121 with identifier: UZ60031 to the API
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:04:36Z',
'fuel_type': 'petrol',
'id': '0414232b-43c2-550a-9bd2-d4591d9f2121',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ60031',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 142815,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-19',
'seller_name': None,
'title': 'Seat Leon 1.4 Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2009}
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ60031%27 HTTP/1.1" 200 None
2026-03-29 18:46:16 [auto1.de] INFO: Saving data for UZ60031: {'auction_closing_time': 1774883076.0, 'created_time': 1774723300.786294, 'last_price_update_time': 1774809976.132426}
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ60031') HTTP/1.1" 204 0
2026-03-29 18:46:16 [auto1.de] INFO: Found listing with ID: XT42092
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42092%27 HTTP/1.1" 200 None
2026-03-29 18:46:16 [auto1.de] INFO: Scrape type for XT42092: 2
2026-03-29 18:46:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d2803ca-911b-5581-9411-59cbdfc1346b with identifier: XT42092
2026-03-29 18:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d2803ca-911b-5581-9411-59cbdfc1346b with scrape type 2
2026-03-29 18:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d2803ca-911b-5581-9411-59cbdfc1346b with scrape type 2
2026-03-29 18:46:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d2803ca-911b-5581-9411-59cbdfc1346b, identifier: XT42092
2026-03-29 18:46:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:16 [auto1.de] INFO: Found listing with ID: RX22328
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX22328%27 HTTP/1.1" 200 None
2026-03-29 18:46:16 [auto1.de] INFO: Scrape type for RX22328: 2
2026-03-29 18:46:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43b09e42-afec-5653-a101-b286949b5a95 with identifier: RX22328
2026-03-29 18:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43b09e42-afec-5653-a101-b286949b5a95 with scrape type 2
2026-03-29 18:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43b09e42-afec-5653-a101-b286949b5a95 with scrape type 2
2026-03-29 18:46:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43b09e42-afec-5653-a101-b286949b5a95, identifier: RX22328
2026-03-29 18:46:16 [auto1.de] INFO: Found listing with ID: FD59666
2026-03-29 18:46:16 [auto1.de] INFO: Found listing with ID: YP26052
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP26052%27 HTTP/1.1" 200 None
2026-03-29 18:46:16 [auto1.de] INFO: Scrape type for YP26052: 2
2026-03-29 18:46:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5539d343-1aec-5424-a45e-26822f0bb2f3 with identifier: YP26052
2026-03-29 18:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5539d343-1aec-5424-a45e-26822f0bb2f3 with scrape type 2
2026-03-29 18:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5539d343-1aec-5424-a45e-26822f0bb2f3 with scrape type 2
2026-03-29 18:46:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5539d343-1aec-5424-a45e-26822f0bb2f3, identifier: YP26052
2026-03-29 18:46:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d2803ca-911b-5581-9411-59cbdfc1346b with identifier: XT42092
2026-03-29 18:46:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d2803ca-911b-5581-9411-59cbdfc1346b with identifier: XT42092
2026-03-29 18:46:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d2803ca-911b-5581-9411-59cbdfc1346b with identifier: XT42092 to the API
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:38:43Z',
'fuel_type': 'diesel',
'id': '9d2803ca-911b-5581-9411-59cbdfc1346b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT42092',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 105775,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-22',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2016}
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42092%27 HTTP/1.1" 200 None
2026-03-29 18:46:16 [auto1.de] INFO: Saving data for XT42092: {'auction_closing_time': 1774885123.0, 'created_time': 1774723342.231971, 'last_price_update_time': 1774809976.74882}
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT42092') HTTP/1.1" 204 0
2026-03-29 18:46:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43b09e42-afec-5653-a101-b286949b5a95 with identifier: RX22328
2026-03-29 18:46:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43b09e42-afec-5653-a101-b286949b5a95 with identifier: RX22328
2026-03-29 18:46:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43b09e42-afec-5653-a101-b286949b5a95 with identifier: RX22328 to the API
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:37:42Z',
'fuel_type': 'diesel',
'id': '43b09e42-afec-5653-a101-b286949b5a95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX22328',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Sprinter',
'odometer': 332893,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-19',
'seller_name': None,
'title': 'Mercedes-Benz Sprinter 313 CDI',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX22328%27 HTTP/1.1" 200 None
2026-03-29 18:46:17 [auto1.de] INFO: Saving data for RX22328: {'auction_closing_time': 1774885062.0, 'created_time': 1774723336.366532, 'last_price_update_time': 1774809977.038257}
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX22328') HTTP/1.1" 204 0
2026-03-29 18:46:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5539d343-1aec-5424-a45e-26822f0bb2f3 with identifier: YP26052
2026-03-29 18:46:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5539d343-1aec-5424-a45e-26822f0bb2f3 with identifier: YP26052
2026-03-29 18:46:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5539d343-1aec-5424-a45e-26822f0bb2f3 with identifier: YP26052 to the API
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:51:47Z',
'fuel_type': 'petrol',
'id': '5539d343-1aec-5424-a45e-26822f0bb2f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP26052',
'listing': 'auction',
'make': 'Fiat',
'model': 'Qubo',
'odometer': 40068,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'Fiat Qubo 1.4 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2017}
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP26052%27 HTTP/1.1" 200 None
2026-03-29 18:46:17 [auto1.de] INFO: Saving data for YP26052: {'auction_closing_time': 1774885907.0, 'created_time': 1774723287.624808, 'last_price_update_time': 1774809977.33215}
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP26052') HTTP/1.1" 204 0
2026-03-29 18:46:17 [auto1.de] INFO: Found listing with ID: ER27214
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER27214%27 HTTP/1.1" 200 None
2026-03-29 18:46:17 [auto1.de] INFO: Scrape type for ER27214: 2
2026-03-29 18:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5af9afd0-6f46-55e8-9755-ce8e7ff28a16 with identifier: ER27214
2026-03-29 18:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16 with scrape type 2
2026-03-29 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16 with scrape type 2
2026-03-29 18:46:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5af9afd0-6f46-55e8-9755-ce8e7ff28a16, identifier: ER27214
2026-03-29 18:46:17 [auto1.de] INFO: Found listing with ID: XE09172
2026-03-29 18:46:17 [auto1.de] INFO: Found listing with ID: ST78231
2026-03-29 18:46:17 [auto1.de] INFO: Found listing with ID: UW39915
2026-03-29 18:46:17 [auto1.de] INFO: Found listing with ID: GC53202
2026-03-29 18:46:17 [auto1.de] INFO: Found listing with ID: RF84100
2026-03-29 18:46:17 [auto1.de] INFO: Found listing with ID: BW84058
2026-03-29 18:46:17 [auto1.de] INFO: Found listing with ID: WJ96014
2026-03-29 18:46:17 [auto1.de] INFO: Found listing with ID: UX04638
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX04638%27 HTTP/1.1" 200 None
2026-03-29 18:46:17 [auto1.de] INFO: Scrape type for UX04638: 2
2026-03-29 18:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38050cb7-bcfb-599e-a22e-2bc8deb93957 with identifier: UX04638
2026-03-29 18:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38050cb7-bcfb-599e-a22e-2bc8deb93957 with scrape type 2
2026-03-29 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38050cb7-bcfb-599e-a22e-2bc8deb93957 with scrape type 2
2026-03-29 18:46:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38050cb7-bcfb-599e-a22e-2bc8deb93957, identifier: UX04638
2026-03-29 18:46:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5af9afd0-6f46-55e8-9755-ce8e7ff28a16 with identifier: ER27214
2026-03-29 18:46:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5af9afd0-6f46-55e8-9755-ce8e7ff28a16 with identifier: ER27214
2026-03-29 18:46:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5af9afd0-6f46-55e8-9755-ce8e7ff28a16 with identifier: ER27214 to the API
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:54:31Z',
'fuel_type': 'petrol',
'id': '5af9afd0-6f46-55e8-9755-ce8e7ff28a16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER27214',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 213423,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-07',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 250 Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2012}
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER27214%27 HTTP/1.1" 200 None
2026-03-29 18:46:17 [auto1.de] INFO: Saving data for ER27214: {'auction_closing_time': 1774886071.0, 'created_time': 1774723347.541487, 'last_price_update_time': 1774809977.865484}
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER27214') HTTP/1.1" 204 0
2026-03-29 18:46:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38050cb7-bcfb-599e-a22e-2bc8deb93957 with identifier: UX04638
2026-03-29 18:46:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38050cb7-bcfb-599e-a22e-2bc8deb93957 with identifier: UX04638
2026-03-29 18:46:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38050cb7-bcfb-599e-a22e-2bc8deb93957 with identifier: UX04638 to the API
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:29:35Z',
'fuel_type': 'petrol',
'id': '38050cb7-bcfb-599e-a22e-2bc8deb93957',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX04638',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 99945,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-28',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2019}
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX04638%27 HTTP/1.1" 200 None
2026-03-29 18:46:18 [auto1.de] INFO: Saving data for UX04638: {'auction_closing_time': 1774884575.0, 'created_time': 1773905433.337493, 'last_price_update_time': 1774809978.249248}
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX04638') HTTP/1.1" 204 0
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: VK18000
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: ZJ88951
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: DS51520
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: DU68074
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU68074%27 HTTP/1.1" 200 None
2026-03-29 18:46:18 [auto1.de] INFO: Scrape type for DU68074: 2
2026-03-29 18:46:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71e4824a-504e-5865-b11d-1e64a1740a05 with identifier: DU68074
2026-03-29 18:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71e4824a-504e-5865-b11d-1e64a1740a05 with scrape type 2
2026-03-29 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71e4824a-504e-5865-b11d-1e64a1740a05 with scrape type 2
2026-03-29 18:46:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71e4824a-504e-5865-b11d-1e64a1740a05, identifier: DU68074
2026-03-29 18:46:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71e4824a-504e-5865-b11d-1e64a1740a05 with identifier: DU68074
2026-03-29 18:46:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71e4824a-504e-5865-b11d-1e64a1740a05 with identifier: DU68074
2026-03-29 18:46:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71e4824a-504e-5865-b11d-1e64a1740a05 with identifier: DU68074 to the API
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:33:44Z',
'fuel_type': 'petrol',
'id': '71e4824a-504e-5865-b11d-1e64a1740a05',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU68074',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 120837,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-14',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2011}
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU68074%27 HTTP/1.1" 200 None
2026-03-29 18:46:18 [auto1.de] INFO: Saving data for DU68074: {'auction_closing_time': 1774884824.0, 'created_time': 1774032304.200163, 'last_price_update_time': 1774809978.648174}
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU68074') HTTP/1.1" 204 0
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: AX34662
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: VP32069
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: ZU11253
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: ZN38550
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN38550%27 HTTP/1.1" 200 None
2026-03-29 18:46:18 [auto1.de] INFO: Scrape type for ZN38550: 2
2026-03-29 18:46:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2b20905-7d4e-5ef3-9e1b-ac8929a6235f with identifier: ZN38550
2026-03-29 18:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2b20905-7d4e-5ef3-9e1b-ac8929a6235f with scrape type 2
2026-03-29 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2b20905-7d4e-5ef3-9e1b-ac8929a6235f with scrape type 2
2026-03-29 18:46:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2b20905-7d4e-5ef3-9e1b-ac8929a6235f, identifier: ZN38550
2026-03-29 18:46:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2b20905-7d4e-5ef3-9e1b-ac8929a6235f with identifier: ZN38550
2026-03-29 18:46:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2b20905-7d4e-5ef3-9e1b-ac8929a6235f with identifier: ZN38550
2026-03-29 18:46:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2b20905-7d4e-5ef3-9e1b-ac8929a6235f with identifier: ZN38550 to the API
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:48:16Z',
'fuel_type': 'diesel',
'id': 'b2b20905-7d4e-5ef3-9e1b-ac8929a6235f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN38550',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Viano',
'odometer': 223217,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-07',
'seller_name': None,
'title': 'Mercedes-Benz Viano 3.0 CDI lang BlueEfficiency Ambiente Edition',
'transmission': 'automatic',
'trim': 'lang BlueEfficiency Ambiente Edition',
'year': 2013}
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN38550%27 HTTP/1.1" 200 None
2026-03-29 18:46:19 [auto1.de] INFO: Saving data for ZN38550: {'auction_closing_time': 1774885696.0, 'created_time': 1774350208.274618, 'last_price_update_time': 1774809979.078491}
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN38550') HTTP/1.1" 204 0
2026-03-29 18:46:19 [auto1.de] INFO: Found listing with ID: TR40985
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR40985%27 HTTP/1.1" 200 None
2026-03-29 18:46:19 [auto1.de] INFO: Scrape type for TR40985: 2
2026-03-29 18:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02492eb5-9c6c-5a28-b81b-88d205d51ffe with identifier: TR40985
2026-03-29 18:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe with scrape type 2
2026-03-29 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe with scrape type 2
2026-03-29 18:46:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02492eb5-9c6c-5a28-b81b-88d205d51ffe, identifier: TR40985
2026-03-29 18:46:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02492eb5-9c6c-5a28-b81b-88d205d51ffe with identifier: TR40985
2026-03-29 18:46:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02492eb5-9c6c-5a28-b81b-88d205d51ffe with identifier: TR40985
2026-03-29 18:46:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02492eb5-9c6c-5a28-b81b-88d205d51ffe with identifier: TR40985 to the API
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:35:51Z',
'fuel_type': 'diesel',
'id': '02492eb5-9c6c-5a28-b81b-88d205d51ffe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR40985',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 127242,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-16',
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 2.0 Blue-HDi BeChic',
'transmission': 'automatic',
'trim': 'BeChic',
'year': 2018}
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR40985%27 HTTP/1.1" 200 None
2026-03-29 18:46:19 [auto1.de] INFO: Saving data for TR40985: {'auction_closing_time': 1774884951.0, 'created_time': 1774723281.195022, 'last_price_update_time': 1774809979.493761}
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR40985') HTTP/1.1" 204 0
2026-03-29 18:46:19 [auto1.de] INFO: Found listing with ID: BW25069
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW25069%27 HTTP/1.1" 200 None
2026-03-29 18:46:19 [auto1.de] INFO: Scrape type for BW25069: 2
2026-03-29 18:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0 with identifier: BW25069
2026-03-29 18:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0 with scrape type 2
2026-03-29 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0 with scrape type 2
2026-03-29 18:46:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0, identifier: BW25069
2026-03-29 18:46:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0 with identifier: BW25069
2026-03-29 18:46:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0 with identifier: BW25069
2026-03-29 18:46:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0 with identifier: BW25069 to the API
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:46:35Z',
'fuel_type': 'petrol',
'id': '0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW25069',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 121017,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-22',
'seller_name': None,
'title': 'Hyundai i30 1.4 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2010}
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW25069%27 HTTP/1.1" 200 None
2026-03-29 18:46:19 [auto1.de] INFO: Saving data for BW25069: {'auction_closing_time': 1774885595.0, 'created_time': 1774723283.428287, 'last_price_update_time': 1774809979.893009}
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW25069') HTTP/1.1" 204 0
2026-03-29 18:46:19 [auto1.de] INFO: Found listing with ID: UH14714
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14714%27 HTTP/1.1" 200 None
2026-03-29 18:46:19 [auto1.de] INFO: Scrape type for UH14714: 2
2026-03-29 18:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12e1bb21-1269-5538-98f2-2df346cb91fd with identifier: UH14714
2026-03-29 18:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12e1bb21-1269-5538-98f2-2df346cb91fd with scrape type 2
2026-03-29 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12e1bb21-1269-5538-98f2-2df346cb91fd with scrape type 2
2026-03-29 18:46:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12e1bb21-1269-5538-98f2-2df346cb91fd, identifier: UH14714
2026-03-29 18:46:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12e1bb21-1269-5538-98f2-2df346cb91fd with identifier: UH14714
2026-03-29 18:46:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12e1bb21-1269-5538-98f2-2df346cb91fd with identifier: UH14714
2026-03-29 18:46:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12e1bb21-1269-5538-98f2-2df346cb91fd with identifier: UH14714 to the API
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:42:33Z',
'fuel_type': 'petrol',
'id': '12e1bb21-1269-5538-98f2-2df346cb91fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH14714',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 236378,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-15',
'seller_name': None,
'title': 'Opel Astra 1.4 Turbo Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14714%27 HTTP/1.1" 200 None
2026-03-29 18:46:20 [auto1.de] INFO: Saving data for UH14714: {'auction_closing_time': 1774885353.0, 'created_time': 1774118372.059754, 'last_price_update_time': 1774809980.319057}
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH14714') HTTP/1.1" 204 0
2026-03-29 18:46:20 [auto1.de] INFO: Found listing with ID: WR70011
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR70011%27 HTTP/1.1" 200 None
2026-03-29 18:46:20 [auto1.de] INFO: Scrape type for WR70011: 2
2026-03-29 18:46:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b1b07b7-f96a-56f6-97e6-d9999465f9ec with identifier: WR70011
2026-03-29 18:46:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec with scrape type 2
2026-03-29 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec with scrape type 2
2026-03-29 18:46:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b1b07b7-f96a-56f6-97e6-d9999465f9ec, identifier: WR70011
2026-03-29 18:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b1b07b7-f96a-56f6-97e6-d9999465f9ec with identifier: WR70011
2026-03-29 18:46:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b1b07b7-f96a-56f6-97e6-d9999465f9ec with identifier: WR70011
2026-03-29 18:46:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b1b07b7-f96a-56f6-97e6-d9999465f9ec with identifier: WR70011 to the API
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 228,
'expiration_date': '2026-03-30T15:01:22Z',
'fuel_type': 'petrol',
'id': '0b1b07b7-f96a-56f6-97e6-d9999465f9ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR70011',
'listing': 'auction',
'make': 'Porsche',
'model': 'Boxster',
'odometer': 71145,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-10-03',
'seller_name': None,
'title': 'Porsche Boxster 2.7',
'transmission': 'automatic',
'trim': '',
'year': 2004}
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR70011%27 HTTP/1.1" 200 None
2026-03-29 18:46:20 [auto1.de] INFO: Saving data for WR70011: {'auction_closing_time': 1774882882.0, 'created_time': 1774723282.631493, 'last_price_update_time': 1774809980.832798}
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR70011') HTTP/1.1" 204 0
2026-03-29 18:46:20 [auto1.de] INFO: Found listing with ID: FL42692
2026-03-29 18:46:20 [auto1.de] INFO: Found listing with ID: UP55636
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55636%27 HTTP/1.1" 200 None
2026-03-29 18:46:20 [auto1.de] INFO: Scrape type for UP55636: 2
2026-03-29 18:46:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a9fc37-8973-53f1-b9d5-0689115e690a with identifier: UP55636
2026-03-29 18:46:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a9fc37-8973-53f1-b9d5-0689115e690a with scrape type 2
2026-03-29 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96a9fc37-8973-53f1-b9d5-0689115e690a with scrape type 2
2026-03-29 18:46:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96a9fc37-8973-53f1-b9d5-0689115e690a, identifier: UP55636
2026-03-29 18:46:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96a9fc37-8973-53f1-b9d5-0689115e690a with identifier: UP55636
2026-03-29 18:46:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96a9fc37-8973-53f1-b9d5-0689115e690a with identifier: UP55636
2026-03-29 18:46:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96a9fc37-8973-53f1-b9d5-0689115e690a with identifier: UP55636 to the API
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-30T15:14:05Z',
'fuel_type': 'petrol',
'id': '96a9fc37-8973-53f1-b9d5-0689115e690a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP55636',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 61639,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-03',
'seller_name': None,
'title': 'Kia Sportage 1.6 GDI Edition 7 2WD',
'transmission': 'manual',
'trim': 'Edition 7 2WD',
'year': 2019}
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55636%27 HTTP/1.1" 200 None
2026-03-29 18:46:21 [auto1.de] INFO: Saving data for UP55636: {'auction_closing_time': 1774883645.0, 'created_time': 1774723338.638544, 'last_price_update_time': 1774809981.267532}
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP55636') HTTP/1.1" 204 0
2026-03-29 18:46:21 [auto1.de] INFO: Found listing with ID: EP24311
2026-03-29 18:46:21 [auto1.de] INFO: Found listing with ID: ZT83144
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT83144%27 HTTP/1.1" 200 None
2026-03-29 18:46:21 [auto1.de] INFO: Scrape type for ZT83144: 2
2026-03-29 18:46:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24fbc3ce-1fe2-5a34-b5da-34d30d4b349f with identifier: ZT83144
2026-03-29 18:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24fbc3ce-1fe2-5a34-b5da-34d30d4b349f with scrape type 2
2026-03-29 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24fbc3ce-1fe2-5a34-b5da-34d30d4b349f with scrape type 2
2026-03-29 18:46:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24fbc3ce-1fe2-5a34-b5da-34d30d4b349f, identifier: ZT83144
2026-03-29 18:46:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24fbc3ce-1fe2-5a34-b5da-34d30d4b349f with identifier: ZT83144
2026-03-29 18:46:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24fbc3ce-1fe2-5a34-b5da-34d30d4b349f with identifier: ZT83144
2026-03-29 18:46:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24fbc3ce-1fe2-5a34-b5da-34d30d4b349f with identifier: ZT83144 to the API
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:28:49Z',
'fuel_type': 'diesel',
'id': '24fbc3ce-1fe2-5a34-b5da-34d30d4b349f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT83144',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLK-Klasse',
'odometer': 204817,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-26',
'seller_name': None,
'title': 'Mercedes-Benz GLK-Klasse GLK 250 CDI 4Matic BlueEfficiency',
'transmission': 'automatic',
'trim': '4Matic BlueEfficiency',
'year': 2012}
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT83144%27 HTTP/1.1" 200 None
2026-03-29 18:46:21 [auto1.de] INFO: Saving data for ZT83144: {'auction_closing_time': 1774884529.0, 'created_time': 1774002253.259746, 'last_price_update_time': 1774809981.663349}
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT83144') HTTP/1.1" 204 0
2026-03-29 18:46:21 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:21 [auto1.de] INFO: Found listing with ID: UY91981
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY91981%27 HTTP/1.1" 200 None
2026-03-29 18:46:21 [auto1.de] INFO: Scrape type for UY91981: 2
2026-03-29 18:46:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab60df0a-b336-5f49-81c6-b8c042e48330 with identifier: UY91981
2026-03-29 18:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab60df0a-b336-5f49-81c6-b8c042e48330 with scrape type 2
2026-03-29 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab60df0a-b336-5f49-81c6-b8c042e48330 with scrape type 2
2026-03-29 18:46:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab60df0a-b336-5f49-81c6-b8c042e48330, identifier: UY91981
2026-03-29 18:46:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab60df0a-b336-5f49-81c6-b8c042e48330 with identifier: UY91981
2026-03-29 18:46:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab60df0a-b336-5f49-81c6-b8c042e48330 with identifier: UY91981
2026-03-29 18:46:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab60df0a-b336-5f49-81c6-b8c042e48330 with identifier: UY91981 to the API
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:13:24Z',
'fuel_type': 'diesel',
'id': 'ab60df0a-b336-5f49-81c6-b8c042e48330',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY91981',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 109267,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-13',
'seller_name': None,
'title': 'Citroen C4 Cactus 1.5 Blue-HDi Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2019}
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY91981%27 HTTP/1.1" 200 None
2026-03-29 18:46:22 [auto1.de] INFO: Saving data for UY91981: {'auction_closing_time': 1774883604.0, 'created_time': 1774723337.487762, 'last_price_update_time': 1774809982.082921}
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY91981') HTTP/1.1" 204 0
2026-03-29 18:46:22 [auto1.de] INFO: Found listing with ID: NX87227
2026-03-29 18:46:22 [auto1.de] INFO: Found listing with ID: TH73061
2026-03-29 18:46:22 [auto1.de] INFO: Found listing with ID: DN86096
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN86096%27 HTTP/1.1" 200 None
2026-03-29 18:46:22 [auto1.de] INFO: Scrape type for DN86096: 2
2026-03-29 18:46:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 004ed81a-173c-54ba-adc0-8d6e5b6a693e with identifier: DN86096
2026-03-29 18:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 004ed81a-173c-54ba-adc0-8d6e5b6a693e with scrape type 2
2026-03-29 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 004ed81a-173c-54ba-adc0-8d6e5b6a693e with scrape type 2
2026-03-29 18:46:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 004ed81a-173c-54ba-adc0-8d6e5b6a693e, identifier: DN86096
2026-03-29 18:46:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:22 [auto1.de] INFO: Found listing with ID: AX05001
2026-03-29 18:46:22 [auto1.de] INFO: Found listing with ID: LT27218
2026-03-29 18:46:22 [auto1.de] INFO: Found listing with ID: TG23617
2026-03-29 18:46:22 [auto1.de] INFO: Found listing with ID: DL01383
2026-03-29 18:46:22 [auto1.de] INFO: Found listing with ID: VR01975
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01975%27 HTTP/1.1" 200 None
2026-03-29 18:46:22 [auto1.de] INFO: Scrape type for VR01975: 2
2026-03-29 18:46:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 665e0565-4699-51e9-906a-e5685aa77c62 with identifier: VR01975
2026-03-29 18:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 665e0565-4699-51e9-906a-e5685aa77c62 with scrape type 2
2026-03-29 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 665e0565-4699-51e9-906a-e5685aa77c62 with scrape type 2
2026-03-29 18:46:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 665e0565-4699-51e9-906a-e5685aa77c62, identifier: VR01975
2026-03-29 18:46:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 004ed81a-173c-54ba-adc0-8d6e5b6a693e with identifier: DN86096
2026-03-29 18:46:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 004ed81a-173c-54ba-adc0-8d6e5b6a693e with identifier: DN86096
2026-03-29 18:46:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 004ed81a-173c-54ba-adc0-8d6e5b6a693e with identifier: DN86096 to the API
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:26:53Z',
'fuel_type': 'diesel',
'id': '004ed81a-173c-54ba-adc0-8d6e5b6a693e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN86096',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 103249,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-06',
'seller_name': None,
'title': 'Porsche Macan S Diesel',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN86096%27 HTTP/1.1" 200 None
2026-03-29 18:46:22 [auto1.de] INFO: Saving data for DN86096: {'auction_closing_time': 1774884413.0, 'created_time': 1774723339.350622, 'last_price_update_time': 1774809982.595601}
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN86096') HTTP/1.1" 204 0
2026-03-29 18:46:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 665e0565-4699-51e9-906a-e5685aa77c62 with identifier: VR01975
2026-03-29 18:46:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 665e0565-4699-51e9-906a-e5685aa77c62 with identifier: VR01975
2026-03-29 18:46:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 665e0565-4699-51e9-906a-e5685aa77c62 with identifier: VR01975 to the API
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:41:34Z',
'fuel_type': 'petrol',
'id': '665e0565-4699-51e9-906a-e5685aa77c62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR01975',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 45320,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-28',
'seller_name': None,
'title': 'Renault Scenic 1.6 TomTom Edition',
'transmission': 'manual',
'trim': 'TomTom Edition',
'year': 2012}
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01975%27 HTTP/1.1" 200 None
2026-03-29 18:46:22 [auto1.de] INFO: Saving data for VR01975: {'auction_closing_time': 1774885294.0, 'created_time': 1774723318.356079, 'last_price_update_time': 1774809982.984115}
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR01975') HTTP/1.1" 204 0
2026-03-29 18:46:22 [auto1.de] INFO: Found listing with ID: YK83419
2026-03-29 18:46:22 [auto1.de] INFO: Found listing with ID: RV77607
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV77607%27 HTTP/1.1" 200 None
2026-03-29 18:46:23 [auto1.de] INFO: Scrape type for RV77607: 2
2026-03-29 18:46:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63e300ed-3954-56d4-afe8-4b59858d928e with identifier: RV77607
2026-03-29 18:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63e300ed-3954-56d4-afe8-4b59858d928e with scrape type 2
2026-03-29 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63e300ed-3954-56d4-afe8-4b59858d928e with scrape type 2
2026-03-29 18:46:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63e300ed-3954-56d4-afe8-4b59858d928e, identifier: RV77607
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: BC68366
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: UW30616
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: RT08508
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: HL66974
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL66974%27 HTTP/1.1" 200 None
2026-03-29 18:46:23 [auto1.de] INFO: Scrape type for HL66974: 2
2026-03-29 18:46:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf4f7648-08b9-5a3a-99f0-397a66b393f3 with identifier: HL66974
2026-03-29 18:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf4f7648-08b9-5a3a-99f0-397a66b393f3 with scrape type 2
2026-03-29 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf4f7648-08b9-5a3a-99f0-397a66b393f3 with scrape type 2
2026-03-29 18:46:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf4f7648-08b9-5a3a-99f0-397a66b393f3, identifier: HL66974
2026-03-29 18:46:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63e300ed-3954-56d4-afe8-4b59858d928e with identifier: RV77607
2026-03-29 18:46:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63e300ed-3954-56d4-afe8-4b59858d928e with identifier: RV77607
2026-03-29 18:46:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63e300ed-3954-56d4-afe8-4b59858d928e with identifier: RV77607 to the API
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:21:47Z',
'fuel_type': 'gas',
'id': '63e300ed-3954-56d4-afe8-4b59858d928e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV77607',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 89413,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-22',
'seller_name': None,
'title': 'Volkswagen Caddy 1.4 TGI Comfortline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion Tech',
'year': 2016}
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV77607%27 HTTP/1.1" 200 None
2026-03-29 18:46:23 [auto1.de] INFO: Saving data for RV77607: {'auction_closing_time': 1774884107.0, 'created_time': 1774521622.033738, 'last_price_update_time': 1774809983.516595}
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV77607') HTTP/1.1" 204 0
2026-03-29 18:46:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf4f7648-08b9-5a3a-99f0-397a66b393f3 with identifier: HL66974
2026-03-29 18:46:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf4f7648-08b9-5a3a-99f0-397a66b393f3 with identifier: HL66974
2026-03-29 18:46:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf4f7648-08b9-5a3a-99f0-397a66b393f3 with identifier: HL66974 to the API
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:23:40Z',
'fuel_type': 'diesel',
'id': 'cf4f7648-08b9-5a3a-99f0-397a66b393f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL66974',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 139380,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-27',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line 2WD',
'transmission': 'manual',
'trim': 'Exclusive-Line 2WD',
'year': 2016}
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL66974%27 HTTP/1.1" 200 None
2026-03-29 18:46:23 [auto1.de] INFO: Saving data for HL66974: {'auction_closing_time': 1774884220.0, 'created_time': 1774723338.994568, 'last_price_update_time': 1774809983.819429}
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL66974') HTTP/1.1" 204 0
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: PS10948
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: HF23324
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: XA19312
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: UP26126
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP26126%27 HTTP/1.1" 200 None
2026-03-29 18:46:23 [auto1.de] INFO: Scrape type for UP26126: 2
2026-03-29 18:46:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 356511fb-5dbd-5350-b3c3-cf15a8c143b1 with identifier: UP26126
2026-03-29 18:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 356511fb-5dbd-5350-b3c3-cf15a8c143b1 with scrape type 2
2026-03-29 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 356511fb-5dbd-5350-b3c3-cf15a8c143b1 with scrape type 2
2026-03-29 18:46:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 356511fb-5dbd-5350-b3c3-cf15a8c143b1, identifier: UP26126
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: CJ73141
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ73141%27 HTTP/1.1" 200 None
2026-03-29 18:46:23 [auto1.de] INFO: Scrape type for CJ73141: 2
2026-03-29 18:46:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d8948d1-6f87-5de2-90fe-acc74013515e with identifier: CJ73141
2026-03-29 18:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d8948d1-6f87-5de2-90fe-acc74013515e with scrape type 2
2026-03-29 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d8948d1-6f87-5de2-90fe-acc74013515e with scrape type 2
2026-03-29 18:46:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d8948d1-6f87-5de2-90fe-acc74013515e, identifier: CJ73141
2026-03-29 18:46:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 356511fb-5dbd-5350-b3c3-cf15a8c143b1 with identifier: UP26126
2026-03-29 18:46:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 356511fb-5dbd-5350-b3c3-cf15a8c143b1 with identifier: UP26126
2026-03-29 18:46:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 356511fb-5dbd-5350-b3c3-cf15a8c143b1 with identifier: UP26126 to the API
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:36:14Z',
'fuel_type': 'petrol',
'id': '356511fb-5dbd-5350-b3c3-cf15a8c143b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP26126',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 178333,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-30',
'seller_name': None,
'title': 'BMW 2er 218i Active Tourer Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2017}
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP26126%27 HTTP/1.1" 200 None
2026-03-29 18:46:24 [auto1.de] INFO: Saving data for UP26126: {'auction_closing_time': 1774884974.0, 'created_time': 1774349000.309853, 'last_price_update_time': 1774809984.370126}
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP26126') HTTP/1.1" 204 0
2026-03-29 18:46:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d8948d1-6f87-5de2-90fe-acc74013515e with identifier: CJ73141
2026-03-29 18:46:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d8948d1-6f87-5de2-90fe-acc74013515e with identifier: CJ73141
2026-03-29 18:46:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d8948d1-6f87-5de2-90fe-acc74013515e with identifier: CJ73141 to the API
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:01:12Z',
'fuel_type': 'petrol',
'id': '4d8948d1-6f87-5de2-90fe-acc74013515e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ73141',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 27357,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-20',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 160 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2010}
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ73141%27 HTTP/1.1" 200 None
2026-03-29 18:46:24 [auto1.de] INFO: Saving data for CJ73141: {'auction_closing_time': 1774882872.0, 'created_time': 1774723314.106224, 'last_price_update_time': 1774809984.759214}
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ73141') HTTP/1.1" 204 0
2026-03-29 18:46:24 [auto1.de] INFO: Found listing with ID: GP53136
2026-03-29 18:46:24 [auto1.de] INFO: Found listing with ID: TV59519
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV59519%27 HTTP/1.1" 200 None
2026-03-29 18:46:24 [auto1.de] INFO: Scrape type for TV59519: 2
2026-03-29 18:46:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b with identifier: TV59519
2026-03-29 18:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b with scrape type 2
2026-03-29 18:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b with scrape type 2
2026-03-29 18:46:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b, identifier: TV59519
2026-03-29 18:46:24 [auto1.de] INFO: Found listing with ID: LT88740
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT88740%27 HTTP/1.1" 200 None
2026-03-29 18:46:24 [auto1.de] INFO: Scrape type for LT88740: 2
2026-03-29 18:46:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1a68d32-d9c0-552d-acb4-159293946c40 with identifier: LT88740
2026-03-29 18:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a68d32-d9c0-552d-acb4-159293946c40 with scrape type 2
2026-03-29 18:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1a68d32-d9c0-552d-acb4-159293946c40 with scrape type 2
2026-03-29 18:46:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1a68d32-d9c0-552d-acb4-159293946c40, identifier: LT88740
2026-03-29 18:46:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b with identifier: TV59519
2026-03-29 18:46:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b with identifier: TV59519
2026-03-29 18:46:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b with identifier: TV59519 to the API
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-30T15:38:29Z',
'fuel_type': 'diesel',
'id': '2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV59519',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 217579,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-19',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 e-HDi Intensive',
'transmission': 'automatic',
'trim': 'Intensive',
'year': 2013}
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV59519%27 HTTP/1.1" 200 None
2026-03-29 18:46:25 [auto1.de] INFO: Saving data for TV59519: {'auction_closing_time': 1774885109.0, 'created_time': 1774723356.729914, 'last_price_update_time': 1774809985.256457}
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV59519') HTTP/1.1" 204 0
2026-03-29 18:46:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1a68d32-d9c0-552d-acb4-159293946c40 with identifier: LT88740
2026-03-29 18:46:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1a68d32-d9c0-552d-acb4-159293946c40 with identifier: LT88740
2026-03-29 18:46:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1a68d32-d9c0-552d-acb4-159293946c40 with identifier: LT88740 to the API
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:10:39Z',
'fuel_type': 'petrol',
'id': 'd1a68d32-d9c0-552d-acb4-159293946c40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT88740',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 109218,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-11-23',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 150 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2004}
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT88740%27 HTTP/1.1" 200 None
2026-03-29 18:46:25 [auto1.de] INFO: Saving data for LT88740: {'auction_closing_time': 1774883439.0, 'created_time': 1774118561.518442, 'last_price_update_time': 1774809985.548059}
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT88740') HTTP/1.1" 204 0
2026-03-29 18:46:25 [auto1.de] INFO: Found listing with ID: XL14326
2026-03-29 18:46:25 [auto1.de] INFO: Found listing with ID: AC34212
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC34212%27 HTTP/1.1" 200 None
2026-03-29 18:46:25 [auto1.de] INFO: Scrape type for AC34212: 2
2026-03-29 18:46:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15256595-7396-5306-8764-6653f86c51be with identifier: AC34212
2026-03-29 18:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15256595-7396-5306-8764-6653f86c51be with scrape type 2
2026-03-29 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15256595-7396-5306-8764-6653f86c51be with scrape type 2
2026-03-29 18:46:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15256595-7396-5306-8764-6653f86c51be, identifier: AC34212
2026-03-29 18:46:25 [auto1.de] INFO: Found listing with ID: FE36611
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE36611%27 HTTP/1.1" 200 None
2026-03-29 18:46:25 [auto1.de] INFO: Scrape type for FE36611: 2
2026-03-29 18:46:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06a4c7cc-b07f-5e2d-a0d1-17682d363898 with identifier: FE36611
2026-03-29 18:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898 with scrape type 2
2026-03-29 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898 with scrape type 2
2026-03-29 18:46:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06a4c7cc-b07f-5e2d-a0d1-17682d363898, identifier: FE36611
2026-03-29 18:46:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15256595-7396-5306-8764-6653f86c51be with identifier: AC34212
2026-03-29 18:46:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15256595-7396-5306-8764-6653f86c51be with identifier: AC34212
2026-03-29 18:46:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15256595-7396-5306-8764-6653f86c51be with identifier: AC34212 to the API
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:16:42Z',
'fuel_type': 'diesel',
'id': '15256595-7396-5306-8764-6653f86c51be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC34212',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 127192,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-03',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
'transmission': 'manual',
'trim': 'Sport & Style BlueMotion Tech',
'year': 2012}
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC34212%27 HTTP/1.1" 200 None
2026-03-29 18:46:26 [auto1.de] INFO: Saving data for AC34212: {'auction_closing_time': 1774883802.0, 'created_time': 1774723315.300926, 'last_price_update_time': 1774809986.083827}
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC34212') HTTP/1.1" 204 0
2026-03-29 18:46:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06a4c7cc-b07f-5e2d-a0d1-17682d363898 with identifier: FE36611
2026-03-29 18:46:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06a4c7cc-b07f-5e2d-a0d1-17682d363898 with identifier: FE36611
2026-03-29 18:46:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06a4c7cc-b07f-5e2d-a0d1-17682d363898 with identifier: FE36611 to the API
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:35:33Z',
'fuel_type': 'petrol',
'id': '06a4c7cc-b07f-5e2d-a0d1-17682d363898',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE36611',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'up!',
'odometer': 56550,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-30',
'seller_name': None,
'title': 'Volkswagen up! 1.0 Club up!',
'transmission': 'manual',
'trim': 'Club',
'year': 2016}
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE36611%27 HTTP/1.1" 200 None
2026-03-29 18:46:26 [auto1.de] INFO: Saving data for FE36611: {'auction_closing_time': 1774884933.0, 'created_time': 1774723332.14066, 'last_price_update_time': 1774809986.367637}
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE36611') HTTP/1.1" 204 0
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: EW67018
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW67018%27 HTTP/1.1" 200 None
2026-03-29 18:46:26 [auto1.de] INFO: Scrape type for EW67018: 2
2026-03-29 18:46:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb4fc868-1be9-5c31-9102-35d7789cbe76 with identifier: EW67018
2026-03-29 18:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb4fc868-1be9-5c31-9102-35d7789cbe76 with scrape type 2
2026-03-29 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb4fc868-1be9-5c31-9102-35d7789cbe76 with scrape type 2
2026-03-29 18:46:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb4fc868-1be9-5c31-9102-35d7789cbe76, identifier: EW67018
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: MY97693
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: VH99628
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: ST78057
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78057%27 HTTP/1.1" 200 None
2026-03-29 18:46:26 [auto1.de] INFO: Scrape type for ST78057: 2
2026-03-29 18:46:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19a001bc-717d-55cf-9874-d0f17b93182a with identifier: ST78057
2026-03-29 18:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19a001bc-717d-55cf-9874-d0f17b93182a with scrape type 2
2026-03-29 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19a001bc-717d-55cf-9874-d0f17b93182a with scrape type 2
2026-03-29 18:46:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19a001bc-717d-55cf-9874-d0f17b93182a, identifier: ST78057
2026-03-29 18:46:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb4fc868-1be9-5c31-9102-35d7789cbe76 with identifier: EW67018
2026-03-29 18:46:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb4fc868-1be9-5c31-9102-35d7789cbe76 with identifier: EW67018
2026-03-29 18:46:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb4fc868-1be9-5c31-9102-35d7789cbe76 with identifier: EW67018 to the API
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:49:09Z',
'fuel_type': 'petrol',
'id': 'fb4fc868-1be9-5c31-9102-35d7789cbe76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW67018',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 101793,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-05',
'seller_name': None,
'title': 'Skoda Octavia 1.5 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2019}
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW67018%27 HTTP/1.1" 200 None
2026-03-29 18:46:26 [auto1.de] INFO: Saving data for EW67018: {'auction_closing_time': 1774885749.0, 'created_time': 1774723334.498843, 'last_price_update_time': 1774809986.859251}
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW67018') HTTP/1.1" 204 0
2026-03-29 18:46:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19a001bc-717d-55cf-9874-d0f17b93182a with identifier: ST78057
2026-03-29 18:46:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19a001bc-717d-55cf-9874-d0f17b93182a with identifier: ST78057
2026-03-29 18:46:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19a001bc-717d-55cf-9874-d0f17b93182a with identifier: ST78057 to the API
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:45:57Z',
'fuel_type': 'petrol',
'id': '19a001bc-717d-55cf-9874-d0f17b93182a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST78057',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'up!',
'odometer': 94267,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-10',
'seller_name': None,
'title': 'Volkswagen up! 1.0 Cross up!',
'transmission': 'manual',
'trim': 'Cross',
'year': 2013}
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78057%27 HTTP/1.1" 200 None
2026-03-29 18:46:27 [auto1.de] INFO: Saving data for ST78057: {'auction_closing_time': 1774885557.0, 'created_time': 1774032306.797111, 'last_price_update_time': 1774809987.149308}
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST78057') HTTP/1.1" 204 0
2026-03-29 18:46:27 [auto1.de] INFO: Found listing with ID: KN87388
2026-03-29 18:46:27 [auto1.de] INFO: Found listing with ID: MB20164
2026-03-29 18:46:27 [auto1.de] INFO: Found listing with ID: HL64703
2026-03-29 18:46:27 [auto1.de] INFO: Found listing with ID: YW30232
2026-03-29 18:46:27 [auto1.de] INFO: Found listing with ID: AL30364
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL30364%27 HTTP/1.1" 200 None
2026-03-29 18:46:27 [auto1.de] INFO: Scrape type for AL30364: 2
2026-03-29 18:46:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4000ab82-0858-5b4b-ae7e-708aef28a00e with identifier: AL30364
2026-03-29 18:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4000ab82-0858-5b4b-ae7e-708aef28a00e with scrape type 2
2026-03-29 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4000ab82-0858-5b4b-ae7e-708aef28a00e with scrape type 2
2026-03-29 18:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4000ab82-0858-5b4b-ae7e-708aef28a00e, identifier: AL30364
2026-03-29 18:46:27 [auto1.de] INFO: Found listing with ID: PV80087
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV80087%27 HTTP/1.1" 200 None
2026-03-29 18:46:27 [auto1.de] INFO: Scrape type for PV80087: 2
2026-03-29 18:46:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff407923-78b1-5591-abdd-25c1aa59f1f4 with identifier: PV80087
2026-03-29 18:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff407923-78b1-5591-abdd-25c1aa59f1f4 with scrape type 2
2026-03-29 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff407923-78b1-5591-abdd-25c1aa59f1f4 with scrape type 2
2026-03-29 18:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff407923-78b1-5591-abdd-25c1aa59f1f4, identifier: PV80087
2026-03-29 18:46:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4000ab82-0858-5b4b-ae7e-708aef28a00e with identifier: AL30364
2026-03-29 18:46:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4000ab82-0858-5b4b-ae7e-708aef28a00e with identifier: AL30364
2026-03-29 18:46:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4000ab82-0858-5b4b-ae7e-708aef28a00e with identifier: AL30364 to the API
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:27:27Z',
'fuel_type': 'petrol',
'id': '4000ab82-0858-5b4b-ae7e-708aef28a00e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL30364',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 78610,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-28',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2019}
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL30364%27 HTTP/1.1" 200 None
2026-03-29 18:46:27 [auto1.de] INFO: Saving data for AL30364: {'auction_closing_time': 1774884447.0, 'created_time': 1774723348.294502, 'last_price_update_time': 1774809987.640494}
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL30364') HTTP/1.1" 204 0
2026-03-29 18:46:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff407923-78b1-5591-abdd-25c1aa59f1f4 with identifier: PV80087
2026-03-29 18:46:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff407923-78b1-5591-abdd-25c1aa59f1f4 with identifier: PV80087
2026-03-29 18:46:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff407923-78b1-5591-abdd-25c1aa59f1f4 with identifier: PV80087 to the API
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:16:08Z',
'fuel_type': 'petrol',
'id': 'ff407923-78b1-5591-abdd-25c1aa59f1f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV80087',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 106065,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-23',
'seller_name': None,
'title': 'Opel Astra 1.4 SIDI Turbo Excellence Start/Stop',
'transmission': 'manual',
'trim': 'Excellence Start/Stop',
'year': 2017}
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV80087%27 HTTP/1.1" 200 None
2026-03-29 18:46:28 [auto1.de] INFO: Saving data for PV80087: {'auction_closing_time': 1774883768.0, 'created_time': 1774723306.907158, 'last_price_update_time': 1774809988.044027}
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV80087') HTTP/1.1" 204 0
2026-03-29 18:46:28 [auto1.de] INFO: Found listing with ID: FW19107
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW19107%27 HTTP/1.1" 200 None
2026-03-29 18:46:28 [auto1.de] INFO: Scrape type for FW19107: 2
2026-03-29 18:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0db5af3a-941c-58ea-b5a5-77650bbe63d5 with identifier: FW19107
2026-03-29 18:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0db5af3a-941c-58ea-b5a5-77650bbe63d5 with scrape type 2
2026-03-29 18:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0db5af3a-941c-58ea-b5a5-77650bbe63d5 with scrape type 2
2026-03-29 18:46:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0db5af3a-941c-58ea-b5a5-77650bbe63d5, identifier: FW19107
2026-03-29 18:46:28 [auto1.de] INFO: Found listing with ID: HD58306
2026-03-29 18:46:28 [auto1.de] INFO: Found listing with ID: KY32435
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY32435%27 HTTP/1.1" 200 None
2026-03-29 18:46:28 [auto1.de] INFO: Scrape type for KY32435: 2
2026-03-29 18:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4439f062-fb4c-5d27-83e8-3cc1acbd1b81 with identifier: KY32435
2026-03-29 18:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4439f062-fb4c-5d27-83e8-3cc1acbd1b81 with scrape type 2
2026-03-29 18:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4439f062-fb4c-5d27-83e8-3cc1acbd1b81 with scrape type 2
2026-03-29 18:46:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4439f062-fb4c-5d27-83e8-3cc1acbd1b81, identifier: KY32435
2026-03-29 18:46:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0db5af3a-941c-58ea-b5a5-77650bbe63d5 with identifier: FW19107
2026-03-29 18:46:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0db5af3a-941c-58ea-b5a5-77650bbe63d5 with identifier: FW19107
2026-03-29 18:46:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0db5af3a-941c-58ea-b5a5-77650bbe63d5 with identifier: FW19107 to the API
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 292,
'expiration_date': '2026-03-30T15:25:30Z',
'fuel_type': 'petrol',
'id': '0db5af3a-941c-58ea-b5a5-77650bbe63d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW19107',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 343424,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-30',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 CGI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2010}
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW19107%27 HTTP/1.1" 200 None
2026-03-29 18:46:28 [auto1.de] INFO: Saving data for FW19107: {'auction_closing_time': 1774884330.0, 'created_time': 1774723330.782503, 'last_price_update_time': 1774809988.603321}
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW19107') HTTP/1.1" 204 0
2026-03-29 18:46:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4439f062-fb4c-5d27-83e8-3cc1acbd1b81 with identifier: KY32435
2026-03-29 18:46:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4439f062-fb4c-5d27-83e8-3cc1acbd1b81 with identifier: KY32435
2026-03-29 18:46:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4439f062-fb4c-5d27-83e8-3cc1acbd1b81 with identifier: KY32435 to the API
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:04:44Z',
'fuel_type': 'diesel',
'id': '4439f062-fb4c-5d27-83e8-3cc1acbd1b81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY32435',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 132895,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-03',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2017}
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY32435%27 HTTP/1.1" 200 None
2026-03-29 18:46:28 [auto1.de] INFO: Saving data for KY32435: {'auction_closing_time': 1774883084.0, 'created_time': 1773860234.130889, 'last_price_update_time': 1774809988.913156}
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY32435') HTTP/1.1" 204 0
2026-03-29 18:46:28 [auto1.de] INFO: Found listing with ID: HF87037
2026-03-29 18:46:28 [auto1.de] INFO: Found listing with ID: SJ02125
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02125%27 HTTP/1.1" 200 None
2026-03-29 18:46:28 [auto1.de] INFO: Scrape type for SJ02125: 2
2026-03-29 18:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fec6a21-0184-5a46-b8ef-2e2020d2abea with identifier: SJ02125
2026-03-29 18:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fec6a21-0184-5a46-b8ef-2e2020d2abea with scrape type 2
2026-03-29 18:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fec6a21-0184-5a46-b8ef-2e2020d2abea with scrape type 2
2026-03-29 18:46:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fec6a21-0184-5a46-b8ef-2e2020d2abea, identifier: SJ02125
2026-03-29 18:46:29 [auto1.de] INFO: Found listing with ID: BE46966
2026-03-29 18:46:29 [auto1.de] INFO: Found listing with ID: ZZ46464
2026-03-29 18:46:29 [auto1.de] INFO: Found listing with ID: PY07739
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07739%27 HTTP/1.1" 200 None
2026-03-29 18:46:29 [auto1.de] INFO: Scrape type for PY07739: 2
2026-03-29 18:46:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b152afcd-f52e-56e0-ae21-32e659777614 with identifier: PY07739
2026-03-29 18:46:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b152afcd-f52e-56e0-ae21-32e659777614 with scrape type 2
2026-03-29 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b152afcd-f52e-56e0-ae21-32e659777614 with scrape type 2
2026-03-29 18:46:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b152afcd-f52e-56e0-ae21-32e659777614, identifier: PY07739
2026-03-29 18:46:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fec6a21-0184-5a46-b8ef-2e2020d2abea with identifier: SJ02125
2026-03-29 18:46:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fec6a21-0184-5a46-b8ef-2e2020d2abea with identifier: SJ02125
2026-03-29 18:46:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fec6a21-0184-5a46-b8ef-2e2020d2abea with identifier: SJ02125 to the API
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:01:34Z',
'fuel_type': 'diesel',
'id': '7fec6a21-0184-5a46-b8ef-2e2020d2abea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ02125',
'listing': 'auction',
'make': 'Dacia',
'model': 'Logan MCV',
'odometer': 233770,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-31',
'seller_name': None,
'title': 'Dacia Logan MCV 1.5 dCi Prestige',
'transmission': 'manual',
'trim': 'Prestige',
'year': 2015}
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02125%27 HTTP/1.1" 200 None
2026-03-29 18:46:29 [auto1.de] INFO: Saving data for SJ02125: {'auction_closing_time': 1774882894.0, 'created_time': 1774349151.99935, 'last_price_update_time': 1774809989.461188}
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ02125') HTTP/1.1" 204 0
2026-03-29 18:46:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b152afcd-f52e-56e0-ae21-32e659777614 with identifier: PY07739
2026-03-29 18:46:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b152afcd-f52e-56e0-ae21-32e659777614 with identifier: PY07739
2026-03-29 18:46:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b152afcd-f52e-56e0-ae21-32e659777614 with identifier: PY07739 to the API
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:42:46Z',
'fuel_type': 'petrol',
'id': 'b152afcd-f52e-56e0-ae21-32e659777614',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY07739',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 22677,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-06',
'seller_name': None,
'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid advanced',
'transmission': 'automatic',
'trim': 'advanced',
'year': 2024}
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07739%27 HTTP/1.1" 200 None
2026-03-29 18:46:29 [auto1.de] INFO: Saving data for PY07739: {'auction_closing_time': 1774885366.0, 'created_time': 1774553016.669868, 'last_price_update_time': 1774809989.768585}
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY07739') HTTP/1.1" 204 0
2026-03-29 18:46:29 [auto1.de] INFO: Found listing with ID: GZ99340
2026-03-29 18:46:29 [auto1.de] INFO: Found listing with ID: VL24807
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL24807%27 HTTP/1.1" 200 None
2026-03-29 18:46:29 [auto1.de] INFO: Scrape type for VL24807: 2
2026-03-29 18:46:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5710373-7d5f-5f2c-9026-e234d39ef950 with identifier: VL24807
2026-03-29 18:46:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5710373-7d5f-5f2c-9026-e234d39ef950 with scrape type 2
2026-03-29 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5710373-7d5f-5f2c-9026-e234d39ef950 with scrape type 2
2026-03-29 18:46:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5710373-7d5f-5f2c-9026-e234d39ef950, identifier: VL24807
2026-03-29 18:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5710373-7d5f-5f2c-9026-e234d39ef950 with identifier: VL24807
2026-03-29 18:46:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5710373-7d5f-5f2c-9026-e234d39ef950 with identifier: VL24807
2026-03-29 18:46:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5710373-7d5f-5f2c-9026-e234d39ef950 with identifier: VL24807 to the API
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:17:09Z',
'fuel_type': 'petrol',
'id': 'f5710373-7d5f-5f2c-9026-e234d39ef950',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL24807',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 89748,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-25',
'seller_name': None,
'title': 'Renault Clio 0.9 Energy Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2016}
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL24807%27 HTTP/1.1" 200 None
2026-03-29 18:46:30 [auto1.de] INFO: Saving data for VL24807: {'auction_closing_time': 1774883829.0, 'created_time': 1774723358.119605, 'last_price_update_time': 1774809990.167504}
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL24807') HTTP/1.1" 204 0
2026-03-29 18:46:30 [auto1.de] INFO: Found listing with ID: FB16153
2026-03-29 18:46:30 [auto1.de] INFO: Found listing with ID: AX69067
2026-03-29 18:46:30 [auto1.de] INFO: Found listing with ID: CM63557
2026-03-29 18:46:30 [auto1.de] INFO: Found listing with ID: YR62229
2026-03-29 18:46:30 [auto1.de] INFO: Found listing with ID: NF97550
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF97550%27 HTTP/1.1" 200 None
2026-03-29 18:46:30 [auto1.de] INFO: Scrape type for NF97550: 2
2026-03-29 18:46:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f97e4a1-8516-5cf7-9261-ea408182e0f5 with identifier: NF97550
2026-03-29 18:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f97e4a1-8516-5cf7-9261-ea408182e0f5 with scrape type 2
2026-03-29 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f97e4a1-8516-5cf7-9261-ea408182e0f5 with scrape type 2
2026-03-29 18:46:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f97e4a1-8516-5cf7-9261-ea408182e0f5, identifier: NF97550
2026-03-29 18:46:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f97e4a1-8516-5cf7-9261-ea408182e0f5 with identifier: NF97550
2026-03-29 18:46:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f97e4a1-8516-5cf7-9261-ea408182e0f5 with identifier: NF97550
2026-03-29 18:46:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f97e4a1-8516-5cf7-9261-ea408182e0f5 with identifier: NF97550 to the API
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:09:25Z',
'fuel_type': 'diesel',
'id': '7f97e4a1-8516-5cf7-9261-ea408182e0f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF97550',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 178730,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-26',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2015}
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF97550%27 HTTP/1.1" 200 None
2026-03-29 18:46:30 [auto1.de] INFO: Saving data for NF97550: {'auction_closing_time': 1774883365.0, 'created_time': 1773467300.581084, 'last_price_update_time': 1774809990.559753}
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF97550') HTTP/1.1" 204 0
2026-03-29 18:46:30 [auto1.de] INFO: Found listing with ID: AR94395
2026-03-29 18:46:30 [auto1.de] INFO: Found listing with ID: RF06599
2026-03-29 18:46:30 [auto1.de] INFO: Found listing with ID: AD51126
2026-03-29 18:46:30 [auto1.de] INFO: Found listing with ID: ZA82087
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA82087%27 HTTP/1.1" 200 None
2026-03-29 18:46:30 [auto1.de] INFO: Scrape type for ZA82087: 2
2026-03-29 18:46:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 672dea5c-fd7b-5e30-a78a-f2b09ea808ca with identifier: ZA82087
2026-03-29 18:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 672dea5c-fd7b-5e30-a78a-f2b09ea808ca with scrape type 2
2026-03-29 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 672dea5c-fd7b-5e30-a78a-f2b09ea808ca with scrape type 2
2026-03-29 18:46:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 672dea5c-fd7b-5e30-a78a-f2b09ea808ca, identifier: ZA82087
2026-03-29 18:46:30 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 672dea5c-fd7b-5e30-a78a-f2b09ea808ca with identifier: ZA82087
2026-03-29 18:46:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 672dea5c-fd7b-5e30-a78a-f2b09ea808ca with identifier: ZA82087
2026-03-29 18:46:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 672dea5c-fd7b-5e30-a78a-f2b09ea808ca with identifier: ZA82087 to the API
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:39:33Z',
'fuel_type': 'petrol',
'id': '672dea5c-fd7b-5e30-a78a-f2b09ea808ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA82087',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 116565,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-03',
'seller_name': None,
'title': 'Smart fortwo 1.0 Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2008}
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA82087%27 HTTP/1.1" 200 None
2026-03-29 18:46:31 [auto1.de] INFO: Saving data for ZA82087: {'auction_closing_time': 1774885173.0, 'created_time': 1774723358.570112, 'last_price_update_time': 1774809991.37832}
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA82087') HTTP/1.1" 204 0
2026-03-29 18:46:31 [auto1.de] INFO: Found listing with ID: PR51827
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR51827%27 HTTP/1.1" 200 None
2026-03-29 18:46:31 [auto1.de] INFO: Scrape type for PR51827: 2
2026-03-29 18:46:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b0fdc58-1b9d-5474-967b-307b14b4f1a2 with identifier: PR51827
2026-03-29 18:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2 with scrape type 2
2026-03-29 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2 with scrape type 2
2026-03-29 18:46:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b0fdc58-1b9d-5474-967b-307b14b4f1a2, identifier: PR51827
2026-03-29 18:46:31 [auto1.de] INFO: Found listing with ID: CM42106
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM42106%27 HTTP/1.1" 200 None
2026-03-29 18:46:31 [auto1.de] INFO: Scrape type for CM42106: 2
2026-03-29 18:46:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8d503b6-daeb-562a-9db6-a4711381220d with identifier: CM42106
2026-03-29 18:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8d503b6-daeb-562a-9db6-a4711381220d with scrape type 2
2026-03-29 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8d503b6-daeb-562a-9db6-a4711381220d with scrape type 2
2026-03-29 18:46:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8d503b6-daeb-562a-9db6-a4711381220d, identifier: CM42106
2026-03-29 18:46:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b0fdc58-1b9d-5474-967b-307b14b4f1a2 with identifier: PR51827
2026-03-29 18:46:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b0fdc58-1b9d-5474-967b-307b14b4f1a2 with identifier: PR51827
2026-03-29 18:46:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b0fdc58-1b9d-5474-967b-307b14b4f1a2 with identifier: PR51827 to the API
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:09:02Z',
'fuel_type': 'petrol',
'id': '5b0fdc58-1b9d-5474-967b-307b14b4f1a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR51827',
'listing': 'auction',
'make': 'Kia',
'model': 'Picanto',
'odometer': 81693,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-27',
'seller_name': None,
'title': 'Kia Picanto 1.2 GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2017}
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR51827%27 HTTP/1.1" 200 None
2026-03-29 18:46:32 [auto1.de] INFO: Saving data for PR51827: {'auction_closing_time': 1774883342.0, 'created_time': 1774723327.579233, 'last_price_update_time': 1774809992.003756}
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR51827') HTTP/1.1" 204 0
2026-03-29 18:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8d503b6-daeb-562a-9db6-a4711381220d with identifier: CM42106
2026-03-29 18:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8d503b6-daeb-562a-9db6-a4711381220d with identifier: CM42106
2026-03-29 18:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8d503b6-daeb-562a-9db6-a4711381220d with identifier: CM42106 to the API
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:53:49Z',
'fuel_type': 'petrol',
'id': 'd8d503b6-daeb-562a-9db6-a4711381220d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM42106',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'up!',
'odometer': 97518,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-04',
'seller_name': None,
'title': 'Volkswagen up! 1.0 Club up! BlueMotion Tech',
'transmission': 'manual',
'trim': 'Club BlueMotion Tech',
'year': 2015}
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM42106%27 HTTP/1.1" 200 None
2026-03-29 18:46:32 [auto1.de] INFO: Saving data for CM42106: {'auction_closing_time': 1774886029.0, 'created_time': 1774723327.180161, 'last_price_update_time': 1774809992.300067}
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM42106') HTTP/1.1" 204 0
2026-03-29 18:46:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:32 [auto1.de] INFO: Found listing with ID: KU26816
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU26816%27 HTTP/1.1" 200 None
2026-03-29 18:46:32 [auto1.de] INFO: Scrape type for KU26816: 2
2026-03-29 18:46:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e292d12-7c6c-5333-bf2e-44964d0c2734 with identifier: KU26816
2026-03-29 18:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e292d12-7c6c-5333-bf2e-44964d0c2734 with scrape type 2
2026-03-29 18:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e292d12-7c6c-5333-bf2e-44964d0c2734 with scrape type 2
2026-03-29 18:46:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e292d12-7c6c-5333-bf2e-44964d0c2734, identifier: KU26816
2026-03-29 18:46:32 [auto1.de] INFO: Found listing with ID: UP78086
2026-03-29 18:46:32 [auto1.de] INFO: Found listing with ID: WP34859
2026-03-29 18:46:32 [auto1.de] INFO: Found listing with ID: UR14680
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14680%27 HTTP/1.1" 200 None
2026-03-29 18:46:32 [auto1.de] INFO: Scrape type for UR14680: 2
2026-03-29 18:46:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 161c396b-4960-5d3c-b8b8-9c51300527f2 with identifier: UR14680
2026-03-29 18:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 161c396b-4960-5d3c-b8b8-9c51300527f2 with scrape type 2
2026-03-29 18:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 161c396b-4960-5d3c-b8b8-9c51300527f2 with scrape type 2
2026-03-29 18:46:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 161c396b-4960-5d3c-b8b8-9c51300527f2, identifier: UR14680
2026-03-29 18:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e292d12-7c6c-5333-bf2e-44964d0c2734 with identifier: KU26816
2026-03-29 18:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e292d12-7c6c-5333-bf2e-44964d0c2734 with identifier: KU26816
2026-03-29 18:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e292d12-7c6c-5333-bf2e-44964d0c2734 with identifier: KU26816 to the API
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:22:26Z',
'fuel_type': 'petrol',
'id': '3e292d12-7c6c-5333-bf2e-44964d0c2734',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU26816',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 102679,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-17',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 Edition 2020 AMG Line',
'transmission': 'manual',
'trim': 'Edition 2020 AMG Line',
'year': 2020}
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU26816%27 HTTP/1.1" 200 None
2026-03-29 18:46:32 [auto1.de] INFO: Saving data for KU26816: {'auction_closing_time': 1774884146.0, 'created_time': 1774723334.898942, 'last_price_update_time': 1774809992.816715}
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU26816') HTTP/1.1" 204 0
2026-03-29 18:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 161c396b-4960-5d3c-b8b8-9c51300527f2 with identifier: UR14680
2026-03-29 18:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 161c396b-4960-5d3c-b8b8-9c51300527f2 with identifier: UR14680
2026-03-29 18:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 161c396b-4960-5d3c-b8b8-9c51300527f2 with identifier: UR14680 to the API
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:53:49Z',
'fuel_type': 'petrol',
'id': '161c396b-4960-5d3c-b8b8-9c51300527f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR14680',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 63199,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-07',
'seller_name': None,
'title': 'Suzuki Swift 1.2 X-TRA',
'transmission': 'manual',
'trim': 'X-TRA',
'year': 2017}
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14680%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Saving data for UR14680: {'auction_closing_time': 1774886029.0, 'created_time': 1774033898.900501, 'last_price_update_time': 1774809993.11938}
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR14680') HTTP/1.1" 204 0
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: LD78650
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: KB26549
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: VL06986
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: WB94106
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: ZP72952
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: JS00894
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: GZ33681
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ33681%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Scrape type for GZ33681: 2
2026-03-29 18:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40315824-4e52-538b-a3c2-077ef297edf1 with identifier: GZ33681
2026-03-29 18:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40315824-4e52-538b-a3c2-077ef297edf1 with scrape type 2
2026-03-29 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40315824-4e52-538b-a3c2-077ef297edf1 with scrape type 2
2026-03-29 18:46:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40315824-4e52-538b-a3c2-077ef297edf1, identifier: GZ33681
2026-03-29 18:46:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40315824-4e52-538b-a3c2-077ef297edf1 with identifier: GZ33681
2026-03-29 18:46:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40315824-4e52-538b-a3c2-077ef297edf1 with identifier: GZ33681
2026-03-29 18:46:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40315824-4e52-538b-a3c2-077ef297edf1 with identifier: GZ33681 to the API
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:55:31Z',
'fuel_type': 'petrol',
'id': '40315824-4e52-538b-a3c2-077ef297edf1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ33681',
'listing': 'auction',
'make': 'Dacia',
'model': 'Dokker',
'odometer': 80562,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-05',
'seller_name': None,
'title': 'Dacia Dokker 1.2 TCe Stepway',
'transmission': 'manual',
'trim': 'Stepway',
'year': 2019}
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ33681%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Saving data for GZ33681: {'auction_closing_time': 1774886131.0, 'created_time': 1774723344.267802, 'last_price_update_time': 1774809993.535314}
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ33681') HTTP/1.1" 204 0
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: KE41699
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: WH78013
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: GL25834
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: AB16604
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: PM83477
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: XE10609
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: XT67395
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67395%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Scrape type for XT67395: 2
2026-03-29 18:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc5294da-b9cb-59c1-919c-9204164e6ed4 with identifier: XT67395
2026-03-29 18:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc5294da-b9cb-59c1-919c-9204164e6ed4 with scrape type 2
2026-03-29 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc5294da-b9cb-59c1-919c-9204164e6ed4 with scrape type 2
2026-03-29 18:46:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc5294da-b9cb-59c1-919c-9204164e6ed4, identifier: XT67395
2026-03-29 18:46:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc5294da-b9cb-59c1-919c-9204164e6ed4 with identifier: XT67395
2026-03-29 18:46:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc5294da-b9cb-59c1-919c-9204164e6ed4 with identifier: XT67395
2026-03-29 18:46:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc5294da-b9cb-59c1-919c-9204164e6ed4 with identifier: XT67395 to the API
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:58:23Z',
'fuel_type': 'petrol',
'id': 'fc5294da-b9cb-59c1-919c-9204164e6ed4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT67395',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 53227,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-30',
'seller_name': None,
'title': 'Seat Ateca 1.5 TSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2022}
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67395%27 HTTP/1.1" 200 None
2026-03-29 18:46:34 [auto1.de] INFO: Saving data for XT67395: {'auction_closing_time': 1774886303.0, 'created_time': 1774034140.079845, 'last_price_update_time': 1774809994.092676}
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT67395') HTTP/1.1" 204 0
2026-03-29 18:46:34 [auto1.de] INFO: Found listing with ID: XT85364
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT85364%27 HTTP/1.1" 200 None
2026-03-29 18:46:34 [auto1.de] INFO: Scrape type for XT85364: 2
2026-03-29 18:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3 with identifier: XT85364
2026-03-29 18:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3 with scrape type 2
2026-03-29 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3 with scrape type 2
2026-03-29 18:46:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3, identifier: XT85364
2026-03-29 18:46:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3 with identifier: XT85364
2026-03-29 18:46:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3 with identifier: XT85364
2026-03-29 18:46:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3 with identifier: XT85364 to the API
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:48:47Z',
'fuel_type': 'petrol',
'id': '7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT85364',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 91279,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-31',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TFSI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2017}
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT85364%27 HTTP/1.1" 200 None
2026-03-29 18:46:34 [auto1.de] INFO: Saving data for XT85364: {'auction_closing_time': 1774885727.0, 'created_time': 1774723324.909824, 'last_price_update_time': 1774809994.5163}
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT85364') HTTP/1.1" 204 0
2026-03-29 18:46:34 [auto1.de] INFO: Found listing with ID: AU58197
2026-03-29 18:46:34 [auto1.de] INFO: Found listing with ID: KJ39198
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ39198%27 HTTP/1.1" 200 None
2026-03-29 18:46:34 [auto1.de] INFO: Scrape type for KJ39198: 2
2026-03-29 18:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3af1b4a5-7f64-5c5c-a306-80508b5fa393 with identifier: KJ39198
2026-03-29 18:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3af1b4a5-7f64-5c5c-a306-80508b5fa393 with scrape type 2
2026-03-29 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3af1b4a5-7f64-5c5c-a306-80508b5fa393 with scrape type 2
2026-03-29 18:46:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3af1b4a5-7f64-5c5c-a306-80508b5fa393, identifier: KJ39198
2026-03-29 18:46:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3af1b4a5-7f64-5c5c-a306-80508b5fa393 with identifier: KJ39198
2026-03-29 18:46:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3af1b4a5-7f64-5c5c-a306-80508b5fa393 with identifier: KJ39198
2026-03-29 18:46:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3af1b4a5-7f64-5c5c-a306-80508b5fa393 with identifier: KJ39198 to the API
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:49:49Z',
'fuel_type': 'diesel',
'id': '3af1b4a5-7f64-5c5c-a306-80508b5fa393',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ39198',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 248634,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-02',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 280 CDI T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2008}
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ39198%27 HTTP/1.1" 200 None
2026-03-29 18:46:34 [auto1.de] INFO: Saving data for KJ39198: {'auction_closing_time': 1774885789.0, 'created_time': 1774723324.237907, 'last_price_update_time': 1774809994.931647}
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ39198') HTTP/1.1" 204 0
2026-03-29 18:46:34 [auto1.de] INFO: Found listing with ID: ED37424
2026-03-29 18:46:34 [auto1.de] INFO: Found listing with ID: HP09567
2026-03-29 18:46:34 [auto1.de] INFO: Found listing with ID: EX55373
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX55373%27 HTTP/1.1" 200 None
2026-03-29 18:46:34 [auto1.de] INFO: Scrape type for EX55373: 2
2026-03-29 18:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f7c74a2-f962-54a2-a368-59e4fe976b52 with identifier: EX55373
2026-03-29 18:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7c74a2-f962-54a2-a368-59e4fe976b52 with scrape type 2
2026-03-29 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f7c74a2-f962-54a2-a368-59e4fe976b52 with scrape type 2
2026-03-29 18:46:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f7c74a2-f962-54a2-a368-59e4fe976b52, identifier: EX55373
2026-03-29 18:46:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f7c74a2-f962-54a2-a368-59e4fe976b52 with identifier: EX55373
2026-03-29 18:46:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f7c74a2-f962-54a2-a368-59e4fe976b52 with identifier: EX55373
2026-03-29 18:46:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f7c74a2-f962-54a2-a368-59e4fe976b52 with identifier: EX55373 to the API
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 355,
'expiration_date': '2026-03-30T15:40:30Z',
'fuel_type': 'petrol',
'id': '6f7c74a2-f962-54a2-a368-59e4fe976b52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX55373',
'listing': 'auction',
'make': 'Audi',
'model': 'S4',
'odometer': 59322,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-11',
'seller_name': None,
'title': 'Audi S4 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2016}
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX55373%27 HTTP/1.1" 200 None
2026-03-29 18:46:35 [auto1.de] INFO: Saving data for EX55373: {'auction_closing_time': 1774885230.0, 'created_time': 1774723330.009421, 'last_price_update_time': 1774809995.348542}
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX55373') HTTP/1.1" 204 0
2026-03-29 18:46:35 [auto1.de] INFO: Found listing with ID: BN44220
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN44220%27 HTTP/1.1" 200 None
2026-03-29 18:46:35 [auto1.de] INFO: Scrape type for BN44220: 2
2026-03-29 18:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 813336d6-1e43-5e3e-8824-86d8b9a5f8b4 with identifier: BN44220
2026-03-29 18:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4 with scrape type 2
2026-03-29 18:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4 with scrape type 2
2026-03-29 18:46:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 813336d6-1e43-5e3e-8824-86d8b9a5f8b4, identifier: BN44220
2026-03-29 18:46:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 813336d6-1e43-5e3e-8824-86d8b9a5f8b4 with identifier: BN44220
2026-03-29 18:46:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 813336d6-1e43-5e3e-8824-86d8b9a5f8b4 with identifier: BN44220
2026-03-29 18:46:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 813336d6-1e43-5e3e-8824-86d8b9a5f8b4 with identifier: BN44220 to the API
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:37:39Z',
'fuel_type': 'diesel',
'id': '813336d6-1e43-5e3e-8824-86d8b9a5f8b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN44220',
'listing': 'auction',
'make': 'Kia',
'model': 'Carens',
'odometer': 106566,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-31',
'seller_name': None,
'title': 'Kia Carens 1.7 CRDi Spirit',
'transmission': 'manual',
'trim': 'Spirit',
'year': 2016}
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN44220%27 HTTP/1.1" 200 None
2026-03-29 18:46:35 [auto1.de] INFO: Saving data for BN44220: {'auction_closing_time': 1774885059.0, 'created_time': 1774723320.613252, 'last_price_update_time': 1774809995.835616}
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN44220') HTTP/1.1" 204 0
2026-03-29 18:46:35 [auto1.de] INFO: Found listing with ID: YV25001
2026-03-29 18:46:35 [auto1.de] INFO: Found listing with ID: DF34301
2026-03-29 18:46:35 [auto1.de] INFO: Found listing with ID: KT60539
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60539%27 HTTP/1.1" 200 None
2026-03-29 18:46:35 [auto1.de] INFO: Scrape type for KT60539: 2
2026-03-29 18:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13fe999f-d980-5b0c-918f-8c224e9e66ac with identifier: KT60539
2026-03-29 18:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13fe999f-d980-5b0c-918f-8c224e9e66ac with scrape type 2
2026-03-29 18:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13fe999f-d980-5b0c-918f-8c224e9e66ac with scrape type 2
2026-03-29 18:46:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13fe999f-d980-5b0c-918f-8c224e9e66ac, identifier: KT60539
2026-03-29 18:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13fe999f-d980-5b0c-918f-8c224e9e66ac with identifier: KT60539
2026-03-29 18:46:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13fe999f-d980-5b0c-918f-8c224e9e66ac with identifier: KT60539
2026-03-29 18:46:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13fe999f-d980-5b0c-918f-8c224e9e66ac with identifier: KT60539 to the API
2026-03-29 18:46:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:13:09Z',
'fuel_type': 'petrol',
'id': '13fe999f-d980-5b0c-918f-8c224e9e66ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT60539',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Jetta',
'odometer': 94822,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-13',
'seller_name': None,
'title': 'Volkswagen Jetta 1.2 TSI Match BlueMotion',
'transmission': 'manual',
'trim': 'Match BlueMotion',
'year': 2012}
2026-03-29 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60539%27 HTTP/1.1" 200 None
2026-03-29 18:46:36 [auto1.de] INFO: Saving data for KT60539: {'auction_closing_time': 1774883589.0, 'created_time': 1774723359.405121, 'last_price_update_time': 1774809996.973652}
2026-03-29 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT60539') HTTP/1.1" 204 0
2026-03-29 18:46:36 [auto1.de] INFO: Found listing with ID: VA98416
2026-03-29 18:46:36 [auto1.de] INFO: Found listing with ID: JM65569
2026-03-29 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM65569%27 HTTP/1.1" 200 None
2026-03-29 18:46:37 [auto1.de] INFO: Scrape type for JM65569: 2
2026-03-29 18:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17b58079-2060-5ffb-b0cd-6c9b7f790662 with identifier: JM65569
2026-03-29 18:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17b58079-2060-5ffb-b0cd-6c9b7f790662 with scrape type 2
2026-03-29 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17b58079-2060-5ffb-b0cd-6c9b7f790662 with scrape type 2
2026-03-29 18:46:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17b58079-2060-5ffb-b0cd-6c9b7f790662, identifier: JM65569
2026-03-29 18:46:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17b58079-2060-5ffb-b0cd-6c9b7f790662 with identifier: JM65569
2026-03-29 18:46:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17b58079-2060-5ffb-b0cd-6c9b7f790662 with identifier: JM65569
2026-03-29 18:46:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17b58079-2060-5ffb-b0cd-6c9b7f790662 with identifier: JM65569 to the API
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 97,
'expiration_date': '2026-03-30T15:28:22Z',
'fuel_type': 'petrol',
'id': '17b58079-2060-5ffb-b0cd-6c9b7f790662',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM65569',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 87103,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-20',
'seller_name': None,
'title': 'Ford Fiesta 1.4 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2010}
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM65569%27 HTTP/1.1" 200 None
2026-03-29 18:46:37 [auto1.de] INFO: Saving data for JM65569: {'auction_closing_time': 1774884502.0, 'created_time': 1774723346.031425, 'last_price_update_time': 1774809997.511417}
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM65569') HTTP/1.1" 204 0
2026-03-29 18:46:37 [auto1.de] INFO: Found listing with ID: LX23482
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX23482%27 HTTP/1.1" 200 None
2026-03-29 18:46:37 [auto1.de] INFO: Scrape type for LX23482: 2
2026-03-29 18:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da906c4b-3b74-5349-83dd-90bdb06913c8 with identifier: LX23482
2026-03-29 18:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da906c4b-3b74-5349-83dd-90bdb06913c8 with scrape type 2
2026-03-29 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da906c4b-3b74-5349-83dd-90bdb06913c8 with scrape type 2
2026-03-29 18:46:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da906c4b-3b74-5349-83dd-90bdb06913c8, identifier: LX23482
2026-03-29 18:46:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da906c4b-3b74-5349-83dd-90bdb06913c8 with identifier: LX23482
2026-03-29 18:46:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da906c4b-3b74-5349-83dd-90bdb06913c8 with identifier: LX23482
2026-03-29 18:46:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da906c4b-3b74-5349-83dd-90bdb06913c8 with identifier: LX23482 to the API
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:06:38Z',
'fuel_type': 'diesel',
'id': 'da906c4b-3b74-5349-83dd-90bdb06913c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX23482',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 191787,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-02',
'seller_name': None,
'title': 'BMW 5er 520d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX23482%27 HTTP/1.1" 200 None
2026-03-29 18:46:37 [auto1.de] INFO: Saving data for LX23482: {'auction_closing_time': 1774883198.0, 'created_time': 1774032325.481548, 'last_price_update_time': 1774809997.934322}
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX23482') HTTP/1.1" 204 0
2026-03-29 18:46:37 [auto1.de] INFO: Found listing with ID: RS04004
2026-03-29 18:46:37 [auto1.de] INFO: Found listing with ID: KC29293
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC29293%27 HTTP/1.1" 200 None
2026-03-29 18:46:37 [auto1.de] INFO: Scrape type for KC29293: 2
2026-03-29 18:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70083eab-e53b-54ac-8b5d-27b9b357742d with identifier: KC29293
2026-03-29 18:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70083eab-e53b-54ac-8b5d-27b9b357742d with scrape type 2
2026-03-29 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70083eab-e53b-54ac-8b5d-27b9b357742d with scrape type 2
2026-03-29 18:46:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70083eab-e53b-54ac-8b5d-27b9b357742d, identifier: KC29293
2026-03-29 18:46:38 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70083eab-e53b-54ac-8b5d-27b9b357742d with identifier: KC29293
2026-03-29 18:46:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70083eab-e53b-54ac-8b5d-27b9b357742d with identifier: KC29293
2026-03-29 18:46:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70083eab-e53b-54ac-8b5d-27b9b357742d with identifier: KC29293 to the API
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:18:18Z',
'fuel_type': 'petrol',
'id': '70083eab-e53b-54ac-8b5d-27b9b357742d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC29293',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'MiTo',
'odometer': 124060,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-11-02',
'seller_name': None,
'title': 'Alfa Romeo MiTo 1.4 Turismo',
'transmission': 'manual',
'trim': 'Turismo',
'year': 2009}
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC29293%27 HTTP/1.1" 200 None
2026-03-29 18:46:38 [auto1.de] INFO: Saving data for KC29293: {'auction_closing_time': 1774883898.0, 'created_time': 1774723341.031666, 'last_price_update_time': 1774809998.42877}
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC29293') HTTP/1.1" 204 0
2026-03-29 18:46:38 [auto1.de] INFO: Found listing with ID: EP86808
2026-03-29 18:46:38 [auto1.de] INFO: Found listing with ID: YA04256
2026-03-29 18:46:38 [auto1.de] INFO: Found listing with ID: WS15050
2026-03-29 18:46:38 [auto1.de] INFO: Found listing with ID: HM10485
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10485%27 HTTP/1.1" 200 None
2026-03-29 18:46:38 [auto1.de] INFO: Scrape type for HM10485: 2
2026-03-29 18:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7641d199-36f9-5945-9967-f210baa6f265 with identifier: HM10485
2026-03-29 18:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7641d199-36f9-5945-9967-f210baa6f265 with scrape type 2
2026-03-29 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7641d199-36f9-5945-9967-f210baa6f265 with scrape type 2
2026-03-29 18:46:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7641d199-36f9-5945-9967-f210baa6f265, identifier: HM10485
2026-03-29 18:46:38 [auto1.de] INFO: Found listing with ID: MV07839
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV07839%27 HTTP/1.1" 200 None
2026-03-29 18:46:38 [auto1.de] INFO: Scrape type for MV07839: 2
2026-03-29 18:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ca3482f-5fdd-559a-8364-77b4a0037042 with identifier: MV07839
2026-03-29 18:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ca3482f-5fdd-559a-8364-77b4a0037042 with scrape type 2
2026-03-29 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ca3482f-5fdd-559a-8364-77b4a0037042 with scrape type 2
2026-03-29 18:46:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ca3482f-5fdd-559a-8364-77b4a0037042, identifier: MV07839
2026-03-29 18:46:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7641d199-36f9-5945-9967-f210baa6f265 with identifier: HM10485
2026-03-29 18:46:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7641d199-36f9-5945-9967-f210baa6f265 with identifier: HM10485
2026-03-29 18:46:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7641d199-36f9-5945-9967-f210baa6f265 with identifier: HM10485 to the API
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:54:18Z',
'fuel_type': 'diesel',
'id': '7641d199-36f9-5945-9967-f210baa6f265',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM10485',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 359248,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-04',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2011}
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10485%27 HTTP/1.1" 200 None
2026-03-29 18:46:38 [auto1.de] INFO: Saving data for HM10485: {'auction_closing_time': 1774886058.0, 'created_time': 1774723335.609718, 'last_price_update_time': 1774809998.953169}
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM10485') HTTP/1.1" 204 0
2026-03-29 18:46:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ca3482f-5fdd-559a-8364-77b4a0037042 with identifier: MV07839
2026-03-29 18:46:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ca3482f-5fdd-559a-8364-77b4a0037042 with identifier: MV07839
2026-03-29 18:46:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ca3482f-5fdd-559a-8364-77b4a0037042 with identifier: MV07839 to the API
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:13:28Z',
'fuel_type': 'diesel',
'id': '6ca3482f-5fdd-559a-8364-77b4a0037042',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV07839',
'listing': 'auction',
'make': 'Audi',
'model': 'SQ5',
'odometer': 173220,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-26',
'seller_name': None,
'title': 'Audi SQ5 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2014}
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV07839%27 HTTP/1.1" 200 None
2026-03-29 18:46:39 [auto1.de] INFO: Saving data for MV07839: {'auction_closing_time': 1774883608.0, 'created_time': 1773427143.133777, 'last_price_update_time': 1774809999.358062}
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV07839') HTTP/1.1" 204 0
2026-03-29 18:46:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:39 [auto1.de] INFO: Found listing with ID: GZ74020
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ74020%27 HTTP/1.1" 200 None
2026-03-29 18:46:39 [auto1.de] INFO: Scrape type for GZ74020: 2
2026-03-29 18:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a468438a-4dec-5f5a-892f-8210f599ecc3 with identifier: GZ74020
2026-03-29 18:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a468438a-4dec-5f5a-892f-8210f599ecc3 with scrape type 2
2026-03-29 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a468438a-4dec-5f5a-892f-8210f599ecc3 with scrape type 2
2026-03-29 18:46:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a468438a-4dec-5f5a-892f-8210f599ecc3, identifier: GZ74020
2026-03-29 18:46:39 [auto1.de] INFO: Found listing with ID: YR28195
2026-03-29 18:46:39 [auto1.de] INFO: Found listing with ID: AW19440
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW19440%27 HTTP/1.1" 200 None
2026-03-29 18:46:39 [auto1.de] INFO: Scrape type for AW19440: 2
2026-03-29 18:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 776fe438-d8b0-541c-bf45-929e52bcf37e with identifier: AW19440
2026-03-29 18:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 776fe438-d8b0-541c-bf45-929e52bcf37e with scrape type 2
2026-03-29 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 776fe438-d8b0-541c-bf45-929e52bcf37e with scrape type 2
2026-03-29 18:46:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 776fe438-d8b0-541c-bf45-929e52bcf37e, identifier: AW19440
2026-03-29 18:46:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a468438a-4dec-5f5a-892f-8210f599ecc3 with identifier: GZ74020
2026-03-29 18:46:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a468438a-4dec-5f5a-892f-8210f599ecc3 with identifier: GZ74020
2026-03-29 18:46:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a468438a-4dec-5f5a-892f-8210f599ecc3 with identifier: GZ74020 to the API
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:00:00Z',
'fuel_type': 'petrol',
'id': 'a468438a-4dec-5f5a-892f-8210f599ecc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ74020',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 86721,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-27',
'seller_name': None,
'title': 'Toyota Aygo 1.0 Cool',
'transmission': 'manual',
'trim': 'Cool',
'year': 2012}
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ74020%27 HTTP/1.1" 200 None
2026-03-29 18:46:39 [auto1.de] INFO: Saving data for GZ74020: {'auction_closing_time': 1774882800.0, 'created_time': 1774723341.477084, 'last_price_update_time': 1774809999.897265}
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ74020') HTTP/1.1" 204 0
2026-03-29 18:46:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 776fe438-d8b0-541c-bf45-929e52bcf37e with identifier: AW19440
2026-03-29 18:46:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 776fe438-d8b0-541c-bf45-929e52bcf37e with identifier: AW19440
2026-03-29 18:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 776fe438-d8b0-541c-bf45-929e52bcf37e with identifier: AW19440 to the API
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:20:50Z',
'fuel_type': 'petrol',
'id': '776fe438-d8b0-541c-bf45-929e52bcf37e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW19440',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 76816,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-22',
'seller_name': None,
'title': 'Hyundai i10 1.2 Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2014}
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW19440%27 HTTP/1.1" 200 None
2026-03-29 18:46:40 [auto1.de] INFO: Saving data for AW19440: {'auction_closing_time': 1774884050.0, 'created_time': 1774723328.43353, 'last_price_update_time': 1774810000.314235}
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW19440') HTTP/1.1" 204 0
2026-03-29 18:46:40 [auto1.de] INFO: Found listing with ID: HZ02763
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ02763%27 HTTP/1.1" 200 None
2026-03-29 18:46:40 [auto1.de] INFO: Scrape type for HZ02763: 2
2026-03-29 18:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfb38d6d-6628-5fba-8862-5115ad13eca4 with identifier: HZ02763
2026-03-29 18:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfb38d6d-6628-5fba-8862-5115ad13eca4 with scrape type 2
2026-03-29 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfb38d6d-6628-5fba-8862-5115ad13eca4 with scrape type 2
2026-03-29 18:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfb38d6d-6628-5fba-8862-5115ad13eca4, identifier: HZ02763
2026-03-29 18:46:40 [auto1.de] INFO: Found listing with ID: DG41556
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG41556%27 HTTP/1.1" 200 None
2026-03-29 18:46:40 [auto1.de] INFO: Scrape type for DG41556: 2
2026-03-29 18:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c319f9a-0510-5652-bedf-1c6f9351daf0 with identifier: DG41556
2026-03-29 18:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c319f9a-0510-5652-bedf-1c6f9351daf0 with scrape type 2
2026-03-29 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c319f9a-0510-5652-bedf-1c6f9351daf0 with scrape type 2
2026-03-29 18:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c319f9a-0510-5652-bedf-1c6f9351daf0, identifier: DG41556
2026-03-29 18:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfb38d6d-6628-5fba-8862-5115ad13eca4 with identifier: HZ02763
2026-03-29 18:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfb38d6d-6628-5fba-8862-5115ad13eca4 with identifier: HZ02763
2026-03-29 18:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfb38d6d-6628-5fba-8862-5115ad13eca4 with identifier: HZ02763 to the API
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:59:24Z',
'fuel_type': 'petrol',
'id': 'dfb38d6d-6628-5fba-8862-5115ad13eca4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ02763',
'listing': 'auction',
'make': 'Skoda',
'model': 'Roomster',
'odometer': 196230,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-02',
'seller_name': None,
'title': 'Skoda Roomster 1.2 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2014}
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ02763%27 HTTP/1.1" 200 None
2026-03-29 18:46:40 [auto1.de] INFO: Saving data for HZ02763: {'auction_closing_time': 1774886364.0, 'created_time': 1774349197.053292, 'last_price_update_time': 1774810000.830703}
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ02763') HTTP/1.1" 204 0
2026-03-29 18:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c319f9a-0510-5652-bedf-1c6f9351daf0 with identifier: DG41556
2026-03-29 18:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c319f9a-0510-5652-bedf-1c6f9351daf0 with identifier: DG41556
2026-03-29 18:46:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c319f9a-0510-5652-bedf-1c6f9351daf0 with identifier: DG41556 to the API
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:29:09Z',
'fuel_type': 'hybrid',
'id': '3c319f9a-0510-5652-bedf-1c6f9351daf0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG41556',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 129013,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-10',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 300e T',
'transmission': 'automatic',
'trim': 'T',
'year': 2022}
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG41556%27 HTTP/1.1" 200 None
2026-03-29 18:46:41 [auto1.de] INFO: Saving data for DG41556: {'auction_closing_time': 1774884549.0, 'created_time': 1774723326.72066, 'last_price_update_time': 1774810001.197634}
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG41556') HTTP/1.1" 204 0
2026-03-29 18:46:41 [auto1.de] INFO: Found listing with ID: KZ16493
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ16493%27 HTTP/1.1" 200 None
2026-03-29 18:46:41 [auto1.de] INFO: Scrape type for KZ16493: 2
2026-03-29 18:46:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3855e2ae-6a92-5d23-9ec3-f0aebdc25983 with identifier: KZ16493
2026-03-29 18:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3855e2ae-6a92-5d23-9ec3-f0aebdc25983 with scrape type 2
2026-03-29 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3855e2ae-6a92-5d23-9ec3-f0aebdc25983 with scrape type 2
2026-03-29 18:46:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3855e2ae-6a92-5d23-9ec3-f0aebdc25983, identifier: KZ16493
2026-03-29 18:46:41 [auto1.de] INFO: Found listing with ID: SR75246
2026-03-29 18:46:41 [auto1.de] INFO: Found listing with ID: HU15676
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU15676%27 HTTP/1.1" 200 None
2026-03-29 18:46:41 [auto1.de] INFO: Scrape type for HU15676: 2
2026-03-29 18:46:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b1eaee-f224-5986-b97d-5ef427717390 with identifier: HU15676
2026-03-29 18:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b1eaee-f224-5986-b97d-5ef427717390 with scrape type 2
2026-03-29 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9b1eaee-f224-5986-b97d-5ef427717390 with scrape type 2
2026-03-29 18:46:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9b1eaee-f224-5986-b97d-5ef427717390, identifier: HU15676
2026-03-29 18:46:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3855e2ae-6a92-5d23-9ec3-f0aebdc25983 with identifier: KZ16493
2026-03-29 18:46:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3855e2ae-6a92-5d23-9ec3-f0aebdc25983 with identifier: KZ16493
2026-03-29 18:46:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3855e2ae-6a92-5d23-9ec3-f0aebdc25983 with identifier: KZ16493 to the API
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:46:09Z',
'fuel_type': 'petrol',
'id': '3855e2ae-6a92-5d23-9ec3-f0aebdc25983',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ16493',
'listing': 'auction',
'make': 'BMW',
'model': 'Z4',
'odometer': 40177,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-18',
'seller_name': None,
'title': 'BMW Z4 M40i',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ16493%27 HTTP/1.1" 200 None
2026-03-29 18:46:41 [auto1.de] INFO: Saving data for KZ16493: {'auction_closing_time': 1774885569.0, 'created_time': 1774723334.11704, 'last_price_update_time': 1774810001.719815}
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ16493') HTTP/1.1" 204 0
2026-03-29 18:46:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9b1eaee-f224-5986-b97d-5ef427717390 with identifier: HU15676
2026-03-29 18:46:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9b1eaee-f224-5986-b97d-5ef427717390 with identifier: HU15676
2026-03-29 18:46:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9b1eaee-f224-5986-b97d-5ef427717390 with identifier: HU15676 to the API
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:43:32Z',
'fuel_type': 'diesel',
'id': 'a9b1eaee-f224-5986-b97d-5ef427717390',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU15676',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 224416,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-24',
'seller_name': None,
'title': 'Volvo XC60 2.0 D4 R-Design 2WD',
'transmission': 'automatic',
'trim': 'R-Design 2WD',
'year': 2020}
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU15676%27 HTTP/1.1" 200 None
2026-03-29 18:46:42 [auto1.de] INFO: Saving data for HU15676: {'auction_closing_time': 1774885412.0, 'created_time': 1774723322.158177, 'last_price_update_time': 1774810002.0077}
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU15676') HTTP/1.1" 204 0
2026-03-29 18:46:42 [auto1.de] INFO: Found listing with ID: UN41694
2026-03-29 18:46:42 [auto1.de] INFO: Found listing with ID: DF05561
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF05561%27 HTTP/1.1" 200 None
2026-03-29 18:46:42 [auto1.de] INFO: Scrape type for DF05561: 2
2026-03-29 18:46:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 411fe958-50ae-53c8-9bcf-3bc8bf92affa with identifier: DF05561
2026-03-29 18:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 411fe958-50ae-53c8-9bcf-3bc8bf92affa with scrape type 2
2026-03-29 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 411fe958-50ae-53c8-9bcf-3bc8bf92affa with scrape type 2
2026-03-29 18:46:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 411fe958-50ae-53c8-9bcf-3bc8bf92affa, identifier: DF05561
2026-03-29 18:46:42 [auto1.de] INFO: Found listing with ID: SV56483
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV56483%27 HTTP/1.1" 200 None
2026-03-29 18:46:42 [auto1.de] INFO: Scrape type for SV56483: 2
2026-03-29 18:46:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 570a6cf2-3d36-548d-a588-b304d6f8cec9 with identifier: SV56483
2026-03-29 18:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 570a6cf2-3d36-548d-a588-b304d6f8cec9 with scrape type 2
2026-03-29 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 570a6cf2-3d36-548d-a588-b304d6f8cec9 with scrape type 2
2026-03-29 18:46:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 570a6cf2-3d36-548d-a588-b304d6f8cec9, identifier: SV56483
2026-03-29 18:46:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 411fe958-50ae-53c8-9bcf-3bc8bf92affa with identifier: DF05561
2026-03-29 18:46:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 411fe958-50ae-53c8-9bcf-3bc8bf92affa with identifier: DF05561
2026-03-29 18:46:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 411fe958-50ae-53c8-9bcf-3bc8bf92affa with identifier: DF05561 to the API
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:38:58Z',
'fuel_type': 'diesel',
'id': '411fe958-50ae-53c8-9bcf-3bc8bf92affa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF05561',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 124221,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-18',
'seller_name': None,
'title': 'Fiat 500X 2.0 Multijet Cross Plus',
'transmission': 'manual',
'trim': 'Cross Plus',
'year': 2015}
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF05561%27 HTTP/1.1" 200 None
2026-03-29 18:46:42 [auto1.de] INFO: Saving data for DF05561: {'auction_closing_time': 1774885138.0, 'created_time': 1774033862.356982, 'last_price_update_time': 1774810002.512945}
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF05561') HTTP/1.1" 204 0
2026-03-29 18:46:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 570a6cf2-3d36-548d-a588-b304d6f8cec9 with identifier: SV56483
2026-03-29 18:46:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 570a6cf2-3d36-548d-a588-b304d6f8cec9 with identifier: SV56483
2026-03-29 18:46:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 570a6cf2-3d36-548d-a588-b304d6f8cec9 with identifier: SV56483 to the API
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 145,
'expiration_date': '2026-03-30T15:12:39Z',
'fuel_type': 'diesel',
'id': '570a6cf2-3d36-548d-a588-b304d6f8cec9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV56483',
'listing': 'auction',
'make': 'Fiat',
'model': 'Talento',
'odometer': 105542,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-15',
'seller_name': None,
'title': 'Fiat Talento 2.0 TwinTurbo Diesel Ecojet L1H1 1,0t Family',
'transmission': 'manual',
'trim': 'L1H1 1,0t Family',
'year': 2020}
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV56483%27 HTTP/1.1" 200 None
2026-03-29 18:46:42 [auto1.de] INFO: Saving data for SV56483: {'auction_closing_time': 1774883559.0, 'created_time': 1773426951.889034, 'last_price_update_time': 1774810002.938423}
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV56483') HTTP/1.1" 204 0
2026-03-29 18:46:42 [auto1.de] INFO: Found listing with ID: GK39429
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK39429%27 HTTP/1.1" 200 None
2026-03-29 18:46:42 [auto1.de] INFO: Scrape type for GK39429: 2
2026-03-29 18:46:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 001744d9-d648-5516-96cb-92e98eaff057 with identifier: GK39429
2026-03-29 18:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 001744d9-d648-5516-96cb-92e98eaff057 with scrape type 2
2026-03-29 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 001744d9-d648-5516-96cb-92e98eaff057 with scrape type 2
2026-03-29 18:46:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 001744d9-d648-5516-96cb-92e98eaff057, identifier: GK39429
2026-03-29 18:46:43 [auto1.de] INFO: Found listing with ID: ZM61762
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM61762%27 HTTP/1.1" 200 None
2026-03-29 18:46:43 [auto1.de] INFO: Scrape type for ZM61762: 2
2026-03-29 18:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 245a47b7-5b3c-586b-a757-43fc46cd59ed with identifier: ZM61762
2026-03-29 18:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 245a47b7-5b3c-586b-a757-43fc46cd59ed with scrape type 2
2026-03-29 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 245a47b7-5b3c-586b-a757-43fc46cd59ed with scrape type 2
2026-03-29 18:46:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 245a47b7-5b3c-586b-a757-43fc46cd59ed, identifier: ZM61762
2026-03-29 18:46:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 001744d9-d648-5516-96cb-92e98eaff057 with identifier: GK39429
2026-03-29 18:46:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 001744d9-d648-5516-96cb-92e98eaff057 with identifier: GK39429
2026-03-29 18:46:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 001744d9-d648-5516-96cb-92e98eaff057 with identifier: GK39429 to the API
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:16:40Z',
'fuel_type': 'diesel',
'id': '001744d9-d648-5516-96cb-92e98eaff057',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK39429',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 111702,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-22',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK39429%27 HTTP/1.1" 200 None
2026-03-29 18:46:43 [auto1.de] INFO: Saving data for GK39429: {'auction_closing_time': 1774883800.0, 'created_time': 1774723316.156469, 'last_price_update_time': 1774810003.485725}
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK39429') HTTP/1.1" 204 0
2026-03-29 18:46:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 245a47b7-5b3c-586b-a757-43fc46cd59ed with identifier: ZM61762
2026-03-29 18:46:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 245a47b7-5b3c-586b-a757-43fc46cd59ed with identifier: ZM61762
2026-03-29 18:46:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 245a47b7-5b3c-586b-a757-43fc46cd59ed with identifier: ZM61762 to the API
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:53:54Z',
'fuel_type': 'petrol',
'id': '245a47b7-5b3c-586b-a757-43fc46cd59ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM61762',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 74622,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-31',
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM61762%27 HTTP/1.1" 200 None
2026-03-29 18:46:43 [auto1.de] INFO: Saving data for ZM61762: {'auction_closing_time': 1774886034.0, 'created_time': 1774032277.045346, 'last_price_update_time': 1774810003.791841}
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM61762') HTTP/1.1" 204 0
2026-03-29 18:46:43 [auto1.de] INFO: Found listing with ID: UJ06873
2026-03-29 18:46:43 [auto1.de] INFO: Found listing with ID: KR32445
2026-03-29 18:46:43 [auto1.de] INFO: Found listing with ID: SC91438
2026-03-29 18:46:43 [auto1.de] INFO: Found listing with ID: LJ25581
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25581%27 HTTP/1.1" 200 None
2026-03-29 18:46:43 [auto1.de] INFO: Scrape type for LJ25581: 2
2026-03-29 18:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18115e89-dfc8-5415-a7e2-d3fb6e3e9068 with identifier: LJ25581
2026-03-29 18:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18115e89-dfc8-5415-a7e2-d3fb6e3e9068 with scrape type 2
2026-03-29 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18115e89-dfc8-5415-a7e2-d3fb6e3e9068 with scrape type 2
2026-03-29 18:46:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18115e89-dfc8-5415-a7e2-d3fb6e3e9068, identifier: LJ25581
2026-03-29 18:46:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18115e89-dfc8-5415-a7e2-d3fb6e3e9068 with identifier: LJ25581
2026-03-29 18:46:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18115e89-dfc8-5415-a7e2-d3fb6e3e9068 with identifier: LJ25581
2026-03-29 18:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18115e89-dfc8-5415-a7e2-d3fb6e3e9068 with identifier: LJ25581 to the API
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:52:16Z',
'fuel_type': 'petrol',
'id': '18115e89-dfc8-5415-a7e2-d3fb6e3e9068',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ25581',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 160539,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-20',
'seller_name': None,
'title': 'Ford Ka 1.2 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2009}
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25581%27 HTTP/1.1" 200 None
2026-03-29 18:46:44 [auto1.de] INFO: Saving data for LJ25581: {'auction_closing_time': 1774885936.0, 'created_time': 1774723323.787982, 'last_price_update_time': 1774810004.203386}
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ25581') HTTP/1.1" 204 0
2026-03-29 18:46:44 [auto1.de] INFO: Found listing with ID: LL75700
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL75700%27 HTTP/1.1" 200 None
2026-03-29 18:46:44 [auto1.de] INFO: Scrape type for LL75700: 2
2026-03-29 18:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18d71fc6-d2c6-5385-878b-0a9104141297 with identifier: LL75700
2026-03-29 18:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18d71fc6-d2c6-5385-878b-0a9104141297 with scrape type 2
2026-03-29 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18d71fc6-d2c6-5385-878b-0a9104141297 with scrape type 2
2026-03-29 18:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18d71fc6-d2c6-5385-878b-0a9104141297, identifier: LL75700
2026-03-29 18:46:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18d71fc6-d2c6-5385-878b-0a9104141297 with identifier: LL75700
2026-03-29 18:46:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18d71fc6-d2c6-5385-878b-0a9104141297 with identifier: LL75700
2026-03-29 18:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18d71fc6-d2c6-5385-878b-0a9104141297 with identifier: LL75700 to the API
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:03:17Z',
'fuel_type': 'diesel',
'id': '18d71fc6-d2c6-5385-878b-0a9104141297',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL75700',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 324484,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-09',
'seller_name': None,
'title': 'Mercedes-Benz Vito 111 CDI Lang',
'transmission': 'automatic',
'trim': 'Lang',
'year': 2008}
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL75700%27 HTTP/1.1" 200 None
2026-03-29 18:46:44 [auto1.de] INFO: Saving data for LL75700: {'auction_closing_time': 1774882997.0, 'created_time': 1773467782.768771, 'last_price_update_time': 1774810004.60915}
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL75700') HTTP/1.1" 204 0
2026-03-29 18:46:44 [auto1.de] INFO: Found listing with ID: RG78174
2026-03-29 18:46:44 [auto1.de] INFO: Found listing with ID: NG57043
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG57043%27 HTTP/1.1" 200 None
2026-03-29 18:46:44 [auto1.de] INFO: Scrape type for NG57043: 2
2026-03-29 18:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d533799-fed8-5b1e-b969-134338c744db with identifier: NG57043
2026-03-29 18:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d533799-fed8-5b1e-b969-134338c744db with scrape type 2
2026-03-29 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d533799-fed8-5b1e-b969-134338c744db with scrape type 2
2026-03-29 18:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d533799-fed8-5b1e-b969-134338c744db, identifier: NG57043
2026-03-29 18:46:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d533799-fed8-5b1e-b969-134338c744db with identifier: NG57043
2026-03-29 18:46:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d533799-fed8-5b1e-b969-134338c744db with identifier: NG57043
2026-03-29 18:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d533799-fed8-5b1e-b969-134338c744db with identifier: NG57043 to the API
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:18:55Z',
'fuel_type': 'petrol',
'id': '4d533799-fed8-5b1e-b969-134338c744db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG57043',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 68963,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-02-15',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Futura',
'transmission': 'manual',
'trim': 'Futura',
'year': 2001}
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG57043%27 HTTP/1.1" 200 None
2026-03-29 18:46:45 [auto1.de] INFO: Saving data for NG57043: {'auction_closing_time': 1774883935.0, 'created_time': 1774723355.879391, 'last_price_update_time': 1774810005.009967}
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG57043') HTTP/1.1" 204 0
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: SK20247
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: KY61393
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: XA48872
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA48872%27 HTTP/1.1" 200 None
2026-03-29 18:46:45 [auto1.de] INFO: Scrape type for XA48872: 2
2026-03-29 18:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a69eac5-d21f-5b7d-b898-a09c3a3a738b with identifier: XA48872
2026-03-29 18:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b with scrape type 2
2026-03-29 18:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b with scrape type 2
2026-03-29 18:46:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a69eac5-d21f-5b7d-b898-a09c3a3a738b, identifier: XA48872
2026-03-29 18:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a69eac5-d21f-5b7d-b898-a09c3a3a738b with identifier: XA48872
2026-03-29 18:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a69eac5-d21f-5b7d-b898-a09c3a3a738b with identifier: XA48872
2026-03-29 18:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a69eac5-d21f-5b7d-b898-a09c3a3a738b with identifier: XA48872 to the API
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:40:14Z',
'fuel_type': 'petrol',
'id': '3a69eac5-d21f-5b7d-b898-a09c3a3a738b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA48872',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 40160,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-14',
'seller_name': None,
'title': 'Fiat 500 1.2 Happy Birthday',
'transmission': 'manual',
'trim': 'Happy Birthday',
'year': 2013}
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA48872%27 HTTP/1.1" 200 None
2026-03-29 18:46:45 [auto1.de] INFO: Saving data for XA48872: {'auction_closing_time': 1774885214.0, 'created_time': 1774723361.131841, 'last_price_update_time': 1774810005.411179}
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA48872') HTTP/1.1" 204 0
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: ZZ30319
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ30319%27 HTTP/1.1" 200 None
2026-03-29 18:46:45 [auto1.de] INFO: Scrape type for ZZ30319: 2
2026-03-29 18:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6e19cca-5226-5d25-8fc3-35cc9bc6dcda with identifier: ZZ30319
2026-03-29 18:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6e19cca-5226-5d25-8fc3-35cc9bc6dcda with scrape type 2
2026-03-29 18:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6e19cca-5226-5d25-8fc3-35cc9bc6dcda with scrape type 2
2026-03-29 18:46:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6e19cca-5226-5d25-8fc3-35cc9bc6dcda, identifier: ZZ30319
2026-03-29 18:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6e19cca-5226-5d25-8fc3-35cc9bc6dcda with identifier: ZZ30319
2026-03-29 18:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6e19cca-5226-5d25-8fc3-35cc9bc6dcda with identifier: ZZ30319
2026-03-29 18:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6e19cca-5226-5d25-8fc3-35cc9bc6dcda with identifier: ZZ30319 to the API
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:31:27Z',
'fuel_type': 'petrol',
'id': 'b6e19cca-5226-5d25-8fc3-35cc9bc6dcda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ30319',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 250708,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-30',
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ30319%27 HTTP/1.1" 200 None
2026-03-29 18:46:45 [auto1.de] INFO: Saving data for ZZ30319: {'auction_closing_time': 1774884687.0, 'created_time': 1774723355.187847, 'last_price_update_time': 1774810005.894316}
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ30319') HTTP/1.1" 204 0
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: HK51191
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: FJ78997
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78997%27 HTTP/1.1" 200 None
2026-03-29 18:46:45 [auto1.de] INFO: Scrape type for FJ78997: 2
2026-03-29 18:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e with identifier: FJ78997
2026-03-29 18:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e with scrape type 2
2026-03-29 18:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e with scrape type 2
2026-03-29 18:46:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e, identifier: FJ78997
2026-03-29 18:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e with identifier: FJ78997
2026-03-29 18:46:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e with identifier: FJ78997
2026-03-29 18:46:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e with identifier: FJ78997 to the API
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:36:58Z',
'fuel_type': 'petrol',
'id': '8ca2b60b-61bf-5afe-b36e-b84c3dfe670e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ78997',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 119007,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-25',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78997%27 HTTP/1.1" 200 None
2026-03-29 18:46:46 [auto1.de] INFO: Saving data for FJ78997: {'auction_closing_time': 1774885018.0, 'created_time': 1774723352.417159, 'last_price_update_time': 1774810006.337129}
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ78997') HTTP/1.1" 204 0
2026-03-29 18:46:46 [auto1.de] INFO: Found listing with ID: NH81778
2026-03-29 18:46:46 [auto1.de] INFO: Found listing with ID: SC04632
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC04632%27 HTTP/1.1" 200 None
2026-03-29 18:46:46 [auto1.de] INFO: Scrape type for SC04632: 2
2026-03-29 18:46:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 357aec1a-ebd2-58e2-9b9d-d045bd1c451e with identifier: SC04632
2026-03-29 18:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 357aec1a-ebd2-58e2-9b9d-d045bd1c451e with scrape type 2
2026-03-29 18:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 357aec1a-ebd2-58e2-9b9d-d045bd1c451e with scrape type 2
2026-03-29 18:46:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 357aec1a-ebd2-58e2-9b9d-d045bd1c451e, identifier: SC04632
2026-03-29 18:46:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 357aec1a-ebd2-58e2-9b9d-d045bd1c451e with identifier: SC04632
2026-03-29 18:46:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 357aec1a-ebd2-58e2-9b9d-d045bd1c451e with identifier: SC04632
2026-03-29 18:46:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 357aec1a-ebd2-58e2-9b9d-d045bd1c451e with identifier: SC04632 to the API
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:13:52Z',
'fuel_type': 'petrol',
'id': '357aec1a-ebd2-58e2-9b9d-d045bd1c451e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC04632',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 128984,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1990-08-02',
'seller_name': None,
'title': 'BMW 5er 525i',
'transmission': 'manual',
'trim': '',
'year': 1990}
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC04632%27 HTTP/1.1" 200 None
2026-03-29 18:46:46 [auto1.de] INFO: Saving data for SC04632: {'auction_closing_time': 1774883632.0, 'created_time': 1773301139.768602, 'last_price_update_time': 1774810006.742148}
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC04632') HTTP/1.1" 204 0
2026-03-29 18:46:46 [auto1.de] INFO: Found listing with ID: CA87929
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87929%27 HTTP/1.1" 200 None
2026-03-29 18:46:46 [auto1.de] INFO: Scrape type for CA87929: 2
2026-03-29 18:46:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2240651-c63f-55af-b924-8919e49ef1ce with identifier: CA87929
2026-03-29 18:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2240651-c63f-55af-b924-8919e49ef1ce with scrape type 2
2026-03-29 18:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2240651-c63f-55af-b924-8919e49ef1ce with scrape type 2
2026-03-29 18:46:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2240651-c63f-55af-b924-8919e49ef1ce, identifier: CA87929
2026-03-29 18:46:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2240651-c63f-55af-b924-8919e49ef1ce with identifier: CA87929
2026-03-29 18:46:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2240651-c63f-55af-b924-8919e49ef1ce with identifier: CA87929
2026-03-29 18:46:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2240651-c63f-55af-b924-8919e49ef1ce with identifier: CA87929 to the API
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:27:34Z',
'fuel_type': 'petrol',
'id': 'c2240651-c63f-55af-b924-8919e49ef1ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA87929',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 187588,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-23',
'seller_name': None,
'title': 'Skoda Fabia 1.4 Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2010}
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87929%27 HTTP/1.1" 200 None
2026-03-29 18:46:47 [auto1.de] INFO: Saving data for CA87929: {'auction_closing_time': 1774884454.0, 'created_time': 1774723354.145926, 'last_price_update_time': 1774810007.155023}
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA87929') HTTP/1.1" 204 0
2026-03-29 18:46:47 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: GL40281
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL40281%27 HTTP/1.1" 200 None
2026-03-29 18:46:47 [auto1.de] INFO: Scrape type for GL40281: 2
2026-03-29 18:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e8a1e95-281c-5023-8bba-16c49d8a5cfe with identifier: GL40281
2026-03-29 18:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe with scrape type 2
2026-03-29 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe with scrape type 2
2026-03-29 18:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e8a1e95-281c-5023-8bba-16c49d8a5cfe, identifier: GL40281
2026-03-29 18:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e8a1e95-281c-5023-8bba-16c49d8a5cfe with identifier: GL40281
2026-03-29 18:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e8a1e95-281c-5023-8bba-16c49d8a5cfe with identifier: GL40281
2026-03-29 18:46:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e8a1e95-281c-5023-8bba-16c49d8a5cfe with identifier: GL40281 to the API
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:49:33Z',
'fuel_type': 'petrol',
'id': '3e8a1e95-281c-5023-8bba-16c49d8a5cfe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL40281',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 86858,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-18',
'seller_name': None,
'title': 'Suzuki Swift 1.4 BoosterJet Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2019}
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL40281%27 HTTP/1.1" 200 None
2026-03-29 18:46:47 [auto1.de] INFO: Saving data for GL40281: {'auction_closing_time': 1774885773.0, 'created_time': 1774723362.068285, 'last_price_update_time': 1774810007.568646}
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL40281') HTTP/1.1" 204 0
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: FF09080
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF09080%27 HTTP/1.1" 200 None
2026-03-29 18:46:47 [auto1.de] INFO: Scrape type for FF09080: 2
2026-03-29 18:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19680ba3-d4ba-53c6-917f-d68876343700 with identifier: FF09080
2026-03-29 18:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19680ba3-d4ba-53c6-917f-d68876343700 with scrape type 2
2026-03-29 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19680ba3-d4ba-53c6-917f-d68876343700 with scrape type 2
2026-03-29 18:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19680ba3-d4ba-53c6-917f-d68876343700, identifier: FF09080
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: RZ32125
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: LC33446
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: JA37481
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: ZT00661
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: WC65602
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC65602%27 HTTP/1.1" 200 None
2026-03-29 18:46:47 [auto1.de] INFO: Scrape type for WC65602: 2
2026-03-29 18:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db665ca2-fa02-5c51-b61d-83e72285554d with identifier: WC65602
2026-03-29 18:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db665ca2-fa02-5c51-b61d-83e72285554d with scrape type 2
2026-03-29 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db665ca2-fa02-5c51-b61d-83e72285554d with scrape type 2
2026-03-29 18:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db665ca2-fa02-5c51-b61d-83e72285554d, identifier: WC65602
2026-03-29 18:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19680ba3-d4ba-53c6-917f-d68876343700 with identifier: FF09080
2026-03-29 18:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19680ba3-d4ba-53c6-917f-d68876343700 with identifier: FF09080
2026-03-29 18:46:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19680ba3-d4ba-53c6-917f-d68876343700 with identifier: FF09080 to the API
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:19:34Z',
'fuel_type': 'petrol',
'id': '19680ba3-d4ba-53c6-917f-d68876343700',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF09080',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 107980,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-03',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 160 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2009}
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF09080%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Saving data for FF09080: {'auction_closing_time': 1774883974.0, 'created_time': 1774723364.240495, 'last_price_update_time': 1774810008.116631}
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF09080') HTTP/1.1" 204 0
2026-03-29 18:46:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db665ca2-fa02-5c51-b61d-83e72285554d with identifier: WC65602
2026-03-29 18:46:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db665ca2-fa02-5c51-b61d-83e72285554d with identifier: WC65602
2026-03-29 18:46:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db665ca2-fa02-5c51-b61d-83e72285554d with identifier: WC65602 to the API
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:02:09Z',
'fuel_type': 'petrol',
'id': 'db665ca2-fa02-5c51-b61d-83e72285554d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC65602',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 87221,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-29',
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive passion',
'year': 2010}
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC65602%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Saving data for WC65602: {'auction_closing_time': 1774882929.0, 'created_time': 1774723369.369402, 'last_price_update_time': 1774810008.505464}
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC65602') HTTP/1.1" 204 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU36975%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for XU36975: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF23902%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for NF23902: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR04886%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for TR04886: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR73784%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for JR73784: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK15682%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for TK15682: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT59270%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for DT59270: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD29600%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for SD29600: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY51976%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for AY51976: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT35256%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for KT35256: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY39038%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for ZY39038: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA52308%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for EA52308: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD45426%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for KD45426: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ43833%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for VZ43833: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA56884%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for HA56884: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80393%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for FD80393: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB41121%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for XB41121: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: AT60125
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: WA47251
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: DA22909
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA22909%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for DA22909: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: RC64872
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: GV73009
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: SR63291
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: BF10429
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF10429%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for BF10429: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: EP03101
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: XY13632
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY13632%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for XY13632: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: HA64256
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH64159%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for MH64159: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: HF13996
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF13996%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for HF13996: 2
2026-03-29 18:46:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5e7d014-69c3-5857-90fb-6d64089f697a with identifier: HF13996
2026-03-29 18:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5e7d014-69c3-5857-90fb-6d64089f697a with scrape type 2
2026-03-29 18:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5e7d014-69c3-5857-90fb-6d64089f697a with scrape type 2
2026-03-29 18:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5e7d014-69c3-5857-90fb-6d64089f697a, identifier: HF13996
2026-03-29 18:46:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5e7d014-69c3-5857-90fb-6d64089f697a with identifier: HF13996
2026-03-29 18:46:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5e7d014-69c3-5857-90fb-6d64089f697a with identifier: HF13996
2026-03-29 18:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5e7d014-69c3-5857-90fb-6d64089f697a with identifier: HF13996 to the API
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:38:19Z',
'fuel_type': 'petrol',
'id': 'a5e7d014-69c3-5857-90fb-6d64089f697a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF13996',
'listing': 'auction',
'make': 'Peugeot',
'model': '206',
'odometer': 186762,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-10-22',
'seller_name': None,
'title': 'Peugeot 206 1.4 Grand Filou Cool',
'transmission': 'manual',
'trim': 'Grand Filou Cool',
'year': 2007}
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF13996%27 HTTP/1.1" 200 None
2026-03-29 18:46:49 [auto1.de] INFO: Saving data for HF13996: {'auction_closing_time': 1774885099.0, 'created_time': 1774723354.557125, 'last_price_update_time': 1774810009.254159}
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF13996') HTTP/1.1" 204 0
2026-03-29 18:46:49 [auto1.de] INFO: Found listing with ID: RX58241
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX58241%27 HTTP/1.1" 200 None
2026-03-29 18:46:49 [auto1.de] INFO: Scrape type for RX58241: 2
2026-03-29 18:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10270847-2b1e-57c4-837c-63237a6962bf with identifier: RX58241
2026-03-29 18:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10270847-2b1e-57c4-837c-63237a6962bf with scrape type 2
2026-03-29 18:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10270847-2b1e-57c4-837c-63237a6962bf with scrape type 2
2026-03-29 18:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10270847-2b1e-57c4-837c-63237a6962bf, identifier: RX58241
2026-03-29 18:46:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10270847-2b1e-57c4-837c-63237a6962bf with identifier: RX58241
2026-03-29 18:46:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10270847-2b1e-57c4-837c-63237a6962bf with identifier: RX58241
2026-03-29 18:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10270847-2b1e-57c4-837c-63237a6962bf with identifier: RX58241 to the API
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:56:53Z',
'fuel_type': 'petrol',
'id': '10270847-2b1e-57c4-837c-63237a6962bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX58241',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 112624,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-15',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 CGI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2013}
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX58241%27 HTTP/1.1" 200 None
2026-03-29 18:46:49 [auto1.de] INFO: Saving data for RX58241: {'auction_closing_time': 1774886213.0, 'created_time': 1774349362.290389, 'last_price_update_time': 1774810009.832879}
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX58241') HTTP/1.1" 204 0
2026-03-29 18:46:49 [auto1.de] INFO: Found listing with ID: DG46200
2026-03-29 18:46:49 [auto1.de] INFO: Found listing with ID: BU17582
2026-03-29 18:46:49 [auto1.de] INFO: Found listing with ID: HN71880
2026-03-29 18:46:49 [auto1.de] INFO: Found listing with ID: VN03026
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN03026%27 HTTP/1.1" 200 None
2026-03-29 18:46:49 [auto1.de] INFO: Scrape type for VN03026: 2
2026-03-29 18:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 266a0dea-d422-56c1-ab95-c86f1b0caac2 with identifier: VN03026
2026-03-29 18:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 266a0dea-d422-56c1-ab95-c86f1b0caac2 with scrape type 2
2026-03-29 18:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 266a0dea-d422-56c1-ab95-c86f1b0caac2 with scrape type 2
2026-03-29 18:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 266a0dea-d422-56c1-ab95-c86f1b0caac2, identifier: VN03026
2026-03-29 18:46:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 266a0dea-d422-56c1-ab95-c86f1b0caac2 with identifier: VN03026
2026-03-29 18:46:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 266a0dea-d422-56c1-ab95-c86f1b0caac2 with identifier: VN03026
2026-03-29 18:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 266a0dea-d422-56c1-ab95-c86f1b0caac2 with identifier: VN03026 to the API
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:17:06Z',
'fuel_type': 'petrol',
'id': '266a0dea-d422-56c1-ab95-c86f1b0caac2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN03026',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 107933,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-30',
'seller_name': None,
'title': 'Opel Astra 1.6 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2009}
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN03026%27 HTTP/1.1" 200 None
2026-03-29 18:46:50 [auto1.de] INFO: Saving data for VN03026: {'auction_closing_time': 1774883826.0, 'created_time': 1774723357.673356, 'last_price_update_time': 1774810010.241658}
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN03026') HTTP/1.1" 204 0
2026-03-29 18:46:50 [auto1.de] INFO: Found listing with ID: NS77188
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS77188%27 HTTP/1.1" 200 None
2026-03-29 18:46:50 [auto1.de] INFO: Scrape type for NS77188: 2
2026-03-29 18:46:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81a471fa-9cb8-56bb-baf2-90bb025769bb with identifier: NS77188
2026-03-29 18:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81a471fa-9cb8-56bb-baf2-90bb025769bb with scrape type 2
2026-03-29 18:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81a471fa-9cb8-56bb-baf2-90bb025769bb with scrape type 2
2026-03-29 18:46:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81a471fa-9cb8-56bb-baf2-90bb025769bb, identifier: NS77188
2026-03-29 18:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81a471fa-9cb8-56bb-baf2-90bb025769bb with identifier: NS77188
2026-03-29 18:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81a471fa-9cb8-56bb-baf2-90bb025769bb with identifier: NS77188
2026-03-29 18:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81a471fa-9cb8-56bb-baf2-90bb025769bb with identifier: NS77188 to the API
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:04:23Z',
'fuel_type': 'diesel',
'id': '81a471fa-9cb8-56bb-baf2-90bb025769bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS77188',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 115976,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-30',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion Tech',
'year': 2017}
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS77188%27 HTTP/1.1" 200 None
2026-03-29 18:46:50 [auto1.de] INFO: Saving data for NS77188: {'auction_closing_time': 1774883063.0, 'created_time': 1774723373.324008, 'last_price_update_time': 1774810010.667697}
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS77188') HTTP/1.1" 204 0
2026-03-29 18:46:50 [auto1.de] INFO: Found listing with ID: GT32005
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT32005%27 HTTP/1.1" 200 None
2026-03-29 18:46:50 [auto1.de] INFO: Scrape type for GT32005: 2
2026-03-29 18:46:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 369fb740-341e-5403-ac15-c2016424baf8 with identifier: GT32005
2026-03-29 18:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 369fb740-341e-5403-ac15-c2016424baf8 with scrape type 2
2026-03-29 18:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 369fb740-341e-5403-ac15-c2016424baf8 with scrape type 2
2026-03-29 18:46:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 369fb740-341e-5403-ac15-c2016424baf8, identifier: GT32005
2026-03-29 18:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 369fb740-341e-5403-ac15-c2016424baf8 with identifier: GT32005
2026-03-29 18:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 369fb740-341e-5403-ac15-c2016424baf8 with identifier: GT32005
2026-03-29 18:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 369fb740-341e-5403-ac15-c2016424baf8 with identifier: GT32005 to the API
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-30T15:29:17Z',
'fuel_type': 'hybrid',
'id': '369fb740-341e-5403-ac15-c2016424baf8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT32005',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 42452,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-24',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 350e 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2021}
2026-03-29 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT32005%27 HTTP/1.1" 200 None
2026-03-29 18:46:51 [auto1.de] INFO: Saving data for GT32005: {'auction_closing_time': 1774884557.0, 'created_time': 1774723367.124012, 'last_price_update_time': 1774810011.870644}
2026-03-29 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT32005') HTTP/1.1" 204 0
2026-03-29 18:46:51 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-29 18:46:51 [auto1.de] INFO: Found listing with ID: CN24608
2026-03-29 18:46:51 [auto1.de] INFO: Found listing with ID: BE39564
2026-03-29 18:46:51 [auto1.de] INFO: Found listing with ID: SF89930
2026-03-29 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF89930%27 HTTP/1.1" 200 None
2026-03-29 18:46:51 [auto1.de] INFO: Scrape type for SF89930: 2
2026-03-29 18:46:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be345a10-8431-5673-aeb0-e14a23f9b714 with identifier: SF89930
2026-03-29 18:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be345a10-8431-5673-aeb0-e14a23f9b714 with scrape type 2
2026-03-29 18:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be345a10-8431-5673-aeb0-e14a23f9b714 with scrape type 2
2026-03-29 18:46:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be345a10-8431-5673-aeb0-e14a23f9b714, identifier: SF89930
2026-03-29 18:46:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be345a10-8431-5673-aeb0-e14a23f9b714 with identifier: SF89930
2026-03-29 18:46:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be345a10-8431-5673-aeb0-e14a23f9b714 with identifier: SF89930
2026-03-29 18:46:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be345a10-8431-5673-aeb0-e14a23f9b714 with identifier: SF89930 to the API
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:15:04Z',
'fuel_type': 'diesel',
'id': 'be345a10-8431-5673-aeb0-e14a23f9b714',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF89930',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 62786,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-09',
'seller_name': None,
'title': 'Mercedes-Benz Vito 110 CDI FWD lang',
'transmission': 'automatic',
'trim': 'FWD lang',
'year': 2020}
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF89930%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Saving data for SF89930: {'auction_closing_time': 1774883704.0, 'created_time': 1774521437.16494, 'last_price_update_time': 1774810012.276792}
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF89930') HTTP/1.1" 204 0
2026-03-29 18:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:52 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51280%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for CU51280: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: PT22331
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: TS47391
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS47391%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for TS47391: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: JD30879
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD30879%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for JD30879: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: BC15764
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: YW82863
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: AR37862
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: XR83794
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: DM55805
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: ZF87196
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF87196%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for ZF87196: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: DK10749
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10749%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for DK10749: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: DD00982
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD00982%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for DD00982: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: BR74031
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: JV93942
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV93942%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for JV93942: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: RR37288
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR37288%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for RR37288: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: ZG46471
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: ZR61272
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: XL20163
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL20163%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for XL20163: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: YU16554
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: PR78588
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: RK30802
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: RW03523
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW03523%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for RW03523: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: ZY17523
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY17523%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for ZY17523: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: GW53776
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW53776%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for GW53776: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: UB66562
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: PH41345
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH41345%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for PH41345: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: FB79072
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB79072%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for FB79072: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: DY16606
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: DK90225
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: MC13380
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: KW07987
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW07987%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for KW07987: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: HC06893
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC06893%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for HC06893: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: BM85402
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM85402%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for BM85402: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: CA67550
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA67550%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for CA67550: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG02351%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for ZG02351: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK87241%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for UK87241: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: GF54285
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: JM74850
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: PJ27517
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27517%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for PJ27517: 0
2026-03-29 18:46:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:53 [auto1.de] INFO: Channel: 24h | Page: 161 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: MN00804
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN00804%27 HTTP/1.1" 200 None
2026-03-29 18:46:53 [auto1.de] INFO: Scrape type for MN00804: 0
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: CR42013
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: GH25955
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH25955%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for GH25955: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: AF81396
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF81396%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for AF81396: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: FJ89028
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ89028%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for FJ89028: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: CU69011
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: GY71036
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY71036%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for GY71036: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: HB96226
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB96226%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for HB96226: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: GS36349
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36349%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for GS36349: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: HA50795
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA50795%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for HA50795: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: UZ55149
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ55149%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for UZ55149: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: NC03535
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC03535%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for NC03535: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: HR22131
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR22131%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for HR22131: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM01256%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for YM01256: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: EZ06190
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: AD09354
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD09354%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for AD09354: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: RE79871
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: YD36788
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD36788%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for YD36788: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: EY64053
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY64053%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for EY64053: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK14391%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for NK14391: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA88960%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for HA88960: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: CV20886
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV20886%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for CV20886: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: BF20079
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF20079%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for BF20079: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: GJ71513
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: XT67531
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: PB33753
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: TU57767
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: YH86831
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH86831%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for YH86831: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24004%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for GU24004: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: KR12848
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR12848%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for KR12848: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: HR78495
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: RR83304
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR83304%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for RR83304: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: UE39516
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE39516%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for UE39516: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: GM93366
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93366%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for GM93366: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: VV13794
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV13794%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for VV13794: 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: RU85035
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: YZ93314
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ93314%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for YZ93314: 0
2026-03-29 18:46:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:55 [auto1.de] INFO: Channel: 24h | Page: 162 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: VJ45584
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: ZE64138
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE64138%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for ZE64138: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: FH72870
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH72870%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for FH72870: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: RV36249
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV36249%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for RV36249: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: GR32471
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR32471%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for GR32471: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: UB45344
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: TJ69669
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ69669%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for TJ69669: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: CX33153
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX33153%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for CX33153: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: XL82798
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL82798%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for XL82798: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: NF65282
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: DE88009
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE88009%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for DE88009: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: HF51839
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF51839%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for HF51839: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: LM10522
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: VG29831
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: GX51381
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: EC79074
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79074%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for EC79074: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: YP50016
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: KE20907
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE20907%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for KE20907: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: XN06908
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: SY64199
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: ZM57049
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM57049%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for ZM57049: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: KW41122
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW41122%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for KW41122: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: XV62067
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: EH91582
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: SG58819
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: EU16330
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU16330%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for EU16330: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: FE70575
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: TK97651
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: DR88922
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR88922%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for DR88922: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: SL55745
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL55745%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for SL55745: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: WA61115
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA61115%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for WA61115: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: SJ49235
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ49235%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for SJ49235: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: ER21698
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: BT33018
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT33018%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for BT33018: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: DY33691
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: KT95165
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT95165%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for KT95165: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: WV98635
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: JX65004
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX65004%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for JX65004: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: VG77732
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG77732%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for VG77732: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: MW16405
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW16405%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for MW16405: 0
2026-03-29 18:46:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:06 [scrapy.extensions.logstats] INFO: Crawled 173 pages (at 9 pages/min), scraped 1620 items (at 100 items/min)
2026-03-29 18:47:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-29 18:47:06 [auto1.de] INFO: Channel: 24h | Page: 163 | totalHits: 6740 | hits on page: 40
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: WF26983
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: BY24352
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY24352%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for BY24352: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: SV90594
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV90594%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for SV90594: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: CN43056
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN43056%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for CN43056: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: RA08562
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA08562%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for RA08562: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: MZ03639
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ03639%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for MZ03639: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: EL77757
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL77757%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for EL77757: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: BS45971
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS45971%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for BS45971: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: NT95392
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT95392%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for NT95392: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: PB01809
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: DA97993
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: AD84103
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: NV43592
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: PL81843
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: FB20065
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20065%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for FB20065: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: YV73995
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV73995%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for YV73995: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: WW38185
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: UW13690
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: CW14038
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: JX55294
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX55294%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for JX55294: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: PY14416
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: BK93979
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK93979%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for BK93979: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: DM10226
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: LC65511
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC65511%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for LC65511: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: NH74164
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74164%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for NH74164: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: EE69038
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: PA12194
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: CG50140
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG50140%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for CG50140: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: HZ13405
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: YL16347
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL16347%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for YL16347: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: MN41763
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN41763%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for MN41763: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: LU05124
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: SY55071
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55071%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for SY55071: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: TJ50371
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: WT57840
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT57840%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for WT57840: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: BZ34179
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ34179%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for BZ34179: 0
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: PA26532
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: CY89611
2026-03-29 18:47:07 [auto1.de] INFO: Found listing with ID: GZ42240
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ42240%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Scrape type for GZ42240: 0
2026-03-29 18:47:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:08 [auto1.de] INFO: Channel: 24h | Page: 164 | totalHits: 6740 | hits on page: 40
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: DV90621
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: DZ63249
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63249%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for DZ63249: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: MN76950
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN76950%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for MN76950: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: AG97842
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: KV46000
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV46000%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for KV46000: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: LA95104
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: TA12646
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA12646%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for TA12646: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: LX44847
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: VG58612
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG58612%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for VG58612: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB45550%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for LB45550: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: YC71395
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC71395%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for YC71395: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: GG20866
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: SW39146
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW39146%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for SW39146: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: WY65265
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: SS56268
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS56268%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for SS56268: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM38388%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for HM38388: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA98041%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for SA98041: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: RV78416
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: GB67844
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: GJ08958
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: HS55924
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55924%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for HS55924: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: RM27503
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM27503%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for RM27503: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: ZD45339
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: BU26829
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: UL74029
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB23451%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for GB23451: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD85387%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for GD85387: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: MF41650
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01608%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for NW01608: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: NV71817
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: TG89658
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: GA70819
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY06085%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for TY06085: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: BW55074
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: NU23342
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23342%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for NU23342: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: XE90423
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: SK80695
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: FL62048
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL62048%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for FL62048: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: XV72554
2026-03-29 18:47:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:09 [auto1.de] INFO: Channel: 24h | Page: 165 | totalHits: 6740 | hits on page: 40
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: RG68419
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: NE45887
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: VZ98908
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: MG84960
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG84960%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for MG84960: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: KU56806
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56806%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for KU56806: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: BH58500
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: FN47599
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: JS16399
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB04799%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for YB04799: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: ME28341
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME28341%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for ME28341: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: JP40190
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: AU10222
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU10222%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for AU10222: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: JN77870
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: MN75028
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN75028%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for MN75028: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: LR31578
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: SB90605
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB90605%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for SB90605: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: HL93382
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL93382%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for HL93382: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: HU71027
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU71027%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for HU71027: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: HW93754
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93754%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for HW93754: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: KV33816
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: NB68023
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB68023%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for NB68023: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: BG93361
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG93361%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for BG93361: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: ZV32018
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV32018%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for ZV32018: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: MV90577
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: DF55649
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: FT64289
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64289%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for FT64289: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: ED71538
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: PJ47645
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: UT04321
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: KE10146
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE10146%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for KE10146: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: PN64243
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64243%27 HTTP/1.1" 200 None
2026-03-29 18:47:09 [auto1.de] INFO: Scrape type for PN64243: 0
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: DF72133
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: RL77282
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: NC99241
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: YW14341
2026-03-29 18:47:09 [auto1.de] INFO: Found listing with ID: WH57282
2026-03-29 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH57282%27 HTTP/1.1" 200 None
2026-03-29 18:47:10 [auto1.de] INFO: Scrape type for WH57282: 0
2026-03-29 18:47:10 [auto1.de] INFO: Found listing with ID: SE82228
2026-03-29 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE82228%27 HTTP/1.1" 200 None
2026-03-29 18:47:10 [auto1.de] INFO: Scrape type for SE82228: 0
2026-03-29 18:47:10 [auto1.de] INFO: Found listing with ID: WB94546
2026-03-29 18:47:10 [auto1.de] INFO: Found listing with ID: LV05660
2026-03-29 18:47:10 [auto1.de] INFO: Found listing with ID: ZY49257
2026-03-29 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY49257%27 HTTP/1.1" 200 None
2026-03-29 18:47:10 [auto1.de] INFO: Scrape type for ZY49257: 0
2026-03-29 18:47:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:20 [auto1.de] INFO: Channel: 24h | Page: 166 | totalHits: 6740 | hits on page: 40
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: PG18082
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG18082%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for PG18082: 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: VX47645
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX47645%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for VX47645: 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: UJ37250
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: BF02767
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: HX00661
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: BV18863
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV18863%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for BV18863: 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: HE38410
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE38410%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for HE38410: 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: GE96927
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: XL36309
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: FM75567
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: TU93300
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: SH00876
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: YC00182
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00182%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for YC00182: 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: AG44580
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: KZ11771
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ11771%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for KZ11771: 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: RP91666
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: YS46144
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: BE92832
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: HJ16589
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ16589%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for HJ16589: 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: TN63274
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: BJ75751
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: ZT80456
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: VY67413
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: HB69209
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: GF17035
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: KM53361
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM53361%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for KM53361: 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: ZV63958
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: VG24913
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: XE04045
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: UV81203
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: PU74458
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU74458%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for PU74458: 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: NK23311
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK23311%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for NK23311: 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP69948%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for HP69948: 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: FK48222
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: KE90826
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: MN93715
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: YJ19312
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19312%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for YJ19312: 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: BS68769
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-29 18:47:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:21 [auto1.de] INFO: Channel: 24h | Page: 167 | totalHits: 6740 | hits on page: 40
2026-03-29 18:47:21 [auto1.de] INFO: Found listing with ID: NE48651
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE48651%27 HTTP/1.1" 200 None
2026-03-29 18:47:21 [auto1.de] INFO: Scrape type for NE48651: 0
2026-03-29 18:47:21 [auto1.de] INFO: Found listing with ID: TJ68834
2026-03-29 18:47:21 [auto1.de] INFO: Found listing with ID: BA78869
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA78869%27 HTTP/1.1" 200 None
2026-03-29 18:47:21 [auto1.de] INFO: Scrape type for BA78869: 0
2026-03-29 18:47:21 [auto1.de] INFO: Found listing with ID: NG50641
2026-03-29 18:47:21 [auto1.de] INFO: Found listing with ID: DJ78015
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ78015%27 HTTP/1.1" 200 None
2026-03-29 18:47:21 [auto1.de] INFO: Scrape type for DJ78015: 0
2026-03-29 18:47:21 [auto1.de] INFO: Found listing with ID: SM71650
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM71650%27 HTTP/1.1" 200 None
2026-03-29 18:47:21 [auto1.de] INFO: Scrape type for SM71650: 0
2026-03-29 18:47:21 [auto1.de] INFO: Found listing with ID: BA31995
2026-03-29 18:47:21 [auto1.de] INFO: Found listing with ID: ZU52934
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU52934%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for ZU52934: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: PW89679
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW89679%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for PW89679: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: GD61279
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61279%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for GD61279: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: PF87793
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: KU32415
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU32415%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for KU32415: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: RR24690
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: NG84191
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG84191%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for NG84191: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: UX99567
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX99567%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for UX99567: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: XD36777
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: PC48603
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: SR86923
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR86923%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for SR86923: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: GJ17699
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: ZX68256
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX68256%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for ZX68256: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: HF47476
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: CZ39134
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ39134%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for CZ39134: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: EU15499
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU15499%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for EU15499: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: DC48276
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: HG48100
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG48100%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for HG48100: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: DS20438
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: CC34542
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: WA68058
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68058%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for WA68058: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: RZ05971
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ05971%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for RZ05971: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: WC61131
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: RU40839
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: VL73605
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL73605%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for VL73605: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: TZ58013
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ58013%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for TZ58013: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: BC10414
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: LG96250
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: MG73872
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG73872%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for MG73872: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: SB27489
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: RM35826
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM35826%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for RM35826: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: EH57829
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH57829%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for EH57829: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: GR42785
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR42785%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for GR42785: 0
2026-03-29 18:47:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:23 [auto1.de] INFO: Channel: 24h | Page: 168 | totalHits: 6740 | hits on page: 40
2026-03-29 18:47:23 [auto1.de] INFO: Found listing with ID: FG97894
2026-03-29 18:47:23 [auto1.de] INFO: Found listing with ID: MM73538
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM73538%27 HTTP/1.1" 200 None
2026-03-29 18:47:23 [auto1.de] INFO: Scrape type for MM73538: 0
2026-03-29 18:47:23 [auto1.de] INFO: Found listing with ID: PX49171
2026-03-29 18:47:23 [auto1.de] INFO: Found listing with ID: AH24505
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH24505%27 HTTP/1.1" 200 None
2026-03-29 18:47:23 [auto1.de] INFO: Scrape type for AH24505: 0
2026-03-29 18:47:23 [auto1.de] INFO: Found listing with ID: SU92609
2026-03-29 18:47:23 [auto1.de] INFO: Found listing with ID: RF00811
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF00811%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for RF00811: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: CA70430
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA70430%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for CA70430: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: CG16297
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: AZ56926
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ56926%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for AZ56926: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: GY33643
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY33643%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for GY33643: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: PF97491
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: EK48004
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK48004%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for EK48004: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ88731%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for WJ88731: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA60872%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for WA60872: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ17594%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for RJ17594: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC98530%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for WC98530: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET93890%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for ET93890: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01854%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for DV01854: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE23148%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for UE23148: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS91776%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for ZS91776: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX64192%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for VX64192: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED17592%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for ED17592: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX10664%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for FX10664: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85041%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for YS85041: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG54603%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for WG54603: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV82390%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for VV82390: 0
2026-03-29 18:47:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:25 [auto1.de] INFO: Channel: 24h | Page: 169 | totalHits: 6740 | hits on page: 20
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK64465%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Scrape type for SK64465: 2
2026-03-29 18:47:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc334e0f-49a1-5bf7-83cc-6ca9607df256 with identifier: SK64465
2026-03-29 18:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc334e0f-49a1-5bf7-83cc-6ca9607df256 with scrape type 2
2026-03-29 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc334e0f-49a1-5bf7-83cc-6ca9607df256 with scrape type 2
2026-03-29 18:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc334e0f-49a1-5bf7-83cc-6ca9607df256, identifier: SK64465
2026-03-29 18:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc334e0f-49a1-5bf7-83cc-6ca9607df256 with identifier: SK64465
2026-03-29 18:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc334e0f-49a1-5bf7-83cc-6ca9607df256 with identifier: SK64465
2026-03-29 18:47:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc334e0f-49a1-5bf7-83cc-6ca9607df256 with identifier: SK64465 to the API
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:05:28Z',
'fuel_type': 'petrol',
'id': 'bc334e0f-49a1-5bf7-83cc-6ca9607df256',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK64465',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 168515,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-26',
'seller_name': None,
'title': 'Audi A4 2.0 TFSI Sport ultra',
'transmission': 'automatic',
'trim': 'Sport ultra',
'year': 2018}
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK64465%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Saving data for SK64465: {'auction_closing_time': 1774883128.0, 'created_time': 1773945754.773166, 'last_price_update_time': 1774810045.648992}
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK64465') HTTP/1.1" 204 0
2026-03-29 18:47:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY99851%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Scrape type for GY99851: 0
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG73349%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Scrape type for KG73349: 0
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ82496%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Scrape type for ZZ82496: 0
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81744%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Scrape type for MA81744: 0
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG50767%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Scrape type for KG50767: 0
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR70360%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Scrape type for AR70360: 0
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: YX36608
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: XL74124
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL74124%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Scrape type for XL74124: 0
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: WX78972
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX78972%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Scrape type for WX78972: 0
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: TW02363
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW02363%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Scrape type for TW02363: 0
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: HR58634
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: LM22131
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: YV43994
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV43994%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Scrape type for YV43994: 0
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY99539%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Scrape type for HY99539: 0
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-29 18:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:26 [auto1.de] INFO: Channel: 24h | Page: 170 | totalHits: 6740 | hits on page: 0
2026-03-29 18:47:26 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 18:47:26 [auto1.de] INFO: auto1.de Batch config: batch 1/2
2026-03-29 18:47:26 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 11, <ScrapeType.BATCH_SKIPPED: 5>: 8}
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20last_price_update_time%20lt%201774378046 HTTP/1.1" 200 None
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AA06898') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AA32108') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AB67265') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AC07252') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AC38896') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AD74925') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AE26242') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AE39680') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AE43577') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AE74014') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AE87876') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AF66577') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AG95814') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AH65390') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ74586') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AK46647') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AK78003') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AL25278') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AL28178') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AL34664') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AL86420') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AN15347') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AN80772') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AR15845') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AR18320') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AR96485') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AS18029') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AS86854') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AT35703') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AU42878') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AV19170') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AV51392') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AV67353') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AV68545') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AV80430') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AW08611') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AW59097') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AX10736') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AX74120') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BA18229') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BA41377') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BB74260') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BB75246') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BC06913') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BC65295') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BD47800') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BD49614') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BD97066') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BE00503') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BE37921') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BF35632') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BF57061') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BF72847') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BF77211') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BF85858') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BF97183') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BG07457') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BG59012') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BG66813') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BH14894') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BH68210') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BH97370') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BK22174') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BL04511') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BM42864') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BN03694') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BP23923') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BR14910') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BR53160') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BR88807') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BS27875') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BS87926') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BV74648') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BV85221') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BV90046') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BW16600') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BW84151') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BX05660') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BX07396') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BX70852') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BY10843') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BY23081') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ11775') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ49239') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CB16109') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CB73564') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CC09877') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CC33560') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CC81161') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CD00484') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CD29935') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CD89177') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CE12103') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CE42252') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CE84774') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CF05916') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CF24380') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CF79190') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CG08152') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CG97261') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CH81752') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CH98255') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CK11901') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CK25768') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CK65269') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CK80214') HTTP/1.1" 204 0
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CM23885') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CM52533') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CN17481') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CN73192') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CP48685') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CP94846') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CR31763') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CS22351') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CS39553') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CS91780') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CT32974') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CU19217') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CU48528') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CV73242') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CW07169') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CW55467') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CX02051') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CX31809') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CX43876') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CX96906') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CY04532') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CY77324') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ08474') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DA15848') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DA34914') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DA90713') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DA99208') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DB14666') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DB25188') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DB83782') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DC40176') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DC68208') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DC90878') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DD02549') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DD27016') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DD33348') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DD88877') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DD95214') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DE87759') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DF41052') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DF76549') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DF88312') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DG34611') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DG56396') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DG95074') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DH52539') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DH89283') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ24722') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ24931') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ28473') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DK10802') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DL00141') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DL37829') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DL54260') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DM10517') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DM32442') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DM81124') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DM93215') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DN08214') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DN16140') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DN24250') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DN83607') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DP64390') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DR74800') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DS21483') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DS88107') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DT05191') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DT44924') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DT55360') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DU40442') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DU71150') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DV02154') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DV12193') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DV25383') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DV31200') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DW36135') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DW59848') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DW68049') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DX54888') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DY57810') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ18586') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ68437') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ74438') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EA24204') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EA25616') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EA53617') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EA67051') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EB72536') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EB77706') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ED10766') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ED21052') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EE16719') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EF32660') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EF56679') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EF61011') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EG18092') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EH01561') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EH66541') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ46088') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ77666') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EK41234') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EL06604') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EL16664') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EL22711') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EL31717') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EL92761') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EM05740') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EM08805') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EM43363') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EN69875') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EN78707') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EP66881') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EP71522') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EP83467') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ER68726') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ER89223') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ET61209') HTTP/1.1" 204 0
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ET77567') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ET82238') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EV36889') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EV50095') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EV69737') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EW21472') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EW60491') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EW71270') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EX16763') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EX40228') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EX80260') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EY05463') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ42785') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FA62383') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FB32313') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FB85427') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FB96684') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FC43994') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FC64824') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FD53596') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FD81438') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FE25313') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FE53569') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FF21332') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FF91395') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FG17042') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FG75517') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FH63560') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FH83777') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FH99066') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ17863') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ65600') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FK34639') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FK67393') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FL16979') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FL24162') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FL27980') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FL29274') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FL30948') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FL35670') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FL41027') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FL62033') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FM04287') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FN43708') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FP47340') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FP58382') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FR61206') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FR73887') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FS00229') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FS42510') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FT04585') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FT06461') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FU45583') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FU73957') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FV15525') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FV36553') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FV80512') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FW09331') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FW24951') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FW55816') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FX18763') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FY05819') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FY41301') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FY49050') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GA14608') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GA36597') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GA57616') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GB26940') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GB95823') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GC09977') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GC69161') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GD26673') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GD84039') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GE18332') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GE57147') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GE99977') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GF23092') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GG38022') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GG93475') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GH64501') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ29210') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GK84709') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GL47278') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GL66721') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GN90285') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GP61424') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GP91908') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GR22100') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GS02445') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GT24597') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GT95887') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GU29779') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GV47919') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GW46376') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GX98955') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GY82730') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GY96081') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GY96163') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ32446') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ95398') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HA59595') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HA80025') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HB08466') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HB25148') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HB72998') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HB76846') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HB77071') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HC01371') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HC11603') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HC27570') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HC51524') HTTP/1.1" 204 0
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HC90817') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HD30580') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HD90949') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HE04826') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HE71933') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HG29247') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HG60757') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HG69051') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HG81615') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HG84341') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HG91802') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ42012') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ76736') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HK22859') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HK87865') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HL10561') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HL37273') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HL99119') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HM75292') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HM82789') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HP24854') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HP60741') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HR01670') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HR22665') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HR60710') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HR91653') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HS49333') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HS49554') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT03152') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT26975') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT51655') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT72839') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT75427') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HV13956') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HV52909') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HW29828') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HW59975') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HX27579') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HX71136') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HX83582') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HY09950') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HY39527') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JA07463') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JA31790') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JA51854') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JB30434') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JB89867') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JC07820') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JC10785') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JD55916') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JD68794') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JE09646') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JE28304') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JE35957') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JF01718') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JF02873') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JF10828') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JF13550') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JF38916') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JF42728') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JF92138') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JG90003') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JG99906') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JH50907') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JK22330') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JM02516') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JM19534') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JN00237') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JN32091') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JN41944') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JN58446') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JP40849') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JS01714') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JU19826') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JU86791') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JV50059') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JV63190') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JV79372') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JW39032') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JW91465') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JX69270') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JX74869') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JY94530') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ61052') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ81194') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ92752') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KA29356') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KA46838') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KA79218') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KB02718') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KB83594') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KC75912') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KC76053') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KD46095') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KD76210') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KD97757') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KH12434') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KH52507') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ11909') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ27422') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ81960') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KK24232') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KK74577') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KK98529') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KL06340') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KL43472') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KM20579') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KN17663') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KP40220') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KR25525') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KS07737') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KS72113') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KS81188') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KS92375') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KT05836') HTTP/1.1" 204 0
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KT63919') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KU11171') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KV45141') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KV72826') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KW53381') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KX02531') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KX42135') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KX62771') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KX77588') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KY22046') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KY38422') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KY87808') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ40045') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ40910') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ59574') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ64237') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ68822') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LA63885') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LA92268') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LB29277') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LB64238') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LC12643') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LC86336') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LD57098') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LD83438') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LE66161') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LF11408') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LG02122') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LG19024') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LG36605') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ84791') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ88675') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LK77652') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LL56557') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LM35981') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LM78039') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LM97195') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LM98077') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LN15858') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LN50408') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LN80731') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LP66466') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LR15434') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LR19185') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LR31588') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LS25004') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LS28697') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LT57344') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LU36725') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LU91964') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LV58634') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LW03566') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LW16495') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LX12252') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LX57861') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LX62095') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LY11964') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LY27469') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LY47775') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LY67670') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ41567') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ41589') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ67936') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ79684') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ90737') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ92437') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ97087') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MA02944') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MA40868') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MA94229') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MD03906') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MD04240') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MD86637') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MD96557') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ME13008') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ME27003') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MF38370') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MF97595') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MH60501') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ09553') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ30345') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MK00325') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MK56542') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MK60962') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ML80010') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MM08777') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MN22228') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MN49305') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MN80105') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MP58429') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MP75045') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MR49723') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MR51791') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MR66589') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MR74819') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MS18593') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MS25099') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MS75101') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MT16554') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MT78723') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MV45752') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MV51354') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MV71684') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MW28289') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MW45598') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MW61217') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MW88420') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ20393') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ43250') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NA02037') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NB00442') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NB70778') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NE53988') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NG55769') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NG69448') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NG73471') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NG86587') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NH44518') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ16050') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ50994') HTTP/1.1" 204 0
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NK01766') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NK47445') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NL84000') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NM07390') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NP27930') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NR78353') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NR80165') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NR94242') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NR96055') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NS06583') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NS42830') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NS88846') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NT49276') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NT58972') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NT98208') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NV06253') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NV24756') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NV44376') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NV61629') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NW54106') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NX00147') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NX26916') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NX53505') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ64764') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ85944') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ98323') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PA22302') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PA30979') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PC29624') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PC30638') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PC43332') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PC62615') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PD52440') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PD58161') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PD71569') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PE38325') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PE75006') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PF44048') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PG46559') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ85299') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PK88704') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PL78548') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PM17197') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PN21197') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PN46973') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PP21444') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PR37520') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PT23276') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PT34660') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PT82829') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PT99002') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PV24176') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PV40965') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PV48618') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PW09321') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PW66487') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ24364') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ48957') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ63796') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ76056') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RA17986') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RA22757') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RA51445') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RA95438') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RB88750') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RC90212') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RC90507') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RD29858') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RD62434') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RD92309') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RE32012') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RE40934') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RE71978') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RE86533') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RF75391') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RF90584') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RG29496') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RG34214') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RG46048') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ07592') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ11676') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ59525') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RK42579') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RL03845') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RL39686') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RL54950') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RL87986') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RN06750') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RN24073') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RN48653') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RN89506') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RP18393') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RP74433') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RS28653') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RS63501') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RS72101') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RS99493') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RT20033') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RU73566') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RU85511') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RV62411') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RW44470') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RW74329') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RW92168') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RX53642') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RX68318') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RX86727') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RY37521') HTTP/1.1" 204 0
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RY52055') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ32548') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SA15883') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SA17418') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SA48536') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SA54871') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SB49719') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SC95920') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SD15783') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SD71335') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SE30263') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SE35232') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SE41131') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SE69152') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SF00401') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SF71774') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SF86380') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SG04043') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SG12143') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SG17915') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SG85178') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ19230') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SK47826') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SL51204') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SM04860') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SN38705') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SP49200') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SP68035') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SP81336') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SR36738') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SR73766') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SS05467') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SS39773') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SS59526') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SS95122') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ST22552') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SU20373') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SU65060') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SU99344') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SV44201') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SV61668') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SV66187') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SV93114') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SW47319') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SX52611') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SX80991') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SY89369') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ09904') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ14883') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ33241') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TA06372') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TA39894') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TB57719') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TB64088') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TB89261') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TE05074') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TE29720') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TF22894') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TF26573') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TF81030') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TG47232') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TH24188') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TH69094') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TH73607') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ63622') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TK02477') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TK23703') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TK61883') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TK82535') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TK89368') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TL52967') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TL54182') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TM25087') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TP26817') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TP28811') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TP37165') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TP47389') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TR04100') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TR49682') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TR76873') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TS01763') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TS70088') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TT31415') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TT68827') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TT90751') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TU71121') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TV08904') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TV40713') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TW09789') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TW19910') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TX12342') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TX32153') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TY17461') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TY20529') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TY36647') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ30121') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UB08848') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UB39863') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UB45906') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UB81451') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UC09132') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UC12060') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UC79267') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UD21167') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UD74818') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UD86522') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UE19773') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UE23496') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UF39671') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UG47439') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UG65719') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UG92128') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UG95192') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UG98408') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UH37048') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UH85753') HTTP/1.1" 204 0
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UL31255') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UL41002') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UL94398') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UM08416') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UN50260') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UN67551') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UP35188') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UP40275') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UP58161') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UR73301') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UR81883') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='US43610') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='US58549') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='US72791') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='US86784') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UU07960') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UU20180') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UV97046') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UW13556') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UW14242') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UW55953') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UX02896') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UY06535') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UY85190') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ06003') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ37057') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ81978') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ88327') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ93598') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VA29887') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VB99238') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VC85429') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VD46921') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VE22380') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VE94057') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VF63759') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VF75150') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VG37104') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VG43555') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VG77342') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VG96972') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VH52127') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VH73564') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VH97498') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ67966') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VK45952') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VK69224') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VK94539') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VM65367') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VN02329') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VP60062') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VP95743') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR93183') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR94041') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VS15824') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VS50651') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VS58635') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VT04677') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VT40863') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VT71274') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VU29414') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VU41046') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VV50674') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VV62509') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VW33737') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VW75839') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VX30390') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VX37967') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VX47990') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VX60164') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VX62793') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VX81084') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WA01734') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WA93761') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WB90002') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WC07625') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WC26675') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WC81779') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WC85475') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WE28661') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WE29234') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WE88560') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WF88080') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WG18448') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WG21880') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WG49121') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WH81501') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WH94245') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ11524') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WK26069') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WK33395') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WL02996') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WL03333') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WL67462') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WL90525') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WM51027') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WM63649') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WM78595') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WM83452') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WP19747') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WP64025') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WP87454') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WR28878') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WR52983') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WR75781') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WS43283') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WS55091') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WS69627') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WS70043') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WT70832') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WT90595') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WU87071') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WV54187') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WV54197') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WV68222') HTTP/1.1" 204 0
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WW01568') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WW24820') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WW45597') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WX19449') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WX86696') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WY11052') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WY34206') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WY70288') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WY91737') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ94517') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XA87237') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XB58334') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XC72350') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XC77277') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XD48260') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XD87480') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XE33322') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XE42171') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XE90928') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XF05598') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XF36134') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XF41123') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XF75571') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XG08290') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XG41854') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XH24781') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XH86987') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XK01134') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XK08190') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XK41969') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XK59952') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XL36638') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XL80486') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XM13822') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XM60218') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XM95043') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XN80329') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XP24441') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XP43070') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XR76769') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XS87802') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XT49167') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XT82466') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XU13443') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XU28846') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XU64053') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XU76379') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XU93534') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XV11788') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XV30832') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XV31722') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XV84835') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XW29442') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XW43246') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XX36660') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XX96565') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XY02166') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XY23655') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XY45961') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XY47347') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XY66054') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XY85636') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XY85675') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ42206') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ48142') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ62443') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ74746') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YB14596') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YB40435') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YC04316') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YD28016') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YD28826') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YD69577') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YD73084') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YE34962') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YE80822') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YE99980') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YF11664') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YF32220') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YF96126') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YG59093') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YH77632') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ28781') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ83252') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YK23100') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YK53623') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YL15408') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YL44693') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YL64863') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YM37880') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YM74399') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YM88474') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20last_price_update_time%20lt%201774378046&NextPartitionKey=1%2112%21YXV0bzEuZGU-&NextRowKey=1%2112%21WU04OTEyMw-- HTTP/1.1" 200 None
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YN65867') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YP40930') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YR55945') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YR99771') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YS92150') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YT11417') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YT74001') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YT78106') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YU12997') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YU48022') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YU73215') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YV22410') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YW42577') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YW49351') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YY07994') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YY24633') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YY63940') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ12347') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ75563') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA36266') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB32990') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE36307') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE36706') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE65014') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF31177') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG24263') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG40523') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG84014') HTTP/1.1" 204 0
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH11234') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH13125') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ14408') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK24481') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK71758') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL62950') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL93367') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM04964') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM31098') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM57551') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN55562') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN86582') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR39800') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR65443') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS43135') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU32448') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU32637') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV27055') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW22441') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW43649') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW65210') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX14624') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX18582') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX76486') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY26748') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ35419') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ40834') HTTP/1.1" 204 0
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ56834') HTTP/1.1" 204 0
2026-03-29 18:47:36 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (1621 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_17_2026-03-29T18_30_00.jl
2026-03-29 18:47:36 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 517910,
'downloader/request_count': 180,
'downloader/request_method_count/GET': 8,
'downloader/request_method_count/POST': 172,
'downloader/response_bytes': 29311835,
'downloader/response_count': 180,
'downloader/response_status_count/200': 180,
'dupefilter/filtered': 3,
'elapsed_time_seconds': 1049.395895,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 29, 18, 47, 36, 213953, tzinfo=datetime.timezone.utc),
'item_scraped_count': 1621,
'log_count/DEBUG': 19632,
'log_count/INFO': 23414,
'memusage/max': 164782080,
'memusage/startup': 148025344,
'request_depth_max': 173,
'response_received_count': 180,
'scheduler/dequeued': 180,
'scheduler/dequeued/memory': 180,
'scheduler/enqueued': 180,
'scheduler/enqueued/memory': 180,
'scrape_type/batch_skipped': 3407,
'scrape_type/new': 3,
'scrape_type/price_update': 1618,
'scrape_type/skipped': 1749,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 180,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 4.534821838481975,
'scrapy-zyte-api/mean_response_seconds': 4.593532307207998,
'scrapy-zyte-api/processed': 180,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 180,
'scrapy-zyte-api/request_args/experimental.requestCookies': 179,
'scrapy-zyte-api/request_args/experimental.responseCookies': 180,
'scrapy-zyte-api/request_args/httpRequestBody': 172,
'scrapy-zyte-api/request_args/httpRequestMethod': 172,
'scrapy-zyte-api/request_args/httpResponseBody': 180,
'scrapy-zyte-api/request_args/httpResponseHeaders': 180,
'scrapy-zyte-api/request_args/sessionContext': 180,
'scrapy-zyte-api/request_args/url': 180,
'scrapy-zyte-api/status_codes/200': 180,
'scrapy-zyte-api/success': 180,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 6780,
'source/total_available': 6740,
'start_time': datetime.datetime(2026, 3, 29, 18, 30, 6, 818058, tzinfo=datetime.timezone.utc)}
2026-03-29 18:47:36 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 18:47:36 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f95d0239690>
2026-03-29 18:47:36 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f95d0363ed0>